Frequently Asked Questions

  1. What are you asking our faculty, administrators, or student affairs staff to do?
  2. Who is the target population for the Faculty Survey of Assessment Culture?
  3. Who is the target population for the Administrators Survey of Assessment Culture?
  4. Who is the target population for the Student Affairs Survey of Assessment Culture?
  5. What are the timelines for registration and survey administration?
  6. What do the surveys cover?  Are the surveys controversial or risky?
  7. What costs are associated with each survey?
  8. What forms of payment are accepted?
  9. What must my institution submit to register for participation in a Survey of Assessment Culture?
  10. What will I or my institution receive?  How will we benefit from participation?
  11. Why should my institution participate in this research?
  12. How have other institutions used the resources generated from this research?  How many have participated in the past?  What have they said about their experience?
  13. What do I need to provide?  How difficult is it to complete the information required for our faculty, administrators, or staff to participate in the study?
  14. Are the surveys anonymous or confidential?  How will you protect participant responses?
  15. My Institutional Review Board or administration requires an internal review of this research.  Can you help with this internal review?  Has this survey been reviewed by the Sam Houston State University Institutional Review Board?
  16. Will we receive data from this survey?
  17. What are the risks to faculty, administrators, staff, myself, or our institution?
  18. Can we advertise the surveys on our institution?
  19. Can my institution request that additional questions be added to the survey?  Can we change questions on the survey?
  20. Who is leading this research? Who do I contact if I have more questions?

What are you asking our faculty, administrators, or student affairs staff to do?

Research participants in a Survey of Assessment Culture will be asked to participate in an online survey of their perspectives related to your institution’s culture of assessment.  Responses are confidentially recorded and participants will be notified of this via a statement of informed consent prior to beginning any survey.  Most of the questions are not required to complete the survey and participants can discontinue their participation in a survey at any time.  The average time to complete any of the three Surveys of Assessment Culture in prior administrations was 23 minutes. 

Samples of initial and reminder emails containing instructions and the link which will be sent from our team can be found here. 

A draft of an explanation email for the assessment coordinator to send participants before the survey launches can be found here.

Who is the target population for the Faculty Survey of Assessment Culture?

Institutions participating in the Faculty Survey of Assessment Culture can use the Contact File Template to submit the institutional email addresses of anyone teaching a credit-generating course in the semester of administration.

For further information on the Faculty Survey, click here.

Who is the target population for the Administrators Survey of Assessment Culture?

Institutions participating in Administrators Survey of Assessment Culture should provide a listing of all administrative staff at their institution, excluding those staff members in Divisions of Student Affairs/Student Services. The Contact File Template can be accessed here. 

Determining who is an administrative staff member can be a challenge.  We define an administrator according to the U.S. Bureau of Labor Statistics’ definition:  An administrator is anyone who manages the short- and long-term functional operations of a college or university. Within reason, institutions may determine who is contained in this survey population.  However, we advise that institutions survey more individuals rather than fewer.  Ensure that as many administrative team members are included, regardless of their rank or position.

Many institutional assessment leaders express concerns that some administrative staff simply do not have assessment responsibilities in their job functions or are not familiar with assessment practices.  This does not mean that administrative staff members are detached from their institution’s culture of assessment.  Moreover, assessment and institutional leaders have benefited from learning just how pervasive an understanding of assessment is in administrative units.  Data from this survey—if administered to a wider population of participants—is helpful in exploring these assumptions. Since administrators can skip any questions on the survey that do not pertain to them, we encourage institutions to survey as many administrative leaders as reasonable. 

Again, student affairs staff should not be included in this contact file as they are surveyed under the Student Affairs Survey of Assessment Culture.

For further information on the Administrators Survey, click here.

Who is the target population for the Student Affairs Survey of Assessment Culture?

All professional staff members in a division of student affairs or student services should be included in this survey’s Contact File Template.  Divisions of student affairs are diverse organizations with unique perspectives on cultures of assessment.  Some assessment leaders are concerned that staff may not know much about assessment and therefore cannot respond to the survey.  In our experience, this is typically not the case.  Even staff with little familiarity of assessment practices can have a perspective on the use of evidence to make decisions (Assessment Culture).  No participant is forced to respond to a survey question with which they are unfamiliar.  Finally, many assessment leaders tell us that simply discussing who is “at the assessment table” while preparing the contact files for this survey is a valuable, reflective process and that the collection of a wide groups’ perspectives on assessment are extremely valuable.  

For further information on the Student Affairs Survey, click here.

What are the timelines for registration and survey administration?

Please see the calendar of timelines offered below.  These timelines apply to the Administrators Survey of Assessment Culture, the Student Affairs Survey of Assessment Culture, the Faculty Survey of Assessment Culture, and institutions participating in two or all three surveys.

Survey Administration Timeframes:

Fall 2019

Registration Due: September 23, 2019

Launch Date: October 14, 2019

Reminder Emails: October 28, November 4, and November 11, 2019

Survey Closing: November 18, 2019

Reports Available: January 13, 2020

Spring 2020

Registration Due: February 24, 2020

Launch Date: March 16, 2020

Reminder Emails: March 30, April 6, and April 13, 2020

Survey Closing: April 20, 2020

Reports Available: May 18, 2020

Summer 2020

Registration Due: June 8, 2020

Launch Date: June 29, 2020

Reminder Emails: July 13, July 20, and July 27, 2020

Survey Closing: August 3, 2020

Reports Available: August 31, 2020

Fall 2020

Registration Due: September 21, 2020

Launch Date: October 12, 2020

Reminder Emails: October 26, November 2, and November 9, 2020

Survey Closing: November 16, 2020

Reports Available: January 2021 (exact date TBD)

 

Interested in a particular timeframe for your institution’s administration of one of our surveys? Please contact us to see if availability of particular timeframes exist. Please note: Data and reports are made available on the standard release date following completion of a specially-administered survey.  

What do the surveys cover?  Are the surveys controversial or risky?

Most of the questions on the Surveys of Assessment Culture are neither risky nor controversial.  However, some of the questions ask participants to assess their institution’s administration, other employees, and staff commitment to assessment.  The survey also covers participants’ perceptions of institutional resources for assessment, the purpose of assessment at your institution, and reasons for engaging in or avoiding assessment.  To reduce risk, none of the questions are required to complete the survey and participants can discontinue their participation in the survey at any time. 

A DRAFT of each survey can be found on the links below.  These are password protected files. The password can be obtained by emailing assessmentculture@shsu.edu.

DRAFT- Administrators Survey of Assessment Culture

DRAFT- Student Affairs Survey of Assessment Culture

DRAFT- Faculty Survey of Assessment Culture

What costs are associated with each survey?

Beginning in the Spring 2018 semester, fees associated with administering the Survey of Assessment Culture have been collected.  These funds will allow our staff to offer enhanced reports, data files, and timely services.  Costs associated with the survey can be found here.

What forms of payment are accepted?

Sam Houston State University currently accept credit cards, purchase order, and checks.  For guidance pertaining to payments please contact us.

What must my institution submit to register for participation in a Survey of Assessment Culture?

Participating institutions must submit a signed Data Sharing Agreement and email addresses on a Contact Data Template.  Instructions for submitting these materials can be found by clicking on the links.

What will I or my institution receive? How will we benefit from participation?

Participating institutions receive some of the best data and reports pertaining to faculty and staff perceptions about assessment at their institution.  For every survey in which your institution participates, you will receive a report detailing the means, frequencies, and survey administration details.  this report also provides data from open ended questions on the survey.  Finally, you will receive a data file and code book (in MS Excel format) for all questions on the survey.  These data files include any additional questions requested by participating institutions. Click on this link for a sample of an institution's Mean and Frequencies Report.

Individuals interested additional analyses should contact us to determine how we can best serve your needs.

 Why should my institution participate in this research?

Participants will be making a valuable contribution to the scholarship on the understudied concept of institutional culture of assessment.  They will also be contributing to your institution’s conversation on its culture of assessment.  Additionally, participation in this survey could support employees, administrators, and staff members' desires to engage other colleagues in dialogue about campus assessment efforts.  You will receive valuable feedback from research participants on the important topic of assessment on your campus with which you can plan for improvements.  Lastly, institutions have found this data tremendously useful in preparing for and engaging in various institutional processes such as strategic planning, accreditation, research, or visioning exercises.  Please check out our Testimonials Page or our Research Page to learn more about how other institutions have used and benefited from these data.

How have other institutions used the resources generated from this research?  How many have participated in the past?  What have they said about their experience?

Since 2011, over 5,100 employees from hundreds of institutions across the nation have completed the Faculty Survey of Assessment Culture.  Prior administrations of the Survey of Assessment Culture have resulted in useful information to initiate institutional dialogue about institutional cultures of assessment.  Assessment and Institutional research directors have found the study results useful in engaging faculty about perceptions of the institution’s culture of assessment.  Participants have noted that the Survey has also supported their ability to make long-term plans and set goals for their institution’s culture of assessment.  Many institutions are using the data for grant and accreditation or quality enhancement efforts as well. Finally, the reports, resources, and presentations done by research staff have been useful in refining institution cultures of assessment on a number of institutions.  Check out our Testimonials page for insight on past experiences. 

What do I need to provide?  How difficult is it to complete the information required for our faculty to participate in the study?

The process for providing the contact information for the survey is relatively easy.  There are three registration and administration periods (Spring, Summer, and Fall) in any given year.  Timelines for registration and survey administration are listed above.  There are three steps to secure your institution’s participation in any survey.

  • First, complete the Data Sharing Agreement (one per institution) and a Contact File Template for each survey in which your institution is participating.
  • Second, upload these files and the signed Data Sharing Agreement on the Registration Page. (Please note: individuals with “signing authority” for an institution may use our electronic consent form on the Registration Page in lieu of scanning and uploading a printed Data Sharing Agreement.  However, if signatures of senior leaders or individuals not completing the registration are required, an upload feature is also available on the registration page.  Payment details will be collected during registration.
  • Third, add "Sam Houston State University" and "Dr. Matthew Fuller" and "mbf005@shsu.edu" to any institutional email security filters you may have in place.  This measure ensures email invitations and reminders are received by research participants.  A member of our research team will confirm receipt and accuracy of all materials with you within a week of submission.  After these steps are accomplished, the survey(s) will launch on your campus and our research team members will be in touch regularly to offer updates.

Are the Surveys anonymous or confidential?  How will you protect participant responses?

For each institution participating in the study, the listing of faculty, administrators, or staff invited to participate in the survey will be confidential and will not be used beyond inviting and reminding faculty to participate in the survey.  Responses to all Surveys will be collected in a strictly confidential fashion. Invitations to participate in the survey are confidentially sent out, and once employees complete the survey, their responses will be recorded as confidential entries and their identifying information from the recordings will be deleted from the data files.  Research participants will be notified of this in the Surveys’ Statements of Informed Consent.  Participating institutions’ names may be shared in reports and on websites.  In cases of open-ended questions, it should be the participant's understanding that they may forfeit their anonymity if they choose to include identifiable content.

My Institutional Review Board or administration requires an internal review of this research.  Can you help with this internal review?  Has this survey been reviewed by the Sam Houston State University Institutional Review Board?

The Survey of Assessment Culture has been approved by the Sam Houston State University Institutional Review Board (Protocol Number 2013-08-11722).  A copy of this determination letter can be found online by clicking here.  If additional, institution-specific reviews are necessary, the request for this information should be made by email (assessmentculture@shsu.edu) as soon as possible.  Unfortunately, we are unable to complete IRB protocols on behalf of other institutions but will be happy to provide information and support for those interested in submitting a protocol for their institution.

Will we receive data from this survey?

Yes.  A data file (in MS Excel format) and a codebook will be sent to all participating institutions.

What are the risks to faculty, administrators, myself, or our institution?

Though the current study has no more than minimal risks, all research has risks.  Some research participants may find the questions challenging to answer.  Participants may find the survey effort challenging as well, particularly if the topic of the institution’s culture of assessment is contentious or difficult to discuss at your institution.  For some, allowing participants to respond to the survey’s questions may outweigh the perceived benefits of engaging in the survey.  The survey is meant to spark dialogue and contribute to the scholarship on the often advocated, but seldom understood topic of cultures of assessment in higher education.  However, if reputational or political risks outweigh the potential gain, no institution or participants are required to participate in the voluntary research.  Finally, there is a risk for participants’ identities to be revealed.  The survey will record responses confidentially, so unless participants identify themselves through demographic or open ended data, participants’ identities cannot be revealed. All participants will be notified of these standards via a Statement of Informed Consent. 

Can we advertise this survey on our institution?

Yes!  Locally advertising the Survey of Assessment Culture through speeches, emails, communications, etc. is highly encouraged.  We ask that you not provide any monetary incentives for participation in the survey as this is not approved through our survey protocol and may influence responses for reasons unrelated to the topic under study.  A sample email to send to potential participants before the survey launches may be found here.  Many institutions have also found it beneficial to add "Matthew B. Fuller" and "mbf005@shsu.edu" and "Sam Houston State University" to their institution's spam filter "white list."

Can my institution request that additional questions be added to the survey?  Can we change questions on the survey?

Yes. Up to 16 additional questions can be added to the end of each survey for a fee of $500 per survey.  Instructions for supplying these additional questions are included on the Registration Page.  Since this research effort is an ongoing, longitudinal, nationwide study, we are unable to change questions or responses to core questions.

Who is leading this research?  Who do I contact if I have more questions?

Dr. Matthew Fuller, Associate Professor of Higher Education Administration and Director of the Higher Education Leadership Doctoral Program at Sam Houston State University is the Principal Investigator for this annual study.  He may be reached at assessmentculture@shsu.edu or 936.294.1147.