AI Assisted Assessment Planning

Welcome to the AI-Assisted Assessment Plan Guide

At Sam Houston State University, the Office of Assessment is committed to providing faculty and staff with the resources and tools necessary to design, implement, and evaluate effective assessment plans. Our mission is to support the ongoing improvement of academic and non-academic units across all colleges and divisions. We encourage the use of AI to streamline the creation and evaluation of assessment plans, facilitating easier alignment with institutional goals and promoting continuous improvement.

While AI can be a powerful tool for generating elements of your assessment plan, it is important to remember that the human element plays a crucial role in the process. AI responses are only as good as the prompts you provide. Crafting clear, specific, and thoughtful prompts is essential. Faculty and staff must carefully review and adapt the suggestions generated by AI to ensure they meet the standards of our institution and reflect the unique needs of each program.

Additionally, it is essential to be aware of the environmental impact of utilizing AI technologies. The computational processes involved in generating AI responses consume energy and resources. As you utilize AI tools, consider adopting best practices to minimize unnecessary queries and ensure that AI is used effectively.

This page provides step-by-step guides on how to leverage AI to develop key components of assessment plans for both Academic and Non-Academic Units.

SHSU AI Guidance and Resources
SHSU Generative AI Guidance
AI @ SHSU

ACADEMIC UNITS
Step-by-Step Assessment Plan Prompt Guide

This guide provides structured AI-assisted prompts faculty can use to create Goals, Learning Objectives, Indicators, Criteria, Findings, Actions, and the New Plan for Continuous Improvement for their assessment plan(s). Each prompt includes placeholders where faculty can copy/paste program-specific information to ensure alignment with SHSU standards.

Step 1: Goals

Goal Definition: A goal is a broad statement of mission or purpose that serves as a guiding principle for a unit.

Note: Although there is no minimum number for goals, plans should have more than one goal. The number of goals should be appropriate for the size of the unit.

Prompt Template:
"You are tasked with creating Goals for an academic program. Use the following definition of a Goal when generating them: A goal is a broad statement of mission or purpose that serves as a guiding principle for a unit. Use the following mission or purpose statement of the academic program as the foundation for the Goals: [paste mission or purpose statement of the academic program here]. The Goals must be aligned with the provided definition and reflect the broad mission/purpose of the program. Please generate [insert number]Goals that serve as guiding, mission-driven statements for this academic program."

Reminder: Once AI has generated the Goals, refine the prompt and/or the AI-generated Goals as needed.

Step 2: Learning Objectives

Learning Objective Definition: A learning objective is a specific and detailed expression of the expected knowledge or skills someone should gain as a result of receiving instruction or training and should be measurable.

Prompt Template:
"You are tasked with creating Learning Objectives for an academic program. Use the following definition of a Learning Objective when generating them: A Learning Objective is a specific and detailed expression of the expected knowledge or skills someone should gain as a result of receiving instruction or training and should be measurable. Use the following Goal as the foundation for the Learning Objectives: [paste Goal here]. The Learning Objectives must align with the provided definition and clearly connect to the Goal. Please generate [insert number] Learning Objectives that describe the intended student learning outcomes associated with this Goal."

Reminder: Once AI has generated the Learning Objectives, refine the prompt and/or the AI-generated objectives as needed.

Step 3: Indicators (Methods of Measurement)

Indicator Definition: An indicator is the method, instrument, process, or technique used to evaluate a learning objective; the means of gathering data. Indicators should clearly demonstrate how they can provide data to improve learning. The indicators must be aligned with the Learning Objective.

Note: Indicators should describe the source of data (e.g., exam scores), the rubric or evaluation scale (e.g., Likert scale, pass/fail, %, etc.), and any contextual information (frequency of data collection, who will evaluate or score the items, and review results, etc.).

Assessment plans should include both direct and indirect measures, with an emphasis on direct measures. Units are encouraged to have multiple indicators per objective in order to triangulate their assessment results.

Direct Methods

Prompt Template:
"You are tasked with identifying a direct method of measurement for a Learning Objective. Use the following definition of an Indicator (method of measurement) when generating the response: An indicator is the method, instrument, process, or technique used to evaluate a learning objective; the means of gathering data. Indicators should clearly demonstrate how they can provide data to improve learning. The indicators must be aligned with the Learning Objective. Use the following Learning Objective as the basis for the method of measurement: [paste Learning Objective here]. The direct method of measurement must align with the provided definition and clearly demonstrate how student learning related to this Learning Objective will be assessed. Please generate [insert number] direct methods of measurement."

Reminder: Once AI has generated the Indicator, refine the prompt and/or the AI-generated Indicator as needed.

Indirect Methods

Prompt Template:
"You are tasked with identifying an indirect method of measurement for a Learning Objective. Use the following definition of an Indicator (method of measurement) when generating the response: An indicator is the method, instrument, process, or technique used to evaluate a learning objective; the means of gathering data. Indicators should clearly demonstrate how they can provide data to improve learning. The indicators must be aligned with the Learning Objective. Use the following Learning Objective as the basis for the method of measurement: [paste Learning Objective here]. The indirect method of measurement must align with the provided definition and clearly demonstrate how perceptions, attitudes, or reflections related to this Learning Objective will be assessed. Please generate [insert number] indirect methods of measurement."

Reminder: Once AI has generated the Indicator, refine the prompt and/or the AI-generated Indicator as needed.

Step 4: Criterion

Criterion Definition: A criterion is the benchmark, value, or result that will represent success at achieving a learning objective. It should represent a feasible or reasonable amount of success.

Note: Include contextual information to explain how the criterion for success was selected and how it is appropriate for the objective. If the criterion is derived from professional standards, required licensure passage rates, etc., then those standards should be referenced as part of the criterion description.

Caution: Although the prompt below will ensure that the Criterion will align with the Learning Objective and the Indicator, AI will generate a random number or percentage for the Criterion. You will need to decide on a Criterion (number/percentage) that is appropriate for your academic program.

Prompt Template:
"You are tasked with creating a Criterion for a Learning Objective. Use the following definition of a Criterion when generating the response: A Criterion is the benchmark, value, or result that will represent success at achieving a learning objective. It should represent a feasible or reasonable amount of success. Use the following Indicator (method of measurement) as the basis for the Criterion: [paste Indicator here]. The Criterion must align with the provided definition, clearly align with the Indicator, and clearly establish a benchmark that represents success at achieving this Learning Objective: [paste Learning Objective here]. Please generate [insert number] Criterion."

Reminder: Once AI has generated the Criterion, refine the prompt and/or the AI-generated Criterion as needed.

Step 5: Findings

Findings Definition: Findings are a clear and concise summary of the information/data gathered from an assessment indicator. They should align with the corresponding criterion for success. Findings should provide actionable data that can clearly be used for improvement; compare new findings to past trends, previous results, and/or existing standards; provide a clear explanation that the criterion was met, partially met, or not met; and provide supporting documentation, if applicable.

Note: Be sure to redact any student-identifying information from attachments. It is okay if the criterion is not met. This just provides an opportunity for future improvement.

Caution: AI-generated findings may contain inaccuracies, lack contextual nuance, or misrepresent the findings. Users are advised to carefully review and edit all AI-assisted outputs to ensure accuracy, appropriateness, and alignment with SHSU’s assessment guidelines.

Prompt Template:
"You are tasked with writing Findings for a Learning Objective assessment. Use the following definition of Findings when generating the response: Findings are a clear and concise summary of the information/data gathered from an assessment indicator. They should align with the corresponding criterion for success. Findings should provide actionable data that can clearly be used for improvement; compare new findings to past trends, previous results, and/or existing standards; provide a clear explanation that the criterion was met, partially met, or not met; and provide supporting documentation, if applicable. Use the following information as the basis for the Findings:

Learning Objective: [paste Learning Objective here]
Indicator (method of measurement): [paste Indicator here]
Criterion (benchmark for success): [paste Criterion here]
Data/Results collected: [paste summary of collected data here]
(Optional) Past results, trends, or standards for comparison: [paste here if available]

The Findings must:

Align with the provided definition.
Summarize the collected data clearly and concisely.
State whether the criterion was met, partially met, or not met.
Compare results to past trends, previous findings, or external standards (if provided).
Provide actionable data that can inform improvements.
Reference supporting documentation if available (e.g., completed rubrics, survey reports)."

Reminder: Once AI has generated the Findings, refine the prompt and/or the AI-generated Findings as needed.

Step 6: Action

Action Definition: Actions are specific steps to be taken to improve a program or unit, based on an analysis of assessment Findings. Actions should either identify an area that needs to be monitored, remediated, or enhanced (define logical next steps, identify a responsible person or group, and include completion dates) or explain why a finding will not be assessed in the future.

Prompt Template:
"You are tasked with creating Actions for continuous improvement based on assessment results. Use the following definition of an Action when generating the response: Actions are specific steps to be taken to improve a program or unit, based on an analysis of assessment Findings. Actions should either identify an area that needs to be monitored, remediated, or enhanced (e.g., define logical next steps, identify a responsible person or group, and include completion dates) or explain why a finding will not be assessed in the future. Use the following Findings as the basis for the Actions: [paste Findings here].

The Actions must:

Align with the provided definition.
Clearly connect to the Findings and address whether the criterion was met, partially met, or not met.
Identify specific steps the program/unit will take to improve student learning or program effectiveness.
Be realistic, actionable, and tied to continuous improvement.
Indicate how the Action will be monitored or reassessed in the future."

Reminder: Once AI has generated the Action, refine the prompt and/or the AI-generated Action as needed.

Step 7: Update to the Previous Cycle’s Plan for Continuous Improvement

Update of Progress to the Previous Cycle’s PCI Definition: The update should provide a progress update, with relevant contextual information, for all items discussed in the previous cycle's PCI, The narrative should clarify whether items in the previous cycle's PCI were completed or not, and to what extent. The narrative included within this item should be in the past tense. You will NOT include future actions or your new PCI here.

No Prompt Template: A prompt template is not provided for this assessment plan item. To complete this item, simply respond to the Closing Summary situated in the Previous Cycle’s Plan for Continuous Improvement (Do Not Modify) template, which is located in the Plan Item tab of your assessment plan in Anthology Planning.

Step 8: New Plan for Continuous Improvement

New Plan for Continuous Improvement (PCI) Definition: The PCI (Plan for Continuous Improvement) is a narrative summarizing all actions to be implemented into one coherent plan. The new PCI should be specific and detailed; include a summary of all identified actions found within the current plan; include any new initiatives or other items that will be assessed in the next cycle; and provide contextual information or details about what the actions are, how and when they will be implemented, and who will be responsible. The narrative included within this item should be in the future tense.

The New Plan for Continuous Improvement must:

Align with the provided definition.
Clearly connect to the Actions taken in the previous cycle.
Identify new or continuing initiatives that address opportunities for growth and improvement.
Be realistic, actionable, and aligned with the unit’s mission and/or strategic priorities.
Provide a roadmap for how the plan will be implemented, monitored, and reassessed during the upcoming academic year."

Reminder: Once AI has generated the Action, refine the prompt and/or the AI-generated Action as needed.

NON-ACADEMIC UNITS
Step-by-Step Assessment Plan Prompt Guide

This guide provides structured AI-assisted prompts that administrators and staff can use to create Goals, Performance Objectives, KPIs, Targets, Results, Actions, and the New Plan for Continuous Improvement for their assessment plan(s). Each prompt includes placeholders where administrators/staff can copy/paste unit-specific information to ensure alignment with SHSU standards.

Step 1: Goals

Goal Definition: A goal is a broad statement of mission or purpose that serves as a guiding principle for a unit.

Note: Although there is no minimum number for goals, plans should have more than one goal. The number of goals should be appropriate for the size of the unit

Prompt Template:
"You are tasked with creating Goals for a [insert name of unit]at a four-year university. Use the following definition of a Goal when generating them: A goal is a broad statement of mission or purpose that serves as a guiding principle for a unit. Use the following mission or purpose statement of the unit as the foundation for the Goals: [paste unit mission/purpose for the unit here]. The Goals must align with the provided definition and reflect the unit’s broad mission/purpose. Please generate [insert number] Goals that serve as broad, guiding, mission-driven statements for this unit."

Reminder: Once AI has generated the Goals, refine the prompt and/or the AI-generated Goals as needed.

Step 2: Performance Objectives

Performance Objective Definition: A Performance Objective is a specific and detailed statement of the expected attainment of non-learning tasks and should describe the desired quality or improvement of services (e.g., satisfaction with service, attendance/participation levels, student recruitment and enrollment, general administrative functions). The Performance Objective must be measurable.

Note: Each Goal should be supported by more than one Performance Objective.

Prompt Template:
"You are tasked with creating Performance Objectives for [insert name of the administrative/support unit here]. Use the following definition of a Performance Objective when generating them: A Performance Objective is a specific and detailed statement of the expected attainment of non-learning tasks and should describe the desired quality or improvement of services (e.g., satisfaction with service, attendance/participation levels, student recruitment and enrollment, general administrative functions). The Performance Objective must be measurable. Use the following Goal as the foundation for the Performance Objectives: [paste Goal here]. The Performance Objectives must align with the provided definition and clearly connect to the Goal, focusing on non-learning tasks (e.g., service quality, timeliness, participation, operational efficiency). Please generate [insert number] Performance Objectives."

Reminder: Once AI has generated the Performance Objective, refine the prompt and/or the AI-generated objective as needed.

Step 3: Key Performance Indicators (KPIs)

Key Performance Indicator (KPI) Definition: A KPI is the method, instrument, process, or technique used to measure and evaluate a performance objective; the means of gathering data. The KPI should clearly demonstrate how it can provide data to improve performance.

Note: KPIs should clearly show should describe the source of data (e.g., survey data), the evaluation scale (e.g., Likert scale), and any contextual information (how data is gathered and by whom, who will review the results, etc.). Assessment plans should include both direct and indirect measures, with an emphasis on direct measures. Units are encouraged to have multiple indicators per objective in order to triangulate their assessment results.

Direct Methods

Prompt Template:
"You are tasked with identifying a direct method of measurement (i.e., KPI) for a Performance Objective. Use the following definition of a KPI when generating the response: A KPI is the method, instrument, process, or technique used to measure and evaluate a performance objective; the means of gathering data. The KPI should clearly demonstrate how it can provide data to improve performance. Use the following Performance Objective as the basis for the KPI: [paste Performance Objective here]. The KPI must align with the provided definition and clearly describe the direct methods/instruments/processes used to measure and evaluate the Performance Objective (e.g., satisfaction surveys, service response times, appointment rates, event attendance, website analytics, institutional data). Please generate [insert number] KPIs.”

Reminder: Once AI has generated the KPI, refine the prompt and/or the AI-generated KPI as needed.

Indirect Methods

Prompt Template:
"You are tasked with identifying an indirect method of measurement for a Performance Objective. Use the following definition of a KPI when generating the response: A KPI is the method, instrument, process, or technique used to measure and evaluate a performance objective; the means of gathering data. The KPI should clearly demonstrate how it can provide data to improve performance. Use the following Performance Objective as the basis for the KPI: [paste Performance Objective here]. The KPI must align with the provided definition and clearly describe the methods/instruments/processes used to measure and evaluate the Performance Objective (e.g., satisfaction surveys, service response times, appointment rates, event attendance, website analytics, institutional data). Please generate [insert number] KPIs.”

Reminder: Once AI has generated the KPI, refine the prompt and/or the AI-generated KPI as needed.

Step 4: Target

Target Definition: A target is the benchmark, value, or result that represents success in achieving a performance objective. It should represent a feasible or reasonable amount of success.

Note: Include contextual information to explain how the target for success was selected and how it is appropriate for the objective. A target for success should be ambitious but attainable.

Caution: Although the prompt below will ensure that the Target will align with the Performance Objective and the KPI, AI will generate a random number or percentage for the Target. You will need to decide on a Target (number/percentage) that is appropriate for your unit.

Prompt Template:
"You are tasked with creating Targets for a Performance Objective. Use the following definition of a Target when generating the response: A target is the benchmark, value, or result that represents success in achieving a Performance Objective. It should represent a feasible or reasonable amount of success. Use the following KPI as the basis for the Target: [paste KPI here]. The Target must align with the provided definition and establish a clear, time-bound benchmark that indicates success for this Performance Objective [paste Performance Objective here]. Please generate [insert number] Targets. (Optional) If helpful, include baseline value and timeframe (e.g., ‘by end of FY’, ‘each semester’)."

Reminder: Once AI has generated the Target, refine the prompt and/or the AI-generated Target as needed.

Step 5: Results

Results Definition: Results are a clear and concise summary of the information gathered from a KPI. They should align with the corresponding target for success. Results should provide actionable data that can clearly be used for improvement.

Caution: AI-generated results may contain inaccuracies, lack contextual nuance, or misrepresent the results. Users are advised to carefully review and edit all AI-assisted outputs to ensure accuracy, appropriateness, and alignment with SHSU’s assessment guidelines.

Prompt Template:
"You are tasked with writing Results for a Performance Objective assessment. Use the following definition of Results when generating the response: Results are a clear and concise summary of the information gathered from a KPI. They should align with the corresponding target for success. Results should provide actionable data that can clearly be used for improvement. Use the following information as the basis for the Results:

Performance Objective: [paste Performance Objective here]
KPI: [paste KPI here]
Target (benchmark for success): [paste Target here]
Data/Results collected: [paste summary of collected data here]
(Optional) Past results, trends, or external standards for comparison: [paste here if available]
(Optional) Context/constraints (e.g., staffing, system changes): [paste here if applicable]

The Results must:

Align with the provided definition.
Summarize the collected data clearly and concisely.
State whether the Target was met, partially met, or not met.
Compare results to past trends, previous cycles, or external standards (if provided).
Highlight actionable insights that can inform improvement.
Reference supporting documentation if available (e.g., dashboards, reports, logs)."

Reminder: Once AI has generated the Results, refine the prompt and/or the AI-generated results as needed.

Step 6: Actions

Action Definition: Actions are specific steps to be taken to improve a program or unit, based on an analysis of assessment findings. They should either identify an area that needs to be monitored, remediated, or enhanced (define logical next steps, identify a responsible person or group, and include completion dates) or explain why a finding will not be assessed in the future.

Prompt Template:
"You are tasked with creating Actions for continuous improvement based on assessment Results. Use the following definition of an Action when generating the response: Actions are specific steps to be taken to improve a program or unit, based on an analysis of assessment findings. They should either identify an area that needs to be monitored, remediated, or enhanced (define logical next steps, identify a responsible person or group, and include completion dates) or explain why a finding will not be assessed in the future. Use the following Results as the basis for the Actions: [paste Results here].

The Actions must:

Align with the provided definition.
Clearly connect to the Results and address whether the Target was met, partially met, or not met.
Identify specific steps the unit will take to improve service quality, efficiency, access, communication, or other relevant dimensions.
Be realistic, actionable, and time-bound; include responsible parties and needed resources where appropriate.
Indicate how the Action will be monitored or reassessed in the next cycle (i.e., how you will know it worked)."

Reminder: Once AI has generated the Action, refine the prompt and/or the AI-generated KPI as needed.

Step 7: Update to the Previous Cycle’s Plan for Continuous Improvement

No Prompt Template: A prompt template is not provided for this assessment plan item. To complete this item, simply respond to the Closing Summary situated in the Previous Cycle’s Plan for Continuous Improvement (Do Not Modify) template, which is located in the Plan Item tab of your assessment plan in Anthology Planning.

Step 8: New Plan for Continuous Improvement

Prompt Template: "You are tasked with creating a New Plan for Continuous Improvement for the upcoming academic year. Use the following definition of a New Plan for Continuous Improvement when generating the response: The New Plan for Continuous Improvement is a narrative summarizing all actions to be implemented into one coherent plan. The new PCI should be specific and detailed; include a summary of all identified actions found within the current plan; include any new initiatives or other items that will be assessed in the next cycle; and provide contextual information or details about what the actions are, how and when they will be implemented, and who will be responsible. The narrative included within this item should be in the future tense. Use the following Actions and new initiatives as the basis for the plan: [paste Actions and other new initiatives here].” The New Plan for Continuous Improvement must:
1. Align with the provided definition.
2. Clearly connect to the Actions taken in the previous cycle.
3. Identify new or continuing initiatives that address opportunities for growth and improvement.
4. Be realistic, actionable, and aligned with the unit’s mission and/or strategic priorities.
5. Provide a roadmap for how the plan will be implemented, monitored, and reassessed during the upcoming academic year."