13 Assignment Feedback
13.1 Offer elaborate and beneficial feedback on students’ assignments.
In the learning process, feedback serves a critical role, offering essential insights into students’ performance on various tasks and assignments. The insights gleaned from feedback can empower students to gain a better grasp of their strengths and weaknesses, keep track of their academic progress, and enhance their learning outcomes. From a teacher’s perspective, feedback can assist in evaluating teaching effectiveness, identifying the learning needs of their students, and enabling personalised guidance and support.
Yet, the task of giving feedback can be a complex and time-consuming process for teachers. It involves a deep understanding of the course content and learning objectives, careful assessment of the task’s difficulty level, the format of answers, and crafting effective feedback. There is also a need for the continuous refinement of feedback to ensure its relevance, precision, and variation.
ChatGPT offers a promising solution to these challenges, acting as a remarkable tool for providing detailed, elaborate feedback to students, far beyond what a teacher or tutor can offer given time constraints. By leveraging the prowess of ChatGPT, the feedback process can be transformed, ensuring students benefit from comprehensive insights and learn effectively.
Danny Liu from the Educational Innovation team at The University of Sydney has provided some outstanding advice for how to harness ChatGPT for providing feedback. The system needs to be supplied with the assignment guide, the marking rubric, and a summary of your notes for feedback to students. ChatGPT can then use this information to generate in-depth, personalised feedback.
For example, you may have made a brief note on a student’s essay stating “Argument lacks clarity and specificity.” When provided to ChatGPT, along with the essay prompt and rubric, it might expand this feedback to say, “The main argument of your essay could be further enhanced by providing more specific examples and explanations. Remember that a clear and specific argument helps the reader understand your point of view better and strengthens your overall position.”
In this way, ChatGPT can serve as an invaluable aid in the feedback process, helping teachers provide enriched and constructive feedback to their students, ultimately promoting a deeper, more effective learning experience. It not only aids in saving precious time for educators but also provides a more engaging and informative feedback process for learners.
13.1.1 PROMPT
INSTRUCTIONS:
Act as an expert educator in higher education.
The user will provide a section of the student's assignment and a rating on a 5-point scale on each rubric dimension and perhaps a few notes for feedback to students about an assignment. Expand these into a maximum of 3 paragraphs of feedback to the student. The feedback needs to provide a brief summary of the strengths and weaknesses of their assignment, based on the assigned grades. For example, a low grade of 0 or 1 out of 5 needs to be explained.
Base your feedback on the content of the assignment and be sure to mention specific aspects of the assignment in your feedback. But also base your feedback on the **assignment brief**, as well as the **marking rubric**. Don't provide any marks, ratings or grades in the feedback. Don't thank them for submitting the assignment. Don't mention the student's name. Instead, congratulate them on finishing the semester and wish them a nice break (or something like that).
Keep your feedback a maximum of 3 paragraphs.
- Keep sentences concise and clear, avoiding overly complex language and exaggerated expressions
- Communicate relevant information, while remaining focused on the main topic
- Avoid using overly dramatic or grandiose language.
- Use contractions such as "don't" instead of "do not," "I'll" instead of "I will," and "I'd" instead of "I would", and use "Thanks" instead of "Thank you"
- Use simple and genuine language. Be authentic.
- Use UK English spelling and grammar conventions
ASSIGNMENT BRIEF:
ChatGPT Assignment 2
Teaching How To Evaluate
Objective
This assignment aims to help students apply and evaluate concepts from the course in different contexts using ChatGPT as a source of examples. Students will also develop their critical thinking, feedback skills, and explore the potential and limitations of AI chatbots as learning tools.
Task Description
In this assignment, you will choose a concept from the second half of Judgement and Decision Making, and use ChatGPT to generate an initial essay on that concept. You will provide a clear and specific prompt for ChatGPT, and receive its response in the form of an initial essay. Your task is to read and evaluate this initial essay, provide suggestions for improvement, and revise the essay by incorporating your suggestions. You will also provide a summary of the changes and improvements that you made during the revision process and reflect on your personal learning outcomes from this assignment.
To clarify the division of work between ChatGPT and the students
Transfer of knowledge on the chosen concept to various contexts, enabling students to apply the concept effectively outside the classroom.
ChatGPT's role
Generate the initial essay based on the student's prompt
Student's role
Formulate a clear and specific prompt for ChatGPT
Evaluate the initial essay generated by ChatGPT
Provide suggestions for improvement
Revise the essay by incorporating these suggestions
Reflect on personal learning outcomes from the assignment
Structure of the Submission
Your submission must be a single document, formatted with the following headings:
Title Page
Assignment title
Your name
Student ID
Course title
Chosen Concept and Prompt
Clearly state the chosen concept from one of the six classes (with the exception of nudges and behavioural insights). Be sure to choose a concept (e.g., prospect theory) from one of these classes, not the entire topic of the class (e.g., decision making).
Formulate a clear and specific prompt for ChatGPT based on the chosen concept. Make sure to demonstrate what you've learned in the class activities and first assignment this semester about how to formulate a decent prompt using ChatGPT.
Initial ChatGPT-generated Essay (length determined by ChatGPT) and your evaluation (400 words)
Present the initial essay generated by ChatGPT based on your prompt
Evaluate the initial essay by identifying its strengths and weaknesses
Provide specific suggestions for improvement
Revised Essay (800 words)
Include your revision of the initial essay produced by ChatGPT
The reference list (formatted according to APA 7) is not included in the word count for this section
Personal Reflection (200 words)
Reflect on your personal learning outcomes from this assignment
Discuss the potential and limitations of AI chatbots as learning tools
Submission Requirements
Submit your single, complete document through Turnitin, which will be posted in the Assignments page on Blackboard. Make sure to follow the simplified structure outlined above to ensure clarity and coherence in your submission.
MARKING RUBRIC:
Chosen Concept and Prompt (15 marks)
Relevance and depth of chosen concept (10 marks)
Demonstrates a comprehensive understanding of the concept
Evidence of independent thought and novel synthesis of existing information
Demonstrates knowledge of how to create an effective prompt for ChatGPT (5 marks)
Clear and specific prompt that reflects learning from class activities and previous assignments
Initial ChatGPT-generated Essay Evaluation (25 marks)
Comprehensiveness, accuracy, and insightfulness of identifying strengths and weaknesses (15 marks)
Thorough evaluation of the initial essay
Identification of psychological concepts, theories, and processes in the essay
Evidence of critical understanding of the relevant literature
Specificity and relevance of suggestions for improvement (10 marks)
Clear and actionable suggestions for improving the essay
Demonstrates an ability to distinguish between high and low quality evidence
Revised Essay (45 marks)
Mastery of content area and sophisticated synthesis of content (20 marks)
Comprehensive understanding of the chosen concept
Novel synthesis of existing information, reflecting independent thought
Coherent and logical arguments, with strong supporting evidence and examples (15 marks)
Clear, persuasive, and engaging narrative
Consistent train of thought throughout the essay
Clarity and quality of written expression (5 marks)
Well-structured and organised essay
Clear and concise language
Contextualisation and interpretation of the concept within a broader context (5 marks)
Ability to interpret the concept and put it in a broader context
Personal Reflection (15 marks)
Depth of reflection on the assignment process and insights gained (10 marks)
Thorough reflection on the learning process and personal growth
Identification of specific insights gained from the assignment
Understanding of the potential and limitations of AI chatbots as learning tools (5 marks)
Demonstrates an awareness of the benefits and drawbacks of using AI chatbots
Critical evaluation of ChatGPT's role in the learning process
Total Possible Points: 100
MARKER'S FEEDBACK:
Concept Depth: A nice deep dive into the cognitive science of expressive responding and how it relates to distinguishing fact from fiction
Prompt Skill: Well thought-out prompt that flows from a clearly developed skeleton of your planned essay
Essay Eval: Thorough evaluation of the essay content including critically analysing the evidence provided
Improvement: Literature-informed suggestions that would greatly enhance the quality and legitimacy of the essay
Mastery: Demonstrates mastery of the content but also of how to evaluate evidence.
Arguments: Great job interweaving definitions and evidence.
Clarity: Okay.
Context: Though the context was not novel, you did an exceptional job at embedding an assessment of cognitive mechanisms within a larger discussion about both science and politics.
Reflection: Shallow reflection
AI Insight: Did not extend beyond the scope of this assignment
Notice the difference between the quick marker’s feedback:
Concept Depth: A nice deep dive into the cognitive science of expressive responding and how it relates to distinguishing fact from fiction
Prompt Skill: Well thought-out prompt that flows from a clearly developed skeleton of your planned essay
Essay Eval: Thorough evaluation of the essay content including critically analysing the evidence provided
Improvement: Literature-informed suggestions that would greatly enhance the quality and legitimacy of the essay
Mastery: Demonstrates mastery of the content but also of how to evaluate evidence.
Arguments: Great job interweaving definitions and evidence.
Clarity: Okay.
Context: Though the context was not novel, you did an exceptional job at embedding an assessment of cognitive mechanisms within a larger discussion about both science and politics.
Reflection: Shallow reflection
AI Insight: Did not extend beyond the scope of this assignment
And the same feedback that’s been touched up by ChatGPT:
Great work on the concept selection and development of your prompt. The depth of your exploration into the cognitive science of expressive responding and its relation to distinguishing fact from fiction was particularly commendable. You've shown mastery in evaluating the essay, drawing from relevant literature and weaving definitions and evidence together seamlessly. Your choice to embed an assessment of cognitive mechanisms within a wider discussion of science and politics added depth to your work, even though the context was not necessarily novel.
However, there's still room for improvement. While the clarity of your written expression was passable, strive for excellence in your writing. This means making your arguments even clearer and more concise, ensuring that your points are well-structured, and ensuring your writing flows seamlessly.
Lastly, when it comes to reflecting on your learning process and discussing the potential and limitations of AI chatbots as learning tools, a more thoughtful approach would have been beneficial. Aim to dig deeper into your own learning experiences, insights gained, and articulate more fully your understanding of the strengths and weaknesses of using AI such as ChatGPT in learning. Have a well-deserved break, and remember these points for future assignments – there's always room to grow and improve!