Invitation to Participate: Expert Ratings of AI-Generated Tutoring Responses

Introduction I am inviting colleagues and educators to participate in a research study conducted at the Singapore University of Technology and Design (SUTD). As Artificial Intelligence becomes more prevalent in education, it is critical to evaluate its performance not just on accuracy, but on pedagogical quality.

Study Objective The goal of this project, titled “Expert Ratings of AI-Generated Tutoring Responses for Evaluating Pedagogical Quality” , is to understand how different AI approaches demonstrate instructional qualities such as clarity, scaffolding, ethical behaviour, and learner support.

Methodology The study involves an expert review of anonymised tutoring dialogues produced by AI systems for middle-school mathematics. All materials are fully synthetic; no real students or personal data are involved.

Participation Details If you choose to participate, you will complete one online session via a secure survey link.

  • Task: You will review 24 pairs of dialogues and provide ratings and brief comments.
  • Duration: The session takes approximately 45–60 minutes.
  • Eligibility: Participants must be 21+ and have experience in teaching, tutoring, or educational research .

Confidentiality Participation is entirely voluntary. No personal identifiers are collected, and all responses are anonymous and used solely for academic research.

How to Join To contribute your expertise to this study, please visit the link below:

🔗 Link to Survey: https://bit.ly/AI-Tutor-QA

If you have questions, please feel free to contact me at nizam_kadir@mymail.sutd.edu.sg.