Chengyuan Yao

Email  /  Google Scholar  /  LinkedIn  /  Twitter  

I am currently a Ph.D. candidate in Measurement, Evaluation, and Statistics at Teachers College, Columbia University in New York City, where I am fortunate to be advised by Dr. Renzhe Yu and am a member of the AEQUITAS Lab. Previously, I earned a B.A. in Applied Mathematics with Minors in Data Science and Education from UC Berkeley.

Research: My research lies at the intersection of Responsible AI and Educational Data Science, examining how AI methods can be responsibly developed and applied in real-world contexts. I am currently exploring and interested in the following topics:

  • Trustworthy Transfer Learning: Examining challenges of algorithmic fairness and data privacy in transfer learning, aiming to democratize access to trustworthy educational models, especially in under-resourced educational contexts.
  • Measurement and Evaluation for Large Language Models: Advancing more reliable and theoretically grounded evaluation methods for large language models (LLMs), with a focus on construct validity, consistency across tasks, and alignment with real-world goals.
profile photo
News

💼 May. 2026: I am joining Microsoft AI as an Applied Scientist Intern this summer.

📣 April. 2025: I was awarded the Provost's Grant for Conference Presentation and Professional Development.

March. 2025: "Towards Fair and Privacy-Aware Transfer Learning for Educational Predictive Modeling" received the Best Full Paper Award at LAK2025.

🎉August. 2023: I was awarded the Doctoral Research Fellowship to support my Ph.D. research.

Honors and Awards
Publications
From Leaderboards to Decisions: A Psychometric Perspective on Criterion-Referenced Evaluation of Large Language Models
Chengyuan Yao, Zhen Xu, Jiayu Zheng, Renzhe Yu

LAK '26 LLM Psychometrics Workshop
Who's More Biased? Calibrating LLM Generation Against Human Responses in Postsecondary Online Discussion Forums
Daniel March, Zhen Xu, Chengyuan Yao, Renzhe Yu

L@S 2026
Are Online Discussion Forums Falling Behind in the Age of AI? Preliminary Evidence from Students’ Cognitive and Social Engagement Shifts in 370,000+ Posts
Zhen Xu, Yijun Dai, Chenxi Shi, Siyan Li, Chengyuan Yao, Renzhe Yu

L@S 2026
When the Past Misleads: Rethinking Training Data Expansion Under Temporal Distribution Shifts
Chengyuan Yao, Yunxuan Tang, Christopher Brooks, Rene Kizilcec, Renzhe Yu,

AIES 2025
Understanding Predictive Models of Student Success with a Multiverse Analysis
Yunxuan Tang, Emma Harvey, Chengyuan Yao, Renzhe Yu, Rene Kizilcec and Christopher Brooks,

EDM 2025
Towards Fair and Privacy-Aware Transfer Learning for Educational Predictive Modeling
Chengyuan Yao, Carmen Cortez, Renzhe Yu
🏆 Best Full Research Paper Award

LAK 2025
Technology-Based Instructional Strategies Show Promise in Improving Self-Regulated Learning Skills at Broad-Access Postsecondary Institutions
Renzhe Yu, Hui Yang, Xiaoying Lin, Chengyuan Yao, Paul Burkander, Krystal Thomas, Jessica Mislevy

L@S 2024
Academic Services
  • Co-Organizer, Fair4AIED 2026
  • Program Committee Member, AIED 2026
  • Program Committee Member, AIES 2025
  • Reviewer, FAccT 2026
  • Reviewer, L@S 2025
  • Reviewer, AIES 2024
  • Student Volunteer, alt-FAccT 2025
  • Co-Host, EAAMO NYC Meetup 2025
  • Student Representatives, Student Conduct Committee, Teachers College, Columbia University 2025-2027
  • E-board Member, Data Science and Education Association, Teachers College, Columbia University 2023-2024
  • TEDx Organizer, TEDxYouth@YouyiWRoad 2017
Teaching

Last Updated: May 2026.

Website template by Jon Barron.