Fall 2023 Methodology Applications Series

Putting ChatGPT to the Test: Practical Applications of Large Language Models for Assessment Development
Scott Frohn

Scott Frohn

The MAP Academy and Buros Center for Testing invite you to the first presentation of the Fall 2023 Methodology Applications Series, featuring Scott Frohn, senior manager of assessment and psychometrics at Workera.ai.

Buros Center for Testing Buros Center for Testing

Friday, Sept. 22, 2023 12:00-1:30 p.m. CDT Nebraska Union, Regency Suite

Home Details Biography Nebraska Union, Regency Suite

Abstract

The advancement and accessibility of ChatGPT and other Large Language Models (LLMs) over the past year has dramatically impacted how many of us think about work, productivity, learning and many other aspects of our lives

These tools allow users to save time and effort by performing routine tasks and augmenting creative work, but they still require human interaction to get useful output and review content for accuracy.

This presentation will provide a high-level overview of how LLMs such as ChatGPT work, as well as practical advice for leveraging LLMs in assessment development and best practices in prompt engineering.

Three learning objectives for this presentation are:

  • Describe at a high-level how LLMs like ChatGPT work;
  • Identify ways to leverage LLMs in assessment development; and
  • Employ some best practices in prompt engineering.

Details

Date, Time, & Location
Friday, Sept. 22, 2023
12:00-1:30 PM CDT
Nebraska Union, Regency Suite

This presentation is free and open to the public. Continuing education credit for this program is available upon request from the Buros Center for Testing. To request, email Dr. Jessica L. Jonson prior to Sept. 22.

scott-frohn

Scott Frohn, Ph.D.

Senior manager of assessment and psychometrics at Workera.ai

Scott Frohn, Ph.D., is the senior manager of assessment and psychometrics at Workera.ai, where he oversees a team dedicated to developing assessments used to help learners upskill in artificial intelligence and computer science.

He is passionate about teaching, mentoring, leadership and leveraging technology to address practical problems in psychometrics and test development.

Frohn earned his Ph.D. in educational psychology from the University of Nebraska–Lincoln and worked five years as a certification psychometrician. He later became Director of Psychometrics at PSI Services prior to joining Workera.ai in 2021.