Open Day Presentation
BAPC Generative AI: Silver Bullet or Lead Balloon?
Student
Desk
Initial task setting
Supervisor
Second Reader

1.10-74

Not assigned

Keywords
GenAI, Programming, HAI, Think-Aloud

Technologies
ChatGPT, Python, SPSS, Verbal Protocol Analysis

This project investigates how software developers think and make decisions when using Generative AI (GenAI) tools such as ChatGPT. Using a mixed-methods design, participants complete programming tasks with or without AI assistance while verbalising their thoughts. The study examines how developers’ cognitive models of GenAI relate to trust, self-efficacy, reliance, and task satisfaction. By integrating quantitative comparisons with qualitative think-aloud data, the research aims to determine whether GenAI enhances learning and productivity or fosters overreliance, contributing to understanding human–AI interaction.

My contribution spans both qualitative and quantitative analysis. I contributed to the transcription and coding of think-aloud data using Verbal Protocol Analysis (VPA) to identify patterns in reasoning, trust, and reliance. I also helped develop post-task survey measures and analyse participants’ responses. Integrating these data supports a triangulated understanding of how cognitive models influence trust, reliance, and decision-making.