Assessing Usability of Large Language Models in Education
Huovinen, Leo (2024)
Julkaisun pysyvä osoite on
https://urn.fi/URN:NBN:fi:amk-202403285378
https://urn.fi/URN:NBN:fi:amk-202403285378
Tiivistelmä
The aim of the final year project was to investigate the potential of utilizing Large Language Models (LLMs) in automating and enhancing the process of curriculum development.
The project was carried out through the development and implementation of the LLM-based web application, followed by usability testing using the cognitive walkthrough approach and user feedback sessions. Test users were presented with the tool and tasked with evaluating its effectiveness, clarity, and overall usability in the context of curriculum planning. Feedback from users highlighted the importance of clear guidance, integration of tasks into a centralized tool, and the need for human input in verifying and refining generated content, to ensure accurate and meaningful goals in curriculum design. These findings will guide the further development and refinement of the application.
The project was carried out through the development and implementation of the LLM-based web application, followed by usability testing using the cognitive walkthrough approach and user feedback sessions. Test users were presented with the tool and tasked with evaluating its effectiveness, clarity, and overall usability in the context of curriculum planning. Feedback from users highlighted the importance of clear guidance, integration of tasks into a centralized tool, and the need for human input in verifying and refining generated content, to ensure accurate and meaningful goals in curriculum design. These findings will guide the further development and refinement of the application.