route.console
Status: ONLINE
paiva@jcpaiva.dev:~$cat ~/research/incremental-repair-feedback.bib

Incremental Repair Feedback on Automated Assessment of Programming Assignments

Automated assessment tools for programming assignments have become increasingly popular in computing education. These tools offer a cost-effective and highly available way to provide timely and consistent feedback to students. However, when evaluating a logically incorrect source code, there are…

Journal Article
Open DOI
abstract.md

Abstract

Automated assessment tools for programming assignments have become increasingly popular in computing education. These tools offer a cost-effective and highly available way to provide timely and consistent feedback to students. However, when evaluating a logically incorrect source code, there are some reasonable concerns about the formative gap in the feedback generated by such tools compared to that of human teaching assistants. A teaching assistant either pinpoints logical errors, describes how the program fails to perform the proposed task, or suggests possible ways to fix mistakes without revealing the correct code. On the other hand, automated assessment tools typically return a measure of the program’s correctness, possibly backed by failing test cases and, only in a few cases, fixes to the program. In this paper, we introduce a tool, AsanasAssist, to generate formative feedback messages to students to repair functionality mistakes in the submitted source code based on the most similar algorithmic strategy solution. These suggestions are delivered with incremental levels of detail according to the student’s needs, from identifying the block containing the error to displaying the correct source code. Furthermore, we evaluate how well the automatically generated messages provided by AsanasAssist match those provided by a human teaching assistant. The results demonstrate that the tool achieves feedback comparable to that of a human grader while being able to provide it just in time.

Key Contributions & Highlights

  • Venue & Publication: Electronics (2025)
  • Authors: José Carlos Paiva, José Paulo Leal, Álvaro Figueira
  • Research Scope: Focuses on key advancements in Automated Assessment, Generative AI, Program Analysis.

$ rg --related ./research

Conference Paper

Bridging Generative AI and Gamification in Moodle: Design and Evaluation of GamiBot

OASIcs, Volume 145, ICPEC 2026

While Learning Management Systems (LMS) like Moodle are ubiquitous in higher education, they often lack dynamic, personalized academic support. We present GamiBot, an intelligent pedagogical agent natively integrated into Moodle to bridge this gap. GamiBot combines Large Language Model (LLM)…

GamificationEdTech+1
Artifact

GamiBot

Schloss Dagstuhl – Leibniz-Zentrum für Informatik

Presents GamiBot, an AI-powered pedagogical agent integrated into Moodle combining conversational RAG assistance, automated feedback, and native gamification mechanics.

Generative AILLM+4
Journal Article

Clustering source code from automated assessment of programming assignments

International Journal of Data Science and Analytics

Abstract Clustering of source code is a technique that can help improve feedback in automated program assessment. Grouping code submissions that contain similar mistakes can, for instance, facilitate the identification of students’ difficulties to provide targeted feedback. Moreover, solutions with…

Automated AssessmentProgram Analysis
start_conversation.sh
paiva@jcpaiva.dev:~$ ./start-conversation

Turn research insight into production software

If this work intersects with your product, institution, or research program, let’s map the shortest credible route to a working system.

privacy.config
Read the privacy and storage details