route.console
Status: ONLINE
paiva@jcpaiva.dev:~$cat ~/research/progpedia-collection-of-source-code-subm-2023.bib

PROGpedia: Collection of source-code submitted to introductory programming assignments

Learning how to program is a difficult task. To acquire the required skills, novice programmers must solve a broad range of programming activities, always supported with timely, rich, and accurate feedback. Automated assessment tools play a major role in fulfilling these needs, being a common…

Journal Article
Open DOI
abstract.md

Abstract

Learning how to program is a difficult task. To acquire the required skills, novice programmers must solve a broad range of programming activities, always supported with timely, rich, and accurate feedback. Automated assessment tools play a major role in fulfilling these needs, being a common presence in introductory programming courses. As programming exercises are not easy to produce and those loaded into these tools must adhere to specific format requirements, teachers often opt for reusing them for several years. Therefore, most automated assessment tools, particularly Mooshak, store hundreds of submissions to the same programming exercises, as these need to be kept after automatically processed for possible subsequent manual revision. Our dataset consists of the submissions to 16 programming exercises in Mooshak proposed in multiple years within the 2003-2020 timespan to undergraduate Computer Science students at the Faculty of Sciences from the University of Porto. In particular, we extract their code property graphs and store them as CSV files. The analysis of this data can enable, for instance, the generation of more concise and personalized feedback based on similar accepted submissions in the past, the identification of different strategies to solve a problem, the understanding of a student's thinking process, among many other findings.

Key Contributions & Highlights

  • Venue & Publication: Data in Brief (2023)
  • Authors: José Carlos Paiva, José Paulo Leal, Álvaro Figueira
  • Research Scope: Focuses on key advancements in Program Analysis.

$ rg --related ./research

Journal Article

Incremental Repair Feedback on Automated Assessment of Programming Assignments

Electronics

Automated assessment tools for programming assignments have become increasingly popular in computing education. These tools offer a cost-effective and highly available way to provide timely and consistent feedback to students. However, when evaluating a logically incorrect source code, there are…

Automated AssessmentGenerative AI+1
Journal Article

Clustering source code from automated assessment of programming assignments

International Journal of Data Science and Analytics

Abstract Clustering of source code is a technique that can help improve feedback in automated program assessment. Grouping code submissions that contain similar mistakes can, for instance, facilitate the identification of students’ difficulties to provide targeted feedback. Moreover, solutions with…

Automated AssessmentProgram Analysis
start_conversation.sh
paiva@jcpaiva.dev:~$ ./start-conversation

Turn research insight into production software

If this work intersects with your product, institution, or research program, let’s map the shortest credible route to a working system.

privacy.config
Read the privacy and storage details