route.console
Status: ONLINE
paiva@jcpaiva.dev:~$cat ~/research/automated-assessment-review.bib

Automated Assessment in Computer Science Education: A State-of-the-Art Review

Practical programming competencies are critical to the success in computer science (CS) education and go-to-market of fresh graduates. Acquiring the required level of skills is a long journey of discovery, trial and error, and optimization seeking through a broad range of programming activities that…

Journal Article
Open DOI
abstract.md

Abstract

Practical programming competencies are critical to the success in computer science (CS) education and go-to-market of fresh graduates. Acquiring the required level of skills is a long journey of discovery, trial and error, and optimization seeking through a broad range of programming activities that learners must perform themselves. It is not reasonable to consider that teachers could evaluate all attempts that the average learner should develop multiplied by the number of students enrolled in a course, much less in a timely, deep, and fair fashion. Unsurprisingly, exploring the formal structure of programs to automate the assessment of certain features has long been a hot topic among CS education practitioners. Assessing a program is considerably more complex than asserting its functional correctness, as the proliferation of tools and techniques in the literature over the past decades indicates. Program efficiency, behavior, and readability, among many other features, assessed either statically or dynamically, are now also relevant for automatic evaluation. The outcome of an evaluation evolved from the primordial Boolean values to information about errors and tips on how to advance, possibly taking into account similar solutions. This work surveys the state of the art in the automated assessment of CS assignments, focusing on the supported types of exercises, security measures adopted, testing techniques used, type of feedback produced, and the information they offer the teacher to understand and optimize learning. A new era of automated assessment, capitalizing on static analysis techniques and containerization, has been identified. Furthermore, this review presents several other findings from the conducted review, discusses the current challenges of the field, and proposes some future research directions.

Key Contributions & Highlights

  • Venue & Publication: ACM Transactions on Computing Education (2022)
  • Authors: José Carlos Paiva, José Paulo Leal, Álvaro Figueira
  • Research Scope: Focuses on key advancements in Automated Assessment, Research Review.

$ rg --related ./research

Journal Article

Incremental Repair Feedback on Automated Assessment of Programming Assignments

Electronics

Automated assessment tools for programming assignments have become increasingly popular in computing education. These tools offer a cost-effective and highly available way to provide timely and consistent feedback to students. However, when evaluating a logically incorrect source code, there are…

Automated AssessmentGenerative AI+1
Journal Article

Clustering source code from automated assessment of programming assignments

International Journal of Data Science and Analytics

Abstract Clustering of source code is a technique that can help improve feedback in automated program assessment. Grouping code submissions that contain similar mistakes can, for instance, facilitate the identification of students’ difficulties to provide targeted feedback. Moreover, solutions with…

Automated AssessmentProgram Analysis
start_conversation.sh
paiva@jcpaiva.dev:~$ ./start-conversation

Turn research insight into production software

If this work intersects with your product, institution, or research program, let’s map the shortest credible route to a working system.

privacy.config
Read the privacy and storage details