route.console
Status: ONLINE
paiva@jcpaiva.dev:~$./evaluate --feedback-first

Automated Assessment Systems

Secure programming assessment and formative-feedback systems informed by more than a decade of engineering and research.

approach.md

I help teams design assessment workflows that go beyond pass or fail, combining safe execution, test-based evaluation, program analysis, semantic representations, and feedback that supports both learners and teachers.

Typical deliverables

  • Assessment model, threat model, and execution architecture
  • Sandboxed judging, scoring, and feedback workflows
  • Program-analysis or semantic-feedback prototypes
  • Integration plan for courses, repositories, or learning platforms
fit.check

A good fit when…

  • Programming education and competitive-programming platforms
  • Teams improving the quality or scale of technical assessment
  • Research-to-product work in formative feedback

Relevant capabilities

  • Sandboxing
  • Program analysis
  • Java
  • Python
  • Docker
  • WebSockets
  • Feedback systems

$ ls ./evidence/projects

Relevant project evidence

// created: 2018assessment system

Next-generation web-based competitive programming evaluation platform co-developed with Prof. José Paulo Leal, featuring WebSockets, sandbox execution, and distributed scoring.

JavaGWTWebSocketsAutomated AssessmentSandboxing+1 more
// created: 2021-08e-learning system

International Erasmus+ ecosystem for gamified programming learning, featuring GraphQL Gamification Service, React PWA learning environment, and AuthorKit exercise builder.

TypeScriptReactNode.jsGraphQLNestJS+5 more

$ ls ./evidence/research

Research foundation

Journal Article

Automated Assessment in Computer Science Education: A State-of-the-Art Review

ACM Transactions on Computing Education

Practical programming competencies are critical to the success in computer science (CS) education and go-to-market of fresh graduates. Acquiring the required level of skills is a long journey of discovery, trial and error, and optimization seeking through a broad range of programming activities that…

Automated AssessmentResearch Review
Journal Article

PROGpedia: Collection of source-code submitted to introductory programming assignments

Data in Brief

Learning how to program is a difficult task. To acquire the required skills, novice programmers must solve a broad range of programming activities, always supported with timely, rich, and accurate feedback. Automated assessment tools play a major role in fulfilling these needs, being a common…

Program Analysis

$ ls ../services

Adjacent capabilities

ai-rag-architecture.service
Status: READY
$ ./architect --grounded-ai[CAPABILITY_LOADED]

AI & RAG Architecture

Production-ready retrieval-augmented generation, vector search, and conversational AI systems grounded in your own knowledge.

  • Architecture and technology selection for the target workload
  • Content ingestion, chunking, embedding, and synchronization pipeline
  • Grounded retrieval and response orchestration
Inspect service
edtech-lms-integrations.service
Status: READY
$ ./integrate --learning-stack[CAPABILITY_LOADED]

EdTech & LMS Integrations

Custom Moodle and learning-platform integrations that connect content, identity, assessment, gamification, and learner workflows.

  • Learning workflow and integration architecture
  • Moodle, LMS, API, identity, and data integrations
  • Learner-facing interfaces and administration workflows
Inspect service
full-stack-platform-architecture.service
Status: READY
$ ./ship --production-platform[CAPABILITY_LOADED]

Full-Stack Platform Architecture

End-to-end architecture and implementation for portals, SaaS products, APIs, data systems, and multi-tenant platforms.

  • System architecture and phased delivery plan
  • Frontend, API, data, identity, and integration implementation
  • Containerized environments and delivery automation
Inspect service
start_conversation.sh
paiva@jcpaiva.dev:~$ ./start-conversation

Discuss Assessment for your system

Share the context, constraints, and outcome you need. I can help shape the architecture and the delivery path.

privacy.config
Read the privacy and storage details