Moozz: Assessment of Quizzes in Mooshak 2.0

Published in SLATE 2018 Computer Science

Helder Correia, José Paulo Leal & José Carlos Paiva

Quizzes are a widely used form of assessment, supported in many e-learning systems. Mooshak is a web system which supports automated assessment in computer science. This paper presents Moozz, a quiz assessment environment for Mooshak 2.0, with its own XML definition for describing quizzes. This definition is used for: interoperability with different e-learning systems, generating HTML-based forms, storing student answers, marking final submissions and generating feedback. Furthermore, Moozz also includes an authoring tool for creating quizzes. The paper describes Moozz, its quiz definition language and architecture, and details its implementation. 2012 ACM Subject Classification Applied computing → Interactive learning environments

Improving Diagram Assessment in Mooshak

Part of the Communications in Computer and Information Science book series (CCIS,volume 829)

Helder Correia, José Paulo Leal & José Carlos Paiva

Mooshak is a web system with support for assessment in computer science. It was originally developed for programming contest management but evolved to be used also as a pedagogical tool, capitalizing on its programming assessment features. The current version of Mooshak supports other forms of assessment used in computer science, such as diagram assessment. This form of assessment is supported by a set of new features, including a diagram editor, a graph comparator, and an environment for integration of pedagogical activities. The first attempt to integrate these features to support diagram assessment revealed a number of shortcomings, such as the lack of support for multiple diagrammatic languages, ineffective feedback, and usability issues. These shortcomings were addressed by the creation of a diagrammatic language definition language, the introduction of a new component for feedback summarization and a redesign of the diagram editor. This paper describes the design and implementation of these features, as well as their validation.

Enhancing feedback to students in automated diagram assessment

6th Symposium on Languages, Applications and Technologies (SLATE 2017)/Schloss Dagstuhl--Leibniz-Zentrum fuer Informatik - 🏅The best paper award on SLATE track Computer-Computer Languages 🏅

Helder Correia, José Paulo Leal & José Carlos Paiva

Automated assessment is an essential part of eLearning. Although comparatively easy for multiple choice questions (MCQs), automated assessment is more challenging when exercises involve languages used in computer science. In this particular case, the assessment is more than just grading and must include feedback that leads to the improvement of the students' performance.

This paper presents ongoing work to develop Kora, an automated diagram assessment tool with enhanced feedback, targeted to the multiple diagrammatic languages used in computer science. Kora builds on the experience gained with previous research, namely: a diagram assessment tool to compute differences between graphs; an IDE inspired web learning environment for computer science languages; and an extensible web diagram editor.

Kora has several features to enhance feedback: it distinguishes syntactic and semantic errors, providing specialized feedback in each case; it provides progressive feedback disclosure, controlling the quality and quantity shown to each student after a submission; when possible, it integrates feedback within the diagram editor showing actual nodes and edges on the editor itself

Eshu: An Extensible Web Editor for Diagrammatic Languages

FCA - Editora de Informática, Lda

Leal, José Paulo ; Correia, Helder ; Paiva, José Carlos

The corner stone of a language development environment is an editor. For programming languages, several code editors are readily available to be integrated in Web applications. However, only few editors exist for diagrammatic languages. Eshu is an extensible diagram editor, embeddable in Web applications that require diagram interaction, such as modeling tools or e-learning environments. Eshu is a JavaScript library with an API that supports its integration with other components, including importing/exporting diagrams in JSON. Eshu was already integrated in a pedagogical environment with automated diagram assessment, configured for extended entity-relationship diagrams, that served as basis for an usability evaluation.