User Tools

Site Tools


damsym:feedback_and_ratings

This is an old revision of the document!


Feedback and Ratings System

General Description

The Feedback system represents an essential tool within DaMSym, designed to ensure qualitative control of the results returned by the semantic search engine.

This functionality allows users with the Reviewer role to express a judgment on the relevance and semantic accuracy of the results, thereby contributing to the continuous improvement of the corpus and to the scientific validation of the content.

The rating mechanism is based on a simple yet structured model: for each displayed result, the Reviewer may leave a positive or negative feedback, accompanied by an optional explanatory note.

All feedback entries are stored within the system and can be consulted by the WP Lead, who has the possibility to export them in tabular format for analysis and reporting purposes.


Access to the Functionality

The feedback system is available exclusively to authenticated users with the Reviewer role.

Other roles interact with the feedback system in a differentiated manner:

Role Interaction with the Feedback System
Guest No access or interaction.
Researcher No possibility to evaluate results; can only consult search results.
Reviewer Can leave positive or negative evaluations and add descriptive notes.
WP Lead Cannot leave evaluations but can view all feedback and export them from the Dashboard.

Interface and Operation

For each result displayed on the search results page, Reviewers see two dedicated icons:

  • 👍 (Thumbs up) → positive feedback
  • 👎 (Thumbs down) → negative feedback

By clicking on one of these icons, a rating modal window opens, allowing the user to:

  • confirm the selected type of feedback;
  • add, if desired, a textual note to justify the evaluation or describe observations;
  • definitively submit the evaluation.

After submission, the feedback is recorded in the system with the following metadata:

  • ID of the evaluated result and resource;
  • type of evaluation (positive/negative);
  • author of the feedback (authenticated Reviewer);
  • optional descriptive note;
  • date and time of submission.

The system does not allow modification of feedback after submission, in order to guarantee the integrity and traceability of review data.


Feedback Visualization (WP Lead)

Users with the WP Lead role do not see the feedback buttons. Instead, they see a clickable entry labeled “See Ratings” under each result.

By selecting this option, a summary window opens containing:

  • the complete list of feedback received for the selected result;
  • the notes provided by Reviewers;
  • the date and author of each evaluation.

In addition, the WP Lead may access the Dashboard, where a dedicated panel allows the user to:

  • view aggregated feedback by language, author, or date;
  • export the data in CSV or Excel format for subsequent analysis or archival purposes.

Interaction Between Feedback and Corrections

In addition to the like/dislike rating system, users with the roles of Reviewer, Researcher, and WP Lead may contribute to improving text quality by proposing textual corrections or metadata modifications.

In this context, the interaction flow provides that:

  • the Reviewer and/or the Researcher access the More Details view of the selected result;
  • for the Edit Text functionality, the user selects a contextualized portion of text, initially highlighted by the system; the selection may be manually extended. Through the contextual icon displayed, the user may proceed with the proposal of a text modification;
  • similarly, it is possible to propose modifications to metadata through the Edit Metadata function, or to add new metadata through Add Metadata, using the dedicated available buttons;
  • all modification proposals are sent to the Corrections section of the Dashboard, where the WP Lead receives the requests and may approve or reject them.

Corrections approved by the WP Lead are then applied to the corpus, becoming an integral part of the definitive text and resulting directly effective and visible within the platform, thereby contributing to the progressive improvement of the reliability of the semantic engine.


Feedback Export

The export functionality, accessible exclusively to the WP Lead, allows the generation of a structured file containing all ratings and related notes provided by Reviewers.

The exported file includes the following fields:

Field Description
Resource ID Unique identifier of the evaluated text or document
Language Linguistic domain of the resource (Arabic, Church Slavonic, Greek, etc.)
Feedback Type Positive (👍) / Negative (👎)
Note Additional comment provided by the Reviewer
Reviewer Username of the Reviewer who submitted the evaluation
Date and Time Timestamp of feedback submission

The export is designed to provide the WP Lead with a control and documentation tool, also useful for reporting purposes and for monitoring project progress.


Traceability and Data Security

All feedback entries are persistently recorded within the DaMSym database, with cross-reference to the Reviewer’s user ID and the evaluated result.

The system guarantees full traceability of revisions, in compliance with the security and privacy policies adopted by ITSERR and RESILIENCE.

Sensitive information (such as user ID and timestamp) is processed exclusively for technical monitoring purposes and is not made publicly available.


damsym/feedback_and_ratings.1770893405.txt.gz · Last modified: by fincons