Welcome to Appraise!
An open-source system for manual evaluation of MT output
This is Appraise
It supports collaborative collection of human feedback for MT evaluation. It implements tasks such as Direct Assessment (DA), Scalar Quality Metric (SQM), Multidimensional Quality Metric (MQM), Error Span Annotation (ESA), in various settings, such as reference or source based, contrastive, document-level, with video context, and others.