Top 9 evaluation-metrics open source projects

Learning to Evaluate Image Captioning. CVPR 2018

Useful python NLP tools (evaluation, GUI interface, tokenization)

A novel approach to evaluate community detection algorithms on ground truth

Full named-entity (i.e., not tag/token) evaluation metrics based on SemEval’13

PySODEvalToolkit: A Python-based Evaluation Toolbox for Salient Object Detection and Camouflaged Object Detection

Evaluation metrics for machine-composed symbolic music. Paper: "The Jazz Transformer on the Front Line: Exploring the Shortcomings of AI-Composed Music through Quantitative Measures", ISMIR 2020

Easier Automatic Sentence Simplification Evaluation

quica is a tool to run inter coder agreement pipelines in an easy and effective ways. Multiple measures are run and results are collected in a single table than can be easily exported in Latex

Assessing Generative Models via Precision and Recall (official repository)