evaluation-quality

Here are 2 public repositories matching this topic...

Generate controlled synthetic annotator disagreement before real reviewer data is collected.

data generator simulation test calibration reviewer annotator synthetic inter-annotator-agreement synthetic-data iaa ai-evaluation evals disagreement auraone evaluation-quality

Scan evaluation data for n-gram overlap, canaries, answer patterns, hashes, and optional embedding similarity.

cli data benchmark detection evaluation overlap audit n gram contamination leakage data-contamination ai-evaluation evals auraone evaluation-quality

Add a description, image, and links to the evaluation-quality topic page so that developers can more easily learn about it.

To associate your repository with the evaluation-quality topic, visit your repo's landing page and select "manage topics."