> ## Documentation Index
> Fetch the complete documentation index at: https://www.dataframer.ai/docs/llms.txt
> Use this file to discover all available pages before exploring further.

# Queues & Reviews

> Route AI traces to reviewers, grade them against the rubric, and reuse every correction.

With a rubric in place, reviews become repeatable. Everything below lives under **Human Reviews**, in three tabs: **My Reviews**, **All Reviews**, and **Queues**.

## Route traces to reviewers

A **queue** is a shared inbox of traces for a team of reviewers. Create one under **Queues**: name it, pick the rubrics to grade against, pick the reviewers, and optionally add traces right away. The queue hands traces out round-robin, so the load stays even. Leave the rubric list empty and the queue grades against all of the project's active rubrics.

<img src="https://mintcdn.com/aimonlabsinc/BIX30HXoj6xW9wt-/images/reviews/create-queue.png?fit=max&auto=format&n=BIX30HXoj6xW9wt-&q=85&s=ed874b25f2c7e81a71624ed9c1bfcb6e" alt="The Create Queue dialog with a queue name, a description and a rubric" width="1792" height="1048" data-path="images/reviews/create-queue.png" />

From any trace list, select traces, press **Assign review**, and choose **Review Queue**. Choose **Individual Reviewers** instead to skip the queue and hand the traces to specific people. A [tracked finding](/docs/findings/discovery-and-tracking#tracking) can also send every new trace it collects to a queue by itself: open the finding and pick **Route new traces to a queue**.

## Do the review

Each reviewer opens **My Reviews**, their own list of traces waiting for a grade. A trace opens beside the rubric. The reviewer scores each dimension, writes a short rationale, sets how confident they are, and, when the rubric requires it, how severe the problem is.

If the prompt or some output detail was wrong, the reviewer rewrites it into what it should have been. The trace sits beside an editable copy.

<img src="https://mintcdn.com/aimonlabsinc/BIX30HXoj6xW9wt-/images/reviews/review-workbench.png?fit=max&auto=format&n=BIX30HXoj6xW9wt-&q=85&s=0af203248520edebcd244caa8258ce17" alt="A review with the trace output and the reviewer's corrected copy side by side, and the rubric grades, confidence, severity and rationale" width="2880" height="1800" data-path="images/reviews/review-workbench.png" />

The [Review Copilot](/docs/reviews/copilot) drafts the rationale and the correction, so reviewers check and approve instead of writing from scratch.

## See where reviewers agreed and disagreed

**All Reviews** lists every review across all reviewers. When more than one reviewer grades the same trace, their grades combine into a **team verdict**, and the list shows whether they were unanimous or split on the headline dimension and how much they agreed overall.

<img src="https://mintcdn.com/aimonlabsinc/BIX30HXoj6xW9wt-/images/reviews/all-reviews.png?fit=max&auto=format&n=BIX30HXoj6xW9wt-&q=85&s=a1043eaf333adb59c91b278b836a2a20" alt="All Reviews for one queue, with the team verdict, whether reviewers were unanimous or split, and their overall agreement" width="2744" height="1268" data-path="images/reviews/all-reviews.png" />

## Feedback gets reused

After each submission, DataFramer distills what the reviewer decided, and why, into **memory**. The Review Copilot reads that memory on later reviews of similar traces.

From **All Reviews**, select any reviewed traces and press **Add to dataset** to make them an [evaluation dataset](/docs/judges/datasets-and-evaluations) for calibrating a judge, or a [generation seed dataset](/docs/concepts#where-seed-data-comes-from) so the cases your experts just corrected seed the next batch of synthetic data.

## Next steps

<Card title="Judges & Datasets" icon="scale-balanced" href="/docs/judges/overview">
  Calibrate a judge against this review data
</Card>


This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.