Skip to main content

​
Connect an observability tool to pull traces from

Currently supported: Langfuse and LangSmith. More observability tools are on the roadmap. If you do not have one yet, create a free Langfuse or LangSmith project and point your app’s tracing at it.
In the DataFramer UI, open the project picker at the top of the sidebar, add a project and choose your tool:
The Add project dialog at the Connect step for Langfuse, with the Base URL, Public Key and Secret Key filled in Once connected, DataFramer pulls your traces in. Import new traces on the Traces page pulls on demand; the count next to the time window says how many traces are in it and how many were skipped, and why. Two settings are fixed once the project is created:
  • Data level sets what one datapoint is, and discovery and evaluations work at that level. Trace- and session-level datapoints can be large (>1M tokens); those are imported and then processed in pieces. Only ones above 10M tokens are skipped at import.
  • Import history: the traces already logged in the tool before the first import, or only the traces created from now on.
The Import traces step of the Add project dialog, with the project name, the data level and the historical import choice

​
See your traces

The Traces page lists the imported traces for the time range you pick. Open a trace to see everything DataFramer knows about it, and use the Review Copilot there to ask questions with the full context around it. The Traces page with the time window, the trace count, the Import new traces button and the list of traces

​
Route traces onward

Wherever DataFramer lists traces, select any subset and route it onward: Assign review sends the traces to a review queue, Add to dataset → Evaluation Dataset makes them ground truth for judges, and Add to dataset → Generation Seed Dataset makes them seed examples for synthetic generation. Three selected traces with the selection bar open on Add to dataset, offering Evaluation Dataset and Generation Seed Dataset

​
Connect traces to user journeys

The Signals SDK records what your users do in your product: clicks, feedback, workflow events. To line those signals up with the AI traces that happened around them, each trace has to carry the same journey_id as the signals. The dataframer-journey library stamps it onto every Langfuse trace or LangSmith run as your service creates it; see server instrumentation.

​
Next steps

Findings

Search your traces for patterns and track the ones that matter

Human Reviews

Route traces to expert reviewers

Calibrated Judges

Grade every trace automatically against your rubric