Export Studio¶
Export Studio turns an exercise dashboard into a focused comparison that can be shared as a live view or downloaded as a standalone artifact.
Open a strategy comparison dashboard and select Export view, or replace
strategy-compare with strategy-export in an exercise report URL:
/ui/reports/strategy-export.html
/ui/reports/strategy-export-<connector>-<exercise>.html
Compose A Comparison¶
The studio supports:
- selecting only the runs that belong in the comparison
- labeling runs by run name, model, coding harness, model and harness, or an arbitrary display name
- assigning any color and solid/dashed/dotted line style to each run
- highlighting a run, keeping it normal, or graying it into context
- score trajectory, best-candidate run scatter, aggregate group scatter, and cumulative-token charts
- active time, elapsed time, working tokens, API-equivalent cost, and candidate-number axes
- logarithmic or linear score scales
- optional candidate markers, endpoint labels, legend, and source footer
- optional finishing scores appended to run names in endpoint labels and legends
- custom eyebrow, title, and explanation text
- draggable text boxes with configurable text, width, size, color, and optional background
- draggable arrows with movable endpoints, color, and line-width controls
- 16:9, square, and 4:5 output formats
Compare groups applies any group assignments without changing which runs are selected. Presets can assign runs by model, coding harness, effort level, experimental skill usage, or the exact experimental skill set. Groups can also be created, renamed, colored, and assigned per run. Turning comparison off returns to each run's own visual settings without deleting those assignments.
Label preset controls the compact names printed beside the chart and in the
legend. Choose Model + harness to replace long experiment names with labels
such as claude-opus-5 / Claude Code. Model-only and harness-only presets are
also available. You can edit any generated display name afterward; the studio
then marks the label mode as Custom labels. A dashboard export keeps the run
names unless Only best run by is active. When it is active, the studio uses
the exact selected dimensions for compact labels: Model, Harness, Skill, or any
combination of them. The selector identifies this as Dashboard grouping.
Finishing score in names is independent of label presets and dashboard
grouping. It appends each run's best valid score in the selected time window,
including the objective unit, for example gpt-5.6-sol / Codex (981 cycles).
It works with run names, generated presets, and manually edited labels.
The experimental-skill presets deliberately ignore required plumbing and
coordination skills: scorebench, progress-logging, superpowers, skill
management helpers, OpenAI documentation, and Arbor coordinator skills. A run
is labeled Skill only when it used an optimization or knowledge skill such
as problem-agnostic-optimization. This keeps the treatment definition aligned
with controlled skill-versus-no-skill experiments.
Clicking a chart line or legend item focuses that run and grays the other selected runs. Clicking the focused run again restores the configured view.
Best candidate shows one point per run. Use the Tokens x-axis to compare
the working-token budget at each run's best score, or Cost to compare its
API-equivalent budget. Cost estimates retain the dashboard's ~ marker and
pricing caveats; see API Cost Accounting.
Groups turns those run-level best observations into a compact experimental summary. Each selected run contributes one best scored candidate, after the time-window filter. The Skill filter can keep all selected runs, any run with an experimental skill, runs with no experimental skill, or runs containing one specific experimental skill found in the report. It uses the same treatment definition as the experimental-skill group presets, so required harness and coordination skills are not listed. Choose mean or median, then optionally split every group by model, coding harness, effort, model and effort, or model and coding harness. Direct labels report the sample size and the aggregate score and budget. Horizontal and vertical min-max ranges remain on by default so a mean cannot hide run-to-run variance or a failed cohort. Candidate number is unavailable in this view because it is not comparable across runs.
For a skill study, select the controlled runs, assign Experimental skill usage, choose Groups, and split by Model + effort. Tokens, active time, elapsed time, and API-equivalent cost can each be used as the budget axis.
See Stop Using Skills: Chart Assets for a worked example using condition means, effort splits, sample sizes, and full ranges.
Use Add text or Add arrow to place an annotation on the report. Drag a text box or arrow to move it. A selected text box exposes a resize handle, and a selected arrow exposes handles for both endpoints. Annotation coordinates are relative to the report surface, so they remain aligned when the output format changes.
Share And Export¶
The toolbar provides these outputs:
| Action | Result |
|---|---|
| Present | Opens the composed view without editor chrome. Edit view returns to the studio. |
| Copy link | Copies a presentation URL containing the current composition in its URL fragment. |
| HTML | Downloads a self-contained HTML snapshot with only the rendered selection. Its legend remains clickable. |
| SVG | Downloads a vector snapshot of the complete composition. |
| PNG | Downloads a 4x raster image: 4800x2700, 4320x4320, or 4320x5400. |
Composition state is encoded in the URL fragment. It is not written to the ScoreBench database and the fragment is not sent in HTTP requests. Reloading or sharing the full URL restores display names, colors, run selection, emphasis, chart settings, the label preset, the Groups skill filter, narrative text, text boxes, and arrows.
Sharing Boundary¶
Run filtering in a live Export Studio link is a presentation choice, not an authorization boundary. The generated studio page has the same underlying exercise report data as its public strategy dashboard, even when only two or three runs are visible.
Use the downloaded HTML, SVG, or PNG when the artifact itself must contain only the selected, rendered comparison. These snapshot files do not include the studio's full report payload.
Runtime Cost¶
The report builder generates one export page beside each strategy comparison page. Editing, link serialization, highlighting, and file rendering happen in the browser. No image service, database table, or third-party JavaScript dependency is required.