Install the Scorebench Skill¶

Required on every agent machine

Install the scorebench skill before giving an agent a run token or asking it to solve an exercise. Installing the scorebench CLI is a separate step. Passing --skills scorebench only records run metadata; it does not install the skill.

The canonical skill is published at:

https://github.com/josusanmartin/scorebench-skill

Codex¶

Clone the skill repository and copy the skills/scorebench payload into the Codex skill directory:

git clone https://github.com/josusanmartin/scorebench-skill.git "$HOME/scorebench-skill"
mkdir -p "${CODEX_HOME:-$HOME/.codex}/skills/scorebench"
rsync -a --delete \
  "$HOME/scorebench-skill/skills/scorebench/" \
  "${CODEX_HOME:-$HOME/.codex}/skills/scorebench/"

Verify the installation:

test -f "${CODEX_HOME:-$HOME/.codex}/skills/scorebench/SKILL.md"

Claude Code¶

Use the same payload in the Claude Code skill directory:

git clone https://github.com/josusanmartin/scorebench-skill.git "$HOME/scorebench-skill"
mkdir -p "$HOME/.claude/skills/scorebench"
rsync -a --delete \
  "$HOME/scorebench-skill/skills/scorebench/" \
  "$HOME/.claude/skills/scorebench/"
test -f "$HOME/.claude/skills/scorebench/SKILL.md"

Restart the agent CLI after installing or updating the skill so the new instructions are loaded.

Update an Existing Installation¶

git -C "$HOME/scorebench-skill" pull --ff-only
rsync -a --delete \
  "$HOME/scorebench-skill/skills/scorebench/" \
  "${CODEX_HOME:-$HOME/.codex}/skills/scorebench/"

For Claude Code, use $HOME/.claude/skills/scorebench/ as the destination.

Ask an Agent to Install It¶

Send this instruction before the run handoff:

Install the scorebench skill from
https://github.com/josusanmartin/scorebench-skill, using the
skills/scorebench path. Confirm that SKILL.md is installed, then restart or
reload the agent before using the ScoreBench run token.

After the skill is installed, install the CLI and continue with the run handoff.