Build a Claude agent, then trace and grade it

Summoner · AI and agent engineering2 spells in orderProposed, not testedUnrated

Play the combo

Foe: Mirage Djinn, an AI answer that sounds right but isn't.

Foes

  • Mirage Djinn

Party · Context

  • SummonerYour agent100/100
  1. Mirage Djinn

    The Mirage Djinn blocks the way.

    What really happensIt stands for an AI answer that sounds right but isn't.

    Summoner: Context 100/100.

  2. Mirage

    The djinn conjures a mirage, and the hero swings at nothing.

    What really happensA model can sound sure and still be wrong, so AI features need evals and checks.

    Summoner takes 8. Summoner: Context 92/100.

  3. Anthropic Agent SDK Dev

    A forge that starts a Claude Agent SDK project and inspects it.

    What really happensScaffolds and verifies a Claude Agent SDK app.

    SDK verifier: Context 40/40.

  4. Anthropic Agent SDK Dev

    The summons work the problem, each in its own context.

    What really happensEach subagent does its own model and tool work, apart from the main conversation.

    Mirage Djinn takes 50.

  5. Anthropic Agent SDK Dev

    SDK verifier returns with a short report.

    What really happensOnly the subagent's final summary comes back to the main agent.

    Summoner takes 2. Summoner: Context 90/100. Summoner: Insight. SDK verifier returns.

  6. Mirage

    The Mirage Djinn uses Mirage.

    Summoner takes 8. Summoner: Context 82/100.

  7. MLflow Skills

    A tracker's kit that records every step an agent takes, then grades it.

    What really happensAdds MLflow tracing, then builds scorers and runs an evaluation.

    Mirage Djinn takes 50. Mirage Djinn falls.

  8. Victory

    The Mirage Djinn falls.

    What really happensThe Agent SDK plugin gets a working, verified starter agent. MLflow skills then add tracing (Anthropic is a supported library) and an evaluation, so changes to the agent can be measured instead of guessed.

Cast order

  1. Anthropic Agent SDK Dev

    Scaffolds and verifies a Claude Agent SDK app.

  2. MLflow Skills

    Adds MLflow tracing, then builds scorers and runs an evaluation.

Why it works

The Agent SDK plugin gets a working, verified starter agent. MLflow skills then add tracing (Anthropic is a supported library) and an evaluation, so changes to the agent can be measured instead of guessed.

Records

No published usage for this combo yet.

Learn the spells

  1. 1. Anthropic Agent SDK Dev

    Claude Code

    /plugin install agent-sdk-dev@claude-plugins-official

  2. 2. MLflow Skills

    Claude Code and Codex

    npx skills add mlflow/skills