VibeRPGSimulator

Queries W&B runs and Weave traces, compares and diagnoses runs, summarizes evals and writes W&B reports.

How it works

Foe: Mirage Djinn, an AI answer that sounds right but isn't.

Foes

  • Mirage Djinn

Party · Context

  • SummonerYour agent100/100

  1. Mirage Djinn

    The Mirage Djinn blocks the way.

    What really happensIt stands for an AI answer that sounds right but isn't.

    Summoner: Context 100/100.

  2. Mirage

    The djinn conjures a mirage, and the hero swings at nothing.

    What really happensA model can sound sure and still be wrong, so AI features need evals and checks.

    Summoner takes 8. Summoner: Context 92/100.

  3. Weights & Biases MCP

    The seer's glass connects to your W&B vault.

    What really happensThe agent reaches W&B's hosted server with your API key in a bearer header.

    Mirage Djinn takes 29.

  4. Weights & Biases MCP

    It reads the traces where the agent went wrong.

    What really happensquery_weave_traces_tool and count_weave_traces_tool look through Weave traces, for example the most common failures in the last 100.

    Mirage Djinn takes 13.

  5. Mirage

    The Mirage Djinn uses Mirage.

    Summoner takes 8. Summoner: Context 84/100.

  6. Weights & Biases MCP

    Two runs are laid side by side and judged.

    What really happenscompare_runs_tool and diagnose_run_tool compare metrics and config, or explain why a run diverged.

    Mirage Djinn takes 32.

  7. Weights & Biases MCP

    The verdict is written into a W&B report.

    What really happenscreate_wandb_report_tool builds a report with markdown and charts in your project.

    Mirage Djinn takes 26. Mirage Djinn falls.

  8. Victory

    The Mirage Djinn falls.

Learn this spell

Claude Code

claude mcp add --transport http wandb https://mcp.withwandb.com/mcp --scope user --header "Authorization: Bearer <your-api-key-here>"

Codex

export WANDB_API_KEY=<your-api-key>
codex mcp add wandb --url https://mcp.withwandb.com/mcp --bearer-token-env-var WANDB_API_KEY

Notes

Hosted at https://mcp.withwandb.com/mcp with your W&B API key; a local server also exists. Tools include query_weave_traces_tool, query_wandb_tool, compare_runs_tool, diagnose_run_tool, summarize_evaluation_tool and create_wandb_report_tool. log_analysis_to_wandb and report creation write to your account; tool profiles and a read-only mode can limit that. Codex install sets WANDB_API_KEY first.

This spell has no recorded sessions in the curator's logs. Tried it? Send a spell report.