Prompt versions

Play this lesson

The prompt is code

Remy keeps the Garden Guide's instructions in the code repository, not in a settings page. Every change gets a version number, a review and a note saying why, like any other code.

Name the model too

Models are retired. Anthropic says "Requests to retired models will fail", and gives "at least 60 days' notice before model retirement for publicly released models". Shard Garden names an exact model in its code and tests the next one well before the date.

Quick check

The model the Garden Guide uses gets a retirement date. What should Remy do first?

  1. Run the eval on the replacement model
  2. Wait until the date
  3. Switch without testing
Show the answer

Run the eval on the replacement model

The eval shows whether the new model answers as well before players see it.

Roll out like code

A new prompt version goes to 5% of players first, beside the old one. If reports or blocked answers rise, the team switches back with one setting, without a new app release.

Read the rollout

reports per 1,000 answers
prompt v13 (95%)  2.1prompt v14  (5%)  6.8

Priya compares the two versions. What should happen to v14?

  1. Switch it off and find out why
  2. Send it to everyone
  3. Leave it as it is
Show the answer

Switch it off and find out why

v14 draws three times as many reports. Only 5% of players saw it.

Know which version answered

Every logged answer records its prompt version and model. When a player reports an answer, the team can see exactly what produced it.

Quick check

Editing the live prompt without a new version is fine for small changes.

Show the answer

False

A small edit can change thousands of answers. Without a version, nobody can see it or undo it.

One change at a time

A new model and a new prompt in one release? If answers get worse, nobody knows which caused it. Shard Garden changes one, measures, then changes the other.

Answers from the studio's own pages

The guide answers best when it can read the game's help pages.

Bolt says: Next: retrieval.

Fact-checked 12 October 2026