LLM prompt lifecycle
Open Learning LLM call sites are moving onto
ol-llm, and apps on it fetch their prompts from Opik through it.
Production runs the prompt version an app's repository points at: a pull request moves the
pointer, and merging it moves the production label in Opik.
The runbook lives with the library, so it changes with the code it describes: Prompt promotion. It covers moving production, what running apps see after a label moves (up to five minutes of cache), rolling back, what to do while Opik is down, and what to check after a promotion.
The decisions behind it are in
llm-opik-lifecycle-spec.md
(section 1.2 item 5 for the drift report, 2.3 for promotion, 3 for the runtime
policy, and 5.1 item 9 for online scoring).