Prompt
I need a way to compare two prompt versions side by side
Latest observation
Oct 9, 2026
OpenAI APIWeb search: off
A simple way is to use a two-column comparison template with the same test cases run against both prompts.
Side-by-side prompt comparison format
| Test case | Prompt v1 output | Prompt v2 output | Better? | Notes |
|---|---|---|---|---|
| Case 1 | ||||
| Case 2 | ||||
| Case 3 |
What to compare
Use the same criteria for both versions:
- Accuracy
- Completeness
- Clarity
- Tone
- Consistency
- Conciseness
- Safety / policy compliance
Faster scoring version
| Test case | v1 score | v2 score | Winner | Why |
|---|---|---|---|---|
| Case 1 | 7 | 9 | v2 | More specific and correct |
| Case 2 | 8 | 6 | v1 | Fewer hallucinations |
| Case 3 | 6 | 6 | Tie | Both acceptable |
Good practice
- Keep the input identical
- Run multiple test cases
- Randomize order if possible to reduce bias
- Have a single reviewer rubric so comparisons stay consistent
If you want, I can also make you:
- a Google Sheets/Excel template,
- a Markdown table you can paste into docs, or
- a Python script to compare prompt outputs automatically.