DAY 4 / 210

Create and Run First Promptfoo Config

This day establishes the first automated eval loop for StartupTribunal prompts, providing immediate red/green feedback essential to phase-1-eval. It shifts from manual testing to reproducible measurement before quality refinements begin.

⏱ 45 min target📝 2 quiz Qs

Resources

readingGitHub
Promptfoo Repository
README.md sections on installation and basic usage
25 min

Deliverable

promptfooconfig.yaml committed to main branch with one passing test run logged

Quiz · 2 questions

1. What is the minimal requirement for a promptfoo config to produce a red/green signal?

A list of prompts onlyAt least one prompt and one test assertionA full dataset of 100 examplesAn OpenAI API key in every file

2. Why run the config immediately after writing it instead of iterating on the prompt first?

Journal

Time spent (minutes)

Blockers

Commit / PR links (one per line)