Feature/runner backed benchmark eval#22

Merged

mohanagy merged 12 commits intomainfrom

feature/runner-backed-benchmark-eval

Apr 28, 2026

Commits on Apr 28, 2026

test: cover shared prompt runner parsing

mohanagy
and
Copilot
committed
refactor: share prompt runner parsing

mohanagy
and
Copilot
committed
test: codify benchmark eval cli contracts

mohanagy
and
Copilot
committed
feat: require exec for benchmark and eval

mohanagy
and
Copilot
committed
test: thread benchmark eval cli contexts

mohanagy
and
Copilot
committed
fix: thread benchmark eval cli contexts

mohanagy
and
Copilot
committed
test: cover runner-backed benchmark execution

mohanagy
and
Copilot
committed
feat: add runner-backed benchmark usage

mohanagy
and
Copilot
committed
test: cover runner-backed eval usage

mohanagy
and
Copilot
committed
feat: add runner-backed eval usage

mohanagy
and
Copilot
committed
docs: clarify runner-backed benchmark eval

mohanagy
and
Copilot
committed
fix: align eval CI runner contract

mohanagy
and
Copilot
committed