keelyard 為 AI 編碼智能體加入工作驗證關卡
keelyard: making AI coding agents prove their work
Akobir Tulqinov 開發 keelyard,這個 Python CLI 與 MCP server 可接入 Claude Code、Codex 和 OpenCode,並要求智能體改動檔案後先通過測試才可完成工作。
I'm a solo developer from Uzbekistan. Most of what I ship (Telegram bots and mini apps for small businesses)
I build together with AI coding agents. They're fast, but they have one habit that cost me hours: they say
"done" when the work isn't done. Tests still red. Sometimes tests quietly removed.
keelyard is my fix. It's a Python CLI plus an MCP server that plugs into Claude Code, Codex and OpenCode.
What it does
- Proof gate. If the agent changed files, it can't finish until the tests pass on the current files. The evidence is labeled: test-verified, command-succeeded or agent-claimed. Deleted tests, new skips and removed assertions keep the gate closed.
-
Rewind. Every edit is snapshotted into
.keelyard/shadow.git, separate from your repo. Any step can be undone, and the undo is undoable. -
Smaller context. Filters for pytest, go test, cargo, jest, ruff, mypy, git and grep keep every error, warning and
file:lineand collapse the rest. Each filter is tested against real logs intests/corpus/.
Try it
pip install keelyard
cd your-project
keelyard init --preset lean
keelyard doctor
Honest limits
- Proof is only as good as your test suite.
- Snapshots restore files, not databases or deployed services.
- The token numbers in BENCHMARKS.md (267,525 -> 52,745 tokens over six tasks, -80%) come from small samples (3-8 runs per setup) on OpenCode only. Savings on Claude Code and Codex aren't measured yet.
- Claude Code and Codex are checked end to end in CI with the real CLIs and a local scripted model, which proves the wiring, not model quality.
CI runs on Linux, macOS and Windows with Python 3.11 to 3.13. It's Apache-2.0, with no telemetry.
Repo: https://github.com/akobirjontulqinovfuture/keelyard. Issues labeled "good first issue" are a good place to
start, and real logs from your test runners are the most useful thing you can send.
來源:DEV Community · dev.to