跳到正文
DEV Community· Akobir Tulqinov·· 3 小時前AI 評分61

keelyard 為 AI 編碼智能體加入工作驗證關卡

keelyard: making AI coding agents prove their work

AI 導讀

Akobir Tulqinov 開發 keelyard,這個 Python CLI 與 MCP server 可接入 Claude Code、Codex 和 OpenCode,並要求智能體改動檔案後先通過測試才可完成工作。

正文

Cover image for keelyard: making AI coding agents prove their work

Akobir Tulqinov

I'm a solo developer from Uzbekistan. Most of what I ship (Telegram bots and mini apps for small businesses)
I build together with AI coding agents. They're fast, but they have one habit that cost me hours: they say
"done" when the work isn't done. Tests still red. Sometimes tests quietly removed.

keelyard is my fix. It's a Python CLI plus an MCP server that plugs into Claude Code, Codex and OpenCode.

What it does

  1. Proof gate. If the agent changed files, it can't finish until the tests pass on the current files. The evidence is labeled: test-verified, command-succeeded or agent-claimed. Deleted tests, new skips and removed assertions keep the gate closed.
  2. Rewind. Every edit is snapshotted into .keelyard/shadow.git, separate from your repo. Any step can be undone, and the undo is undoable.
  3. Smaller context. Filters for pytest, go test, cargo, jest, ruff, mypy, git and grep keep every error, warning and file:line and collapse the rest. Each filter is tested against real logs in tests/corpus/.

Try it

pip install keelyard
cd your-project
keelyard init --preset lean
keelyard doctor

Honest limits

  • Proof is only as good as your test suite.
  • Snapshots restore files, not databases or deployed services.
  • The token numbers in BENCHMARKS.md (267,525 -> 52,745 tokens over six tasks, -80%) come from small samples (3-8 runs per setup) on OpenCode only. Savings on Claude Code and Codex aren't measured yet.
  • Claude Code and Codex are checked end to end in CI with the real CLIs and a local scripted model, which proves the wiring, not model quality.

CI runs on Linux, macOS and Windows with Python 3.11 to 3.13. It's Apache-2.0, with no telemetry.

Repo: https://github.com/akobirjontulqinovfuture/keelyard. Issues labeled "good first issue" are a good place to
start, and real logs from your test runners are the most useful thing you can send.

來源:DEV Community · dev.to