跳到正文
DEV Community· SKILL123.me·· 3 小時前AI 評分65

如何在 60 秒內審視 Agent Skill 的 SKILL.md

How to Read a SKILL.md in 60 Seconds

AI 導讀

SKILL.md 的 60 秒審視法以六項檢查協助安裝前排除常見問題,並指出結構差異最大、工作流程設計對評分貢獻最高。檢查依次涵蓋檔案樹、描述中的不適用範圍、流程末端驗證、指令具體度、引用路徑,以及能力範圍與用途是否相符;作者稱安全只佔分數差異約 4.6%。評分方法公開於 https://skill123.me/methodology,每個技能頁亦列出六項評分及文字理由。

正文

You're not going to fully evaluate a skill before installing it. You're going to rule out the four or five expensive mistakes — in the order that actually correlates with quality.

We score 628 agent skills on six dimensions. If you look at what separates the top 18 (9.5+) from the middle 214 (7.5–8.5), the ranking surprises people:

Structure has the widest spread. Workflow design contributes the most points. Security — the thing everyone talks about — accounts for about 4.6% of the difference.

That ordering is also the order to read in. Not because security doesn't matter, but because the security you can see in 60 seconds is mostly a binary you check at the end, while structure and workflow are where the quality lives.

1. Open the file tree first — 15 seconds

Before reading a line, look at what ships next to the SKILL.md.

skill-name/
├── SKILL.md          ← should be lean
├── references/       ← detail, loaded on demand
├── scripts/          ← runnable code
└── assets/           ← templates, fonts, icons

Green flag: a SKILL.md under a few hundred lines with depth pushed into references/. That's progressive disclosure — the agent reads the summary and loads detail only when it needs it.

Red flag: a 900-line SKILL.md with no references/. Everything loads on every activation, and it means the author never had to decide what matters.

Highest signal, least time. Structure is where the widest gap between good and average skills is.

2. Find the negative space in the description — 10 seconds

The description field is the router. Ask one question:

Does it say when this skill should not fire?

Most say what it does. Many say when to use it. Very few name the adjacent requests that should go elsewhere.

# weak
description: Reviews contracts and identifies legal risks.

# strong
description: Reviews a contract against a risk taxonomy and returns findings
  with severity and suggested redlines. Use when the user asks to "review this
  contract", "check this NDA", or "flag risky clauses". Not for drafting new
  agreements (use an NDA generator), not for jurisdiction-specific compliance
  questions (use a compliance skill).

A skill with no negative space fires on everything adjacent. Install three of those and your agent starts loading the wrong instructions for ordinary requests — worse than not installing them.

3. Scroll to the end of the workflow — 15 seconds

Workflow design is the heaviest dimension in the rubric, and most of it is decided by one thing:

Is there a step that verifies the result before claiming done?

Look for "check the output renders", "diff against the source", "run the tests", "confirm the file opens". A skill that produces and stops is a generator, not a workflow — and you'll be the one who discovers the failure.

Red flag: the last numbered step is "return the result" or "summarize". Nothing checks.

4. Look at the commands — 10 seconds

# concrete
pandoc input.docx -o output.pdf --pdf-engine=xelatex

# vague
Run the conversion tool with the appropriate options.

Vague commands fail in the field because the agent has to guess the arguments — and it will guess differently than you would.

5. Spot-check one path — 5 seconds

Pick any file the skill references and confirm it exists in the package. Skills regularly reference files the author forgot to ship, especially under scripts/ and assets/.

Cheapest possible test of whether anyone ran the skill after packaging it.

6. Then, and only then, check what it touches — 5 seconds

Security is mostly a floor, not a differentiator — 92% of the directory scores 9+. Almost everything published is clean. But "clean" isn't your question. Scope is.

Scan for:

  • What it reads — project files only? Env vars? A home directory?
  • What it sends — to which hosts? Is that host in the stated purpose?
  • What it persists — config files, shell profiles, browser profiles?
  • What it asks the agent to execute — does it hand the agent a shell command built from untrusted input?

The clearest signal is the gap between what the description promises and what the capability manifest contains. A skill that formats Excel files has no business reading your keychain. Confirmed credential access, exfiltration, or injection caps a skill at 39/100 in our scoring — and it's rare, which is exactly why the mismatch is the thing to look for.

The 60-second verdict

Check Time What it catches
File tree 15s Bloated monoliths, no progressive disclosure
Description's negative space 10s Skills that fire on everything
Workflow's final step 15s Produces without verifying
Command concreteness 10s Instructions the agent has to guess
One referenced path 5s Unrunnable packages
Scope vs. stated purpose 5s Capability mismatch

If all six pass, you have a skill worth installing. If one fails, you have a decision to make instead of a surprise to discover in production.

The rubric is public at https://skill123.me/methodology, and every skill page shows the same six scores with the written reasoning — so you can compare your read against ours and argue with a specific number.

來源:DEV Community · dev.to