跳到正文
Cognition 模型 / Devin 博客·· 3 小時前AI 評分53

Devin 2.1 加入信心評分、程式碼庫理解並調整計劃確認

Devin 2.1

AI 導讀

Cognition 為 Devin 2.1 加入任務信心評分及內置程式碼庫理解,並調整計劃確認方式。Devin 會在建立計劃後及回答程式碼問題時評估信心;🟢評分對應已合併 PR 的可能性是🔴評分的兩倍。Linear 和 Jira 整合可在不啟動工作階段下為多個問題評分;信心不足時 Devin 會提出澄清問題,對計劃不確定時則等待用戶批准。

正文

By The Cognition Team05.15.25

It can sometimes be hard to tell whether Devin (or any other coding agent) is likely to succeed with a task. When Devin tries to tackle a task that's outside of its current capabilities, this sometimes leads to wasted time and ACUs. And, one of the biggest blockers to successful sessions is simply that initial prompts are underspecified—they don't contain enough detail for Devin to use.

Today, we’re announcing some major changes in Devin 2.1, with these issues in mind.

Devin now reports its confidence that it can complete tasks using 🟢 🟡 🔴, and is more likely to succeed in large codebases with better codebase context 🧠. We've also added these upgrades to the Linear and Jira integrations.

Confidence Ratings

Devin 2.1

At multiple points in each session, Devin will express how confident it is in its approach:

  • at the start of the session
  • after creating a plan
  • whenever answering a question about the code

When Devin doesn’t have 🟢 confidence, it will ask clarifying questions to improve its understanding and raise the score.

Developers can boost Devin's confidence by providing guidance or answering the questions that Devin raises.

We've found that Confidence Scores are highly correlated with task success, with 🟢 scores resulting in twice the likelihood of a merged PR compared to 🔴.

Automatic Confidence Ratings for Issues

When using Devin via our Linear and Jira integrations, it's easy to request confidence scores for multiple issues at once. This happens without starting actual Devin sessions, meaning you can score as many issues as you'd like and only have Devin work on the highest-confidence issues.

In Settings, you can configure Devin to automatically scan all issues when they're created.

Built-in Codebase Intelligence

The same codebase understanding that powers DeepWiki is now built-in to Devin. At any point during the task, you can ask a question about the code, get clarification on some implementation, or ask for follow-up, and Devin will provide a response informed by codebase snippets.

Devin auto-detects when it should scan your codebase to answer your question, but you can also trigger it using !ask.

Devin 2.1

Plan Confirmation Simplification

Now that Devin is aware of its own confidence, Devin will wait for user approval when it is unsure about its plan. Otherwise, it will proceed automatically and accept async feedback.

Note: The setting to control whether Devin automatically proceeds with its plan will be deprecated. The planning process can still be controlled with user input. Simply tell Devin to wait for approval. Or, add knowledge expressing any default preferences around getting plan confirmation.

Get started

You can start working with Devin 2.1 today at app.devin.ai.

For more information about Devin Enterprise, reach out to our Sales team here.

來源:Cognition 模型 / Devin 博客 · cognition.ai