Sierra 的 Ghostwriter 績效評估
Ghostwriter’s performance review
Sierra 的 AI teammate Ghostwriter 協助客戶建立 AI 智能體,並持續檢視對話、發布和數據指標,及早發現問題、追查成因及提出修正建議。客戶回饋顯示,ShipStation Global 減少了手動檢查和排查所花的時間;Ghostwriter 亦會追蹤實驗和發布,回報修改是否帶來成效。
Ghostwriter is an AI teammate that helps our customers build their agents. It works alongside them in Slack and Teams, watches how their agents perform, and suggests improvements that help them serve their customers better.
Like any teammate, Ghostwriter gets a performance review, so we asked five customers for feedback. One theme runs through all of their answers: by the time someone sits down to look at a problem, Ghostwriter has usually found it, understood the cause, or drafted a change to fix it.
Finding problems before anyone reports them
Most teams learn about problems with their agent when a customer complains. Ghostwriter reviews conversations, releases, and metrics continuously against the goals each team sets, raising issues in the team’s channel. At ShipStation Global, that has cut down how much the team reviews by hand.

Because Ghostwriter is always watching, it catches problems even when no one is around to look. One morning at Carta, it posted that the chat agent was failing to create support cases. It had already found the likely cause and listed the affected customers, and it later confirmed when things recovered.

Getting to the root cause
When something looks off, the slow part is often working out why. Ghostwriter traces the problem to its source, whether that’s how the journey was built or a system the agent depends on, and lays out what it found in the thread. At Tilt, a question sent from a phone was enough to get an issue diagnosed and handed off.


Because each fix arrives already tested, the ShipStation Global team spends less time digging through journeys and settings to work out why the agent did what it did.

Checking the result
After a change goes live, Ghostwriter keeps track of each experiment and release and reports back on whether it made a difference. For Imprint, which partners with some of the largest brands in the world, that’s how they maintain quality even as more people are working on their agent.

Taken together, that’s a strong first performance review, and it’s only the start. The longer Ghostwriter works with a team, the more it learns how that team works, so we’re even more excited for the next one.
來源:Sierra:Blog · sierra.ai