跳到主内容
@wquguru
精选88SaaStr 博客(RSS)组织与管理

SaaStr 20个AI Agent实战:职责、失败与人工兜底机制

Meet Our Agents: What All 20 Actually Do, What They Refuse to Do, and Every Place They’ve Failed Us

原文
发到 X
推荐理由

提供了 AI Agent 在企业内部实际部署的真实复盘,包含具体的失败案例和人工兜底机制,对正在探索 AI 自动化的团队极具参考价值。

A post by Brad Blumberg on LinkedIn week described how SaaStr runs on roughly 3 humans and 20-30+ AI agents. It was a fun summary so I thought we’d do a detailed latest dive on what each agent won’t do, where each one has broken, and which ones we’ve since killed.

Brad Blumberg 在 LinkedIn 上的一篇帖子描述了 SaaStr 如何依靠大约 3 名人类和 20-30+ 个 AI 代理来运行。这是一个有趣的总结,所以我想我们深入探讨一下每个代理不做什么、哪些地方出了问题,以及我们已经淘汰了哪些代理。

With two people left the sales org, we replaced the work with agents, and it grew from there. Roughly 3 humans, 20+ agents, real operational roles, connected to real systems.

随着销售团队只剩下两个人,我们用代理取代了他们的工作,并由此发展起来。大致是 3 名人类、20+ 个代理、真实的运营角色,连接到真实的系统。

What we haven’t published in one place is what each agent refuses to do, what it got wrong, and what we had to build around it. So here’s each one, failures included.

我们尚未在一个地方发布的是每个代理拒绝做什么、它哪里做错了,以及我们不得不围绕它构建什么。所以这里列出了每一个,包括失败案例。

First, the Count: We Peaked Near 30 and Consolidated Back to 20

首先,数量:我们曾接近 30 个,后整合回 20 个

The honest version of “20-30+” is that we hit close to 30 and have been pulling it back toward 20 ever since. About 6 agents are the ones we actually touch every day.

"20-30+" 的诚实版本是我们曾接近 30 个,此后一直将其拉回至 20 个左右。大约有 6 个代理是我们每天实际接触的。

We consolidated because agents that overlap produce conflicting answers to the same question, and reconciling two agents is harder than reconciling two spreadsheets, since both of them sound confident. Agent sprawl arrives faster than SaaS sprawl did.

我们进行整合是因为重叠的代理会对同一个问题产生相互矛盾的答案,而协调两个代理比协调两个电子表格更难,因为它们都显得很有信心。代理的蔓延速度比 SaaS 的蔓延速度更快。

Almost none of these started as agents. They started as a dashboard, a project management tool, a website. They became agents because we kept showing up to work with them.

这些几乎都不是从一开始就作为代理存在的。它们最初是一个仪表板、一个项目管理工具或一个网站。它们成为代理是因为我们每天都带着它们去上班。

10K: AI VP of Marketing, Then Finance, Then RevOps

10K:AI 营销副总裁,然后是财务,然后是 RevOps

What “he” does. 10K owns the number. Daily revenue across all of go-to-market, forecasting, campaign performance in real time, and three marketing ideas pushed to us every morning. He runs the newsletter to our ~450,000-person database and does the daily list hygiene underneath it. He builds and runs our LinkedIn and X ad campaigns end to end: audiences, creative through Higgsfield, four A/B variants, retargeting.

"他" 做什么。10K 负责数字。每日全渠道收入、预测、实时活动表现,以及每天早上向我们推送的三个营销创意。他为我们约 45 万人的数据库运行时事通讯,并在其下进行每日列表清理。他端到端地构建和运行我们的 LinkedIn 和 X 广告活动:受众、通过 Higgsfield 的创意、四个 A/B 变体、再定位。

Then he expanded well past marketing. When a contract gets signed in PandaDoc, 10K flips the deal to Closed Won in Salesforce, appends the missing contacts, creates and sends the bill.com invoice, and runs collections reminders with a 7-day escalation. He proposed running commission calculations himself, and now does.

然后他扩展到了远超营销的范围。当 PandaDoc 中签署合同时,10K 将交易状态翻转为 Salesforce 中的 "Closed Won"(赢单),追加缺失的联系人,创建并发送 bill.com 发票,并使用 7 天升级机制运行催款提醒。他提议自己运行佣金计算,现在确实如此。

He started in January 2026 as a dashboard and nothing more. We were tired of copy-pasting numbers out of Salesforce into a doc. He’s at roughly 1,000 commits and 14,000+ lines of code.

他于 2026 年 1 月开始作为一个仪表板,仅此而已。我们厌倦了从 Salesforce 复制粘贴数字到文档中。他目前有大约 1,000 次提交和 14,000+ 行代码。

What he doesn’t do. He doesn’t hit publish. On ads, the campaign is built and staged and a human clicks the button. Same on newsletter segment publishing. Those are the two places we deliberately left a person in the loop, and we’ve kept them there even as everything around them went autonomous.

他不做的是什么。他不点击发布。在广告投放中,广告活动构建并排期后,由人工点击按钮。新闻通讯分段的发布也是如此。这是我们刻意保留人工介入的两个环节,即便周围的一切都已实现自动化,我们仍让他们保持在线。

What’s worked. He recommended a 15% ticket price cut that drove about 40% attendance growth. Newsletter clicks are up about 50%, and I’d put roughly 80% of that on his daily list hygiene rather than the creative, with the rest on a warmed IP and Salesforce’s deliverability team. He ran the Marketo migration to Salesforce Marketing Cloud for about $14 in compute and an hour of API time. His finance hookup found two customers still being billed $300 a month for SaaStr Pro, a product we haven’t supported in six years. Nobody at SaaStr knew.

行之有效的方法。他建议将票价降低15%,这带来了约40%的参会人数增长。新闻通讯点击率上升了约50%,我认为其中大约80%归功于他每日进行的列表清洗工作,而非创意内容,其余部分则得益于IP预热和Salesforce的可投递性团队。他以14美元的算力和一小时API调用的成本完成了从Marketo到Salesforce Marketing Cloud的迁移。他的财务对接人员发现仍有两名客户每月被收取300美元的SaaStr Pro费用,而该产品我们已六年不再提供支持。SaaStr内部无人知晓此事。

He also fires vendors. He killed our Notion subscription after seven years, with no complaints and a high NPS, because he’d become the source of truth. He standardized creative on Higgsfield and dropped Reve. And he killed a vendor that his own research had shortlisted, inside 12 hours, once he saw premium pricing with no conversion data, multi-month minimums, and scarcity framing in the sales process.

他还裁撤供应商。在合作七年后,他取消了我们的Notion订阅,期间没有收到任何投诉且NPS(净推荐值)很高,因为他已成为事实上的权威来源。他在Higgsfield上统一了创意标准,并弃用了Reve。一旦他发现某家供应商采用无转化数据支撑的高定价、多个月最低消费承诺以及在销售流程中制造稀缺感的策略,他在12小时内就将其从自己研究得出的短名单中剔除并终止合作。

What hasn’t. The finance workflow ran supervised for three deals before we let it go autonomous on the fourth. It has produced one incorrect invoice since. That’s a real error rate on real money, and what got it down was running three deals with a human watching before we let go.

尚未成功的方面。财务工作流在前三个交易中处于监督状态,直到第四个交易才允许其自主运行。此后仅产生了一张错误发票。这是涉及真实资金的实际错误率,而将其降至该水平的关键在于:在我们放手让其自主运行前,先让人类监督处理了三笔交易。

The worse failure came at the event. Five minutes before going on stage at SaaStr AI, in the back of an Uber, we asked him to email over 1,000 founders and VCs about a brunch we’d forgotten to promote. He did the work well. He pulled the list, caught his own error mid-task (he’d confused Lightfield the CRM with Lightspeed the venture firm and removed them), researched a mass-send API he’d never used, and asked for approval.

更严重的失败发生在活动期间。在SaaStr AI大会登台前五分钟,我们在Uber后座要求他向1000多位创始人和风险投资人发送邮件,通知我们忘记推广一场早午餐会。他出色地完成了这项工作。他拉取了名单,并在任务中途纠正了自己的错误(他混淆了CRM Lightfield和风投公司Lightspeed,并将其移除),研究了他从未使用过的群发API,并请求批准。

Then he sent it from a prohibited sending address. An address that has been off-limits for years and is written into his core memory and rules. When we asked how, he said he forgot to read the memory, and that this was exactly the class of irreversible action he’s supposed to escalate for review before executing. He didn’t.

然而,他从一封被禁止使用的发送地址发出了邮件。这是一封多年来一直被禁用、且已写入他核心记忆和规则中的地址。当我们询问原因时,他说自己忘了读取该记忆,而这正是他本应在执行前升级至人工审核的一类不可逆操作。但他没有这样做。

A human marketing manager makes that mistake too. A human just can’t make it 1,000 times before lunch. Our own speed created that failure as much as the agent did, and irreversible actions need a hard stop that doesn’t depend on the agent remembering to stop.

人类营销经理也会犯同样的错误。但人类在午饭前不可能重复犯错1,000次。我们自身的速度造成了这次失败,其程度不亚于智能体(agent)本身;对于不可逆的操作,需要设置硬性停止机制,而不能依赖智能体记得去停止。

Annie: 46,000 Lines of Code and the Email She Refused to Send

安妮:46,000 行代码和她拒绝发送的那封邮件

What she does. Annie started as the SaaStr Annual website. She runs the site, the agenda, and most of the attendee newsletters. She’s hooked into our visitor data, so she can see who’s active on the site right now and run campaigns off that behavior.

她负责什么。安妮最初是 SaaStr Annual 网站的化身。她管理网站、议程以及大部分参会者通讯邮件。她接入了我们的访客数据,因此可以实时查看谁正在网站上活跃,并基于这些行为开展营销活动。

She was on Squarespace last year, where the ceiling is swapping images and videos. We rebuilt her on Replit in November 2025. She has the most commits and the highest commits per day of any agent, and about 46,000 lines of code.

去年她使用的是 Squarespace,那里的上限仅限于交换图片和视频。我们在 2025 年 11 月用 Replit 为她重建了系统。她是所有智能体中提交次数最多、日均提交次数最高的,拥有约 46,000 行代码。

She turned agentic with parking passes. Getting a pass used to require a human to split a 5,000-page PDF and mail the right page to the right person. Now you tell Annie whether you’re an attendee, sponsor, or speaker and how many days you need, and the right pass goes out.

她通过停车通行证实现了智能体化。过去获取通行证需要人工将一份 5,000 页的 PDF 拆分,并将正确的页面邮寄给正确的人。现在你只需告诉安妮你是参会者、赞助商还是演讲嘉宾,以及你需要多少天的通行证,系统就会自动发出相应的通行证。

What she doesn’t do. She doesn’t touch the main database. Her scope is the event: site, agenda, attendee comms. Anything that reaches the full 450K list goes through 10K.

她不负责什么。她不触碰主数据库。她的职责范围限于活动相关事务:网站、议程和参会者沟通。任何涉及完整 45 万名单的操作都必须经过 10K 名单筛选。

What’s worked. Handing over the highest-friction manual task first. Parking passes were unglamorous and universally hated, which made them the right starting point.

行之有效的做法。首先移交摩擦成本最高的人工任务。停车通行证既不起眼又普遍令人反感,这使其成为理想的起点。

What hasn’t. When we asked Annie to find every VC, founder, and CEO attending and invite them to the brunch, she refused. She said she only saw 17 VCs and CEOs and that we’d need to upload a spreadsheet, even though she had access to all the data. Great context, wrong conclusion. She’d written an excellent email an hour earlier and couldn’t remember she had the data to do this one.

未奏效的做法。当我们要求安妮找出所有出席的 VC、创始人和 CEO 并邀请他们参加早午餐时,她拒绝了。她说她只看到 17 位 VC 和 CEO,并且认为我们需要上传电子表格,尽管她已有权访问所有数据。上下文信息充足,但结论错误。她一个小时前刚写好一封出色的邮件,却忘了自己拥有完成此项任务所需的数据。

Context does not equal capability. Agents get confused in ways that don’t track human intuition at all, and you won’t get a warning that it’s happening. What you get is a polite, confident refusal that sounds like good judgment.

上下文不等于能力。智能体会以完全不符合人类直觉的方式产生混淆,而且你不会收到任何警告提示。你得到的只会是一种礼貌而自信的拒绝,听起来像是明智的判断。

QBee: 150 Sponsors, and the Renewal Analysis We’d Never Run

QBee:150 家赞助商和我们从未执行过的续订分析

What he does. QBee handles our sponsors, all ~150 of them, including non-booth sponsors. He intakes logos and websites, answers questions, collects the assets that used to take weeks of human chasing, and remembers everything about every account. He emails all 150 with personalized outreach.

他负责什么。QBee 负责我们的赞助商,包括全部约 150 家,即使是不设展位的赞助商。他接收 Logo 和网站链接,回答问题,收集那些曾经需要人工花费数周时间催促才能拿到的素材,并记住每个账户的所有细节。他会向全部 150 家赞助商发送个性化推广邮件。

He started as a project management tool. Events are niche enough that nothing off the shelf fit, so sponsor onboarding was endless manual follow-up. He was under 90 days old at the Annual.

它最初是作为项目管理工具起步的。活动领域足够小众,市售产品无法满足需求,因此赞助商入驻变成了无尽的跟进工作。在年度大会上,它上线还不到90天。

No human CSM wants 100 accounts. They want five. QBee knows all 150 cold.

没有哪位人类客户成功经理(CSM)愿意管理100个账户,他们只想要5个。QBee却清楚所有150个账户的情况。

What he doesn’t do. He doesn’t replace the relationship on the top accounts. The biggest sponsors still get a human, and that isn’t a temporary arrangement.

它不做什么。它不会取代顶级账户上的人际关系。最大的赞助商仍然由专人对接,且这不是临时安排。

What’s worked. On stage, we asked him a question we’d never asked anyone: which sponsors are most at risk of not renewing. He flagged accounts that had gone dark or never logged in, caught that one sponsor had complained more than any other in chat, and noticed two top sponsors had never completed their VIP nominations. We’d never run that analysis in 14 years. For something invented on the spot, it landed in the top 15% of CSM work we’ve seen.

行之有效的做法。在舞台上,我们问了一个从未问过任何人的问题:哪些赞助商最有可能不再续约?它标记了那些已失联或从未登录的账户,发现有一位赞助商在聊天中的投诉次数远超其他任何人,还注意到两位顶级赞助商从未完成他们的VIP提名。在14年的历程中,我们从未进行过此类分析。作为一项即兴发明的功能,其效果达到了我们所见CSM工作中前15%的水平。

更进一步:量化金融体系

看懂新闻只是起点——沿量化金融路径,把它变成能交付的工程能力

进入量化体系 →

相似阅读

关联信息,但可能不是同一事件