Pylon 创始人:50% 拦截率未减员,用预调查上下文替代
Pylon’s Founders at SaaStr AI Day: A 1,000-Person Support Team Deflected 50% of Its Tickets. Headcount Didn’t Change.
做客服产品、管客服团队或研究 AI 客服的读者,能拿到一个可验证的判据:把拦截率与客服人数、中位处理时长对比,就能检验 AI 是否真减负;以及一套“预调查上下文”的做法,直接可借鉴。
Marty Kausas and Advith Chelikani on why deflection rate is the wrong numberin CX. And what they’re replacing it with, and what you should, too.
Marty Kausas 和 Advith Chelikani 谈为什么偏转率是客户体验中的错误指标,以及他们用什么来替代它,你也应该这样做。
Pylon closed out the latest SaaStr AI Day with the two co-founders walking through the launch they shipped the week before, which they’re calling agentic customer support. Marty Kausas is co-founder and CEO, Advith Chelikani is co-founder and CTO. The company is a little over three years old and around 1,600 customers, almost all B2B.
Pylon 在最近的 SaaStr AI Day 上,由两位联合创始人介绍了他们一周前发布的、称之为“代理式客户支持”的产品。Marty Kausas 是联合创始人兼 CEO,Advith Chelikani 是联合创始人兼 CTO。公司成立三年多,拥有约 1600 家客户,几乎全是 B2B。
Their argument is that support bought the wrong AI product for the last two years, and the deflection numbers everyone reports are hiding it.
他们认为,过去两年支持部门买错了 AI 产品,而每个人报告的偏转率数字掩盖了这一点。
What the session covered:
本次会议涵盖的内容:
- Why a 50% deflection rate produced zero headcount change at a company with 1,000 support people
- The case for human plus AI over full replacement, and why support ran the other direction
- Two live examples of a ticket that arrives already investigated, including one that replaced a manual AWS log query
- Beta results from customers: 70% fewer escalations at one, 64.5% faster first response at another
- 为什么在拥有 1000 名支持人员的公司,50% 的偏转率没有带来任何人员数量的变化
- 支持“人+AI”而非完全替代的理由,以及为什么支持部门却反其道而行之
- 两个实时示例,展示工单到达时已被调查过,其中一个替代了手动 AWS 日志查询
- 客户测试结果:一家客户升级率降低 70%,另一家首次响应速度提升 64.5%
1. The test is whether the job is unrecognizable
1. 检验标准是工作是否变得面目全非
Kausas opened with an engineer who joined Pylon earlier this year after a two-year sabbatical. He left as a software engineer with no AI coding tools and came back into a job he described as unrecognizable. Before, you wrote the code, tested it, and reviewed it yourself. Now you’re managing agents doing that work.
Kausas 以一位今年早些时候加入 Pylon 的工程师开场,他休了两年假。他离开时是一名软件工程师,没有使用 AI 编码工具,回来后发现工作变得面目全非。以前,你亲自写代码、测试和审查。现在,你是在管理做这些工作的代理。
That’s the bar Kausas set for support. If a support person joins your company and the job feels like the job they left, nothing has actually changed.
这就是 Kausas 为支持部门设定的标准。如果一位支持人员加入你的公司,感觉工作和他离开时一样,那么实际上什么也没有改变。
He also put up AI spend by department. Coding is the only bar that has meaningfully taken off. Every other function is still at the start.
他还按部门列出了 AI 支出。编码是唯一一个真正起飞的部分。其他所有功能仍处于起步阶段。
2. The deflection number that didn’t move headcount
2. 没有改变人员数量的偏转率数字
Kausas’s argument is that the fastest-growing AI companies are running human plus AI augmentation rather than full replacement. He pointed at the model labs themselves, plus Cursor in coding and companies like Harvey in legal, and noted that he uses Claude and Codex daily and neither is close to automating him.
Kausas 的论点是,增长最快的 AI 公司正在采用“人+AI”增强而非完全替代。他指出了模型实验室本身,以及编码领域的 Cursor 和法律领域的 Harvey 等公司,并提到他每天使用 Claude 和 Codex,但两者都远未自动化他的工作。
Support went the other way. Almost everyone ran at full-resolution agents, which Pylon frames as solving a real but narrow slice of the problem, especially in B2B where tickets carry more context and more relationship.
支持部门却反其道而行之。几乎所有人都运行全自动解决代理,Pylon 认为这解决的是问题中真实但狭窄的部分,尤其是在 B2B 中,工单承载着更多上下文和更多关系。
The example: a company of roughly 5,000 people with about 1,000 on the support team deployed a fully automated resolution agent. It deflects around 50% of tickets. Headcount didn’t change.
例子:一家约 5000 人的公司,其中约 1000 人在支持团队,部署了一个全自动解决代理。它偏转了约 50% 的工单。人员数量没有变化。
The reason is that ticket count and work volume aren’t the same measurement. What an agent can fully resolve with no human in the loop is a limited set of questions, and those are the easy ones that consumed the least time to begin with. Deflecting 50% of tickets can remove a much smaller share of the actual work. Everything hard still escalates to a person.
原因是工单数量和工作量不是同一度量。一个客服能在无人介入的情况下完全解决的问题是有限的,而且这些是最简单、最初耗时最少的问题。拦截50%的工单可能只减少了实际工作中很小的一部分。所有困难的问题仍然会升级给人工处理。
Pylon’s bet follows from that: automated resolution gets commoditized, and the value sits in helping humans do the escalated work faster. Worth noting this is a vendor drawing a line where their product sits, and the specific 50% example came from one customer conversation rather than a study. The underlying point is still testable in your own numbers. Compare your deflection rate against your support headcount and your median handle time over the same period.
Pylon的赌注基于此:自动化解决变得商品化,而价值在于帮助人类更快地完成升级的工作。值得注意的是,这是供应商在划定其产品所在的位置,而具体的50%的例子来自一次客户对话,而非研究。但基本观点仍然可以在你自己的数据中验证。比较同一时期你的拦截率、客服人数和平均处理时间。
3. Why DIY with Claude hits a wall
3. 为什么用Claude DIY会碰壁
Most teams already have people asking Claude for help answering tickets, connected to the help center, feature request logs, the support system, and the code base. Kausas’s position is that this gets you real but limited help.
大多数团队已经有人使用Claude来帮助回答工单,连接到帮助中心、功能请求日志、支持系统和代码库。Kausas的立场是,这能给你真实但有限的帮助。
His example: one of the best ways to answer a new ticket is finding similar past tickets. A skill that has to read through every past ticket to do that is impractical every single time.
他的例子:回答新工单的最佳方法之一是找到相似的过去工单。一个必须阅读所有过去工单才能做到这一点的技能,每次都不切实际。
Pylon’s answer is precomputing the context layer instead. Account setup, goals, use cases, interaction history, and sentiment are computed ahead of time, along with related tickets, related knowledge articles, and who the contacts are and what they care about. The claimed result versus rolling your own is three to six times cheaper inference, better quality, faster responses, and team control instead of a group of people trying to co-own one skill.
Pylon的答案是预先计算上下文层。账户设置、目标、用例、交互历史和情感是提前计算的,还有相关工单、相关知识文章、联系人是谁以及他们关心什么。与你自己构建相比,声称的结果是推理成本降低三到六倍,质量更好,响应更快,并且团队控制而不是一群人试图共同拥有一个技能。
4. What a pre-investigated ticket looks like
4. 预先调查的工单是什么样子
Chelikani demoed Pylon’s own support queue. A customer named Ryan asks for a fix to a filter in the analytics part of the product. On the right side, the background agent has already run.
Chelikani演示了Pylon自己的支持队列。一位名叫Ryan的客户要求修复产品分析部分的过滤器。在右侧,后台代理已经运行。
What it produced before a human touched the ticket: it interpreted the screenshots and identified the analytics area even though the customer never named it, found two similar past issues from other customers, surfaced a call from the previous week where this customer had been frustrated about the same thing, and checked the code to confirm the backend was implemented but not surfaced on the front end. It concluded this was a UI regression rather than a missing feature, and suggested next steps.
在人工接触工单之前,它产生了什么:它解释了截图并识别了分析区域,即使客户从未命名它,找到了其他客户的两个类似过去问题,显示了上周的一次通话,其中这位客户对同一件事感到沮丧,并检查了代码以确认后端已实现但未在前端显示。它得出结论,这是一个UI回归而不是缺失功能,并建议了下一步。
Karen, the support engineer, then worked interactively. She asked whether an open feature request existed in Linear (it didn’t), pushed the agent deeper into the code base to confirm a suspicion, ran a skill that packaged the customer context and the investigation into a Linear issue tied to the ticket, then asked for a reply drafted in her tone of voice. She reviewed it and sent it.
随后,支持工程师Karen进行了交互式操作。她询问Linear中是否已存在开放的功能请求(没有),推动代理更深入地检查代码库以确认一个怀疑,运行了一个技能,将客户上下文和调查结果打包成与工单关联的Linear问题,然后要求以她的语气起草回复。她审阅后发送了。
The division of labor is the point. The agent did the gathering, and the human kept the judgment call and the responsibility for the response.
分工是关键。代理负责收集信息,而人类保留判断权和回复的责任。
5. The AWS log query that took a minute instead of twenty
5. AWS日志查询从二十分钟缩短到一分钟
The second example was a customer asking when a specific team in their instance had been deleted.
第二个例子是客户询问其实例中某个特定团队何时被删除。
The manual version: log into AWS, open CloudWatch, look up the customer’s organization ID, write a SQL query against the logs, read the results, and figure out what happened.
手动版本:登录AWS,打开CloudWatch,查找客户的组织ID,对日志编写SQL查询,读取结果,并弄清楚发生了什么。
The agent had already done it, using IDs it already held for that customer plus the new one provided, and it knew where to look and what the query should be because it had solved this type of issue before. It returned the exact timestamps and drafted a response built on the audit trail from the logs. Owen on the support team sent it as written after confirming the results.
代理已经完成了这项工作,使用了它已持有的该客户的ID以及新提供的ID,并且它知道去哪里查找以及查询应该是什么,因为它以前解决过这类问题。它返回了确切的时间戳,并根据日志中的审计跟踪起草了回复。支持团队的Owen在确认结果后按原样发送了。
The customer got a real answer in a minute or two instead of a note saying someone would look into it.
客户在一两分钟内得到了真正的答案,而不是收到一条“会有人调查”的通知。
6. The agent learns from people doing their jobs
6. 代理从人们的工作中学习
Asked how much non-technical team members can shape the agent, Chelikani’s answer was that going back and forth with it is functionally writing down every step you took to solve the issue.
当被问及非技术团队成员能在多大程度上塑造代理时,Chelikani的回答是,与代理来回互动实际上就是在写下你解决问题的每一步。
Ask it to check whether a feature request exists, and it learns that in this class of ticket you check feature requests, and where you check them. The next similar ticket arrives with that already done. Same for knowing which Slack channel covers which project.
让它检查是否存在功能请求,它会学到在这类工单中要检查功能请求,以及在哪里检查。下一个类似的工单到达时,这项检查已经完成了。同样,它也知道哪个Slack频道对应哪个项目。
That’s a different adoption model from most AI tooling. The people who can’t configure anything are still training the system by working in it.
这与大多数AI工具的采用模式不同。那些无法配置任何东西的人仍然通过在其中工作来训练系统。
7. Background agents and the Slack surface
7. 后台代理与Slack界面
Auto-investigating every incoming ticket is the most common background agent, but teams set up others. Pylon’s own runs every time a feature request closes: it summarizes what shipped, checks whether it’s actually deployed, decides whether it resolves the customer’s original ask, and posts that into the AI thread on the relevant ticket. That closes a gap most support teams live with, where engineering ships the fix and nobody tells the person who took the complaint.
自动调查每个传入的工单是最常见的后台代理,但团队也设置了其他代理。Pylon自己的代理在每次功能请求关闭时运行:它总结发布的内容,检查是否实际部署,决定是否解决了客户的原始请求,并将该信息发布到相关工单的AI线程中。这弥补了大多数支持团队长期存在的空白,即工程部门发布了修复,但没有人告知提出投诉的人。
The Slack surface carries the same knowledge as the app. In the demo, someone forwarded a customer question into a channel, tagged Pylon, and got an answer drawn from the code base, logs, past tickets, and prior customer interactions. Chelikani followed up by asking whether a knowledge base article should be updated to prevent the confusion. The agent found the relevant doc, drafted the update, and tagged him for review before publishing.
Slack 界面承载着与应用程序相同的知识。在演示中,有人将客户问题转发到频道,标记了 Pylon,并从代码库、日志、过往工单和之前的客户互动中获得了答案。Chelikani 随后询问是否应更新知识库文章以防止混淆。代理找到了相关文档,起草了更新内容,并在发布前标记他进行审查。
8. What beta customers are reporting
8. 测试版客户反馈
更进一步:量化金融体系
看懂新闻只是起点——沿量化金融路径,把它变成能交付的工程能力