Backstory 用 AI 三天完成客户分层,过去需五个团队一季
Backstory Retiered Its Entire Customer Base in 3 Days. The Same Exercise Used to Take Five Teams a Quarter.
给客户成功和增长团队一套可复制的 AI 分层方法:从定义黄金客户到用连接器整合数据,再到迭代修正信号,今天就能照着搭。
Haya Kamola on running an account tiering analysis with connectors, custom signals, and four rounds of iteration, live at SaaStr AI Day
Haya Kamola 在 SaaStr AI Day 上现场演示了如何使用连接器、自定义信号和四轮迭代进行账户分层分析
Haya Kamola leads customer success at Backstory, and spent her career in sales and sales leadership before that. The project she walked through at SaaStr AI Day is one most go-to-market leaders have either run or will run: take the customer base, figure out which accounts deserve the team’s time, and redistribute against that.
Haya Kamola 负责 Backstory 的客户成功,此前她的职业生涯专注于销售和销售领导。她在 SaaStr AI Day 上介绍的项目是大多数市场负责人已经或将要开展的工作:分析客户群,确定哪些账户值得团队投入时间,并据此重新分配资源。
The ask came down from the board with a short turnaround. 141 accounts. Define what the best customers look like, measure everyone against that, and produce a tiering framework the executive team can act on.
董事会提出了要求,时间紧迫。141 个账户。定义最佳客户的特征,以此衡量所有客户,并生成一个高管团队可以据此行动的分层框架。
In a previous life, that was her team plus four others, working a full quarter. This version took three to four days.
在过去,这需要她的团队加上另外四个团队,整整一个季度才能完成。而这次只用了三到四天。
What the session covered:
本次会议涵盖的内容:
- Defining the “golden customer” from account team judgment before touching any data
- Building the signals they had never measured repeatably, including a five-level AI maturity score generated per account with a rationale
- Replacing a cross-functional data pull with four connectors and one CSV export from Salesforce
- Four iterations to narrow eight signals down to four scoring buckets, including one signal that was scoring backwards
- 在接触任何数据之前,根据客户团队的经验判断定义“黄金客户”
- 构建他们从未可重复衡量的信号,包括为每个账户生成的五级 AI 成熟度评分,并附有理由说明
- 用四个连接器和一次 Salesforce CSV 导出取代跨职能的数据拉取
- 经过四轮迭代,将八个信号缩减为四个评分维度,其中有一个信号最初评分方向错误
1. The definition came before the data
1. 定义先于数据
Kamola started by getting the full account teams and senior leadership to describe what made one or two specific customers feel different from everyone else. Not longest-tenured, not largest.
Kamola 首先让整个客户团队和高级领导层描述是什么让一两个特定客户感觉与众不同。不是合作时间最长,也不是规模最大。
What they landed on: customers who treated Backstory as a core part of their tech stack, built systems around the platform, planned five years out with it at the center, cared about the roadmap and wanted to inform it, and kept finding new use cases to push the product into.
他们得出的结论是:将 Backstory 视为其技术栈核心部分的客户,围绕该平台构建系统,以它为中心制定五年规划,关心路线图并希望参与其中,并不断寻找新的用例来推动产品发展。
Everything else got measured against that definition. Without it you end up scoring accounts against whatever fields happen to be populated in your CRM.
其他一切都以此定义来衡量。没有这个定义,你最终会根据 CRM 中恰好填充的字段来对账户进行评分。
2. Most of the signals that mattered didn’t exist yet
2. 大多数关键信号尚不存在
Stripping the golden customers down produced two sets of characteristics.
将黄金客户的特征分解后,产生了两组特征。
Internal to the customer: go-to-market process maturity, tech stack mix, AI maturity and how fast they were moving up that curve, and whether they ran partner motions.
客户内部特征:市场推广流程成熟度、技术栈组合、AI 成熟度及其提升速度,以及是否开展合作伙伴活动。
Specific to the relationship: deployment velocity, meaning they landed on a small use case and expanded across the stack fast. Executive visibility, meaning Backstory data was being used by executives to make decisions. And total addressable market within the account, plus remaining white space.
关系特定特征:部署速度,即他们从一个小的用例开始,并迅速扩展到整个技术栈;高管可见性,即 Backstory 数据被高管用于决策;以及账户内的总体可寻址市场,加上剩余空白空间。
A lot of that was sitting in silos across various tools. Several of those signals had never been measured repeatably across the full customer base, so the gaps got filled before the analysis started.
其中很多数据分散在各种工具中。有些信号从未在全部客户群中可重复地测量过,因此在分析开始前,这些空白就被填补了。
AI maturity was her example. Backstory had an internal five-level framework covering culture, investment level, technology stack, talent, and willingness to engage on hard problems. Maintaining it meant asking account teams to categorize customers by hand, which she described as grueling.
AI成熟度就是她的例子。Backstory有一个内部五级框架,涵盖文化、投资水平、技术栈、人才以及处理难题的意愿。维护这个框架需要让客户团队手动对客户进行分类,她形容这非常费力。
So they built it as a signal that runs on its own: a prompt executed systematically against every account, pulling specific CRM fields, public company information like AI-forward product launches and new investments, and the account’s full conversation history. Emails, meetings, and Slack, assembled into a chronological record. The output is a maturity level for each account plus the reasoning behind it.
所以他们将其构建为一个自动运行的信号:对每个账户系统性地执行一个提示,提取特定的CRM字段、公开的公司信息(如AI相关的产品发布和新投资),以及账户的完整对话历史。邮件、会议和Slack被整合成按时间顺序的记录。输出是每个账户的成熟度等级以及背后的推理。
They did the same for tech stack mix, where pre-sales scorecards from two or three years ago were badly out of date and the current picture was sitting in conversations nobody had systematically read.
他们对技术栈组合也做了同样的事情,因为两三年前的售前记分卡已经严重过时,而当前的状况存在于没有人系统阅读过的对话中。
3. The cross-functional data pull became four connectors
3. 跨职能数据拉取变成了四个连接器
This is the part that used to consume the quarter. A project owner going to product, BI, finance, and several other functions to collect TAM, health, revenue, renewal rates, delivery risks, feature requests, and adoption levels for every account.
这是过去常常耗费一个季度的部分。项目负责人需要去产品、BI、财务和其他几个职能部门,为每个账户收集TAM、健康状况、收入、续费率、交付风险、功能请求和采用水平。
Kamola didn’t ask anyone. Four connectors covered it:
Kamola没有问任何人。四个连接器就覆盖了这些:
- Amplitude for utilization and usage data
- Atlassian and Jira for years of logged customer feature requests and gaps
- Backstory’s own MCP for the full conversation and engagement history
- Slack, because Backstory runs an internal channel for every single customer, and those channels are where account strategy, next steps, and risks get called out first
- Amplitude用于使用和采用数据
- Atlassian和Jira用于多年的客户功能请求和差距记录
- Backstory自己的MCP用于完整的对话和参与历史
- Slack,因为Backstory为每个客户运行一个内部频道,而这些频道是账户策略、下一步行动和风险最先被提出的地方
The Slack input is the one most teams could copy tomorrow. An account team’s internal dialogue is usually the earliest and most candid read on a customer, and it almost never makes it into any structured system.
Slack输入是大多数团队明天就可以复制的内容。账户团队的内部对话通常是对客户最早、最坦诚的解读,而且几乎从未进入任何结构化系统。
The only manual step in the workflow was exporting the customer list from Salesforce: account name, executive engagement level, predicted account health, the AI maturity signal, upcoming renewal date, and renewal ACV.
工作流程中唯一的手动步骤是从Salesforce导出客户列表:账户名称、高管参与度、预测的账户健康状况、AI成熟度信号、即将到来的续约日期和续约ACV。
4. Order mattered, so the workflow got written down
4. 顺序很重要,所以工作流程被写了下来
The analysis runs as a defined sequence in Claude rather than a single prompt, using Cowork specifically because the steps needed to execute in order.
分析在Claude中作为定义好的序列运行,而不是单个提示,特意使用Cowork是因为步骤需要按顺序执行。
The sequence: ingest and normalize the CSV so accounts match across sources. Start with the conversation history, treated as the primary source of truth for recent engagement, risks raised, and opportunities surfaced. Then utilization data. Then growth potential, combining Salesforce data with public research. Backstory prices per seat off go-to-market headcount, so the size of a customer’s go-to-market org is the TAM indicator, and the gap between that and current seats is the white space. Then the Jira and gap boards. Then a reconciliation step. Then the scoring model.
流程:摄取并规范化CSV,使各来源的账户匹配。从对话历史开始,将其视为近期互动、风险和机会的主要事实来源。然后是使用数据。然后是增长潜力,结合Salesforce数据和公开研究。Backstory按市场团队人数定价,因此客户的市场团队规模是TAM指标,该规模与当前席位之间的差距是空白空间。然后是Jira和差距看板。然后是对账步骤。然后是评分模型。
A full run takes about 20 minutes, sometimes more.
完整运行大约需要20分钟,有时更长。
5. Four iterations, and one signal was scoring backwards
5. 四次迭代,一个信号是评分反向
The version she demoed was not the first one. It took three or four rounds of revalidating how much weight each data point deserved, and she was direct that this is where the human belongs in the workflow.
她演示的版本不是第一个。花了三四轮重新验证每个数据点应得的权重,她直言这是人在工作流中的位置。
Two things came out of that iteration.
那次迭代产生了两个结果。
She started with about eight signals and ended at four scoring buckets: growth potential in the account, AI maturity and the velocity of AI change inside it, engagement level (both the customer’s perception of Backstory and who they were engaged with at what seniority), and current account health. Too many signals produced contradictions between signals, and the narrative got lost.
她开始时大约有八个信号,最终归结为四个评分桶:账户增长潜力、AI成熟度及其内部AI变化速度、参与度(客户对Backstory的看法以及他们与谁在什么级别互动),以及当前账户健康状况。信号太多导致信号之间产生矛盾,叙事丢失了。
The more useful finding came out of reconciling adoption against feature requests. The first version treated a high volume of feature requests as negative, docking points on engagement and health on the assumption that a customer asking for a lot is a customer who isn’t happy. The data said the opposite. Their highest-adopting customers correlated strongly with feature request volume, and deep adoption plus a stream of AI-forward requests turned out to be a positive signal.
更有用的发现来自将采用与功能请求进行对账。第一个版本将大量功能请求视为负面,扣减参与度和健康分,假设要求多的客户是不满意的客户。数据表明相反。他们采用率最高的客户与功能请求量强相关,深度采用加上一系列AI前瞻性请求被证明是积极信号。
An error like that survives indefinitely in a hand-built scoring model, because nobody ever runs the model across the full base and checks who ended up where.
这样的错误在手工构建的评分模型中会无限期存在,因为没有人会在整个客户群上运行模型并检查谁最终处于什么位置。
6. Tier D customers are where the value is
6. D级客户是价值所在
The output was four tiers.
输出是四个层级。
- Tier A: 8 accounts. Customers they believe can grow more than 10x in two to three years, scoring high across all four categories.
- Tier B: 21 accounts. Same 10x potential on a longer time horizon, with a separate playbook.
- Tier C. Accounts at a genuine juncture. They either come to see Backstory as core to their stack, or they don’t mature fast enough to keep up with where Backstory is going and drop.
- Tier D. The customers where the honest conclusion was that they may not be with the company in a couple of years, either because Backstory has evolved and they haven’t, or because the gaps have been insurmountable for years. The decision there is whether to cut losses and service them differently.
- A级:8个账户。他们认为在2-3年内可以增长超过10倍的客户,在所有四个类别中得分都很高。
- B级:21个账户。在更长的时间范围内具有相同的10倍潜力,并有单独的剧本。
- C级:处于真正关键时刻的账户。他们要么将Backstory视为其技术栈的核心,要么成熟速度不够快,无法跟上Backstory的发展方向而流失。
- D 级客户。对于这些客户,诚实的结论是,他们可能几年后就不会再与公司合作了,要么是因为 Backstory 已经发展而他们没有跟上,要么是因为差距多年来一直无法弥合。这里的决定是是否要减少损失并以不同的方式为他们服务。
Plenty of tiering projects produce an A list and stop there. Kamola named the value of the bottom directly: it forced the company to look at real data and decide whether those customers were ones they believed would grow and stay.
许多分级项目只生成一个 A 级名单就停止了。Kamola 直接指出了底层客户的价值:它迫使公司审视真实数据,并决定这些客户是否是他们认为会成长并留下来的客户。
更进一步:量化金融体系
看懂新闻只是起点——沿量化金融路径,把它变成能交付的工程能力