跳到主内容
@wquguru
精选75Cloudflare 博客(RSS)产品发布/更新

Cloudflare 推出自适应智能引擎,重构 Bot 防御经济学

Introducing Adaptive Intelligence: undermining the economics of every bot attack

原文
发到 X

Modern bot threats are increasingly driven by determined, sophisticated attackers. Often it is not even one person, but a group trading techniques with each other or a commercial service sold to anyone willing to pay. For many of them, getting past bot detection is a full-time job they genuinely enjoy. Block them and they get to work, finding a workaround. AI has simplified this further, making it even easier to set up complex configurations for attackers, lowering the overhead of an attack.

现代机器人威胁日益由坚定且技术高超的攻击者驱动。通常,这甚至不是一个人,而是一个互相交流技术的团体,或是一项向任何愿意付费的人出售的商业服务。对许多人来说,绕过机器人检测是一份他们真正享受的全职工作。一旦遭到拦截,他们就会着手寻找变通方法。AI 进一步简化了这一过程,使得为攻击者设置复杂配置变得更加容易,从而降低了攻击的开销。

This shift puts defenders at an economic disadvantage. Responding and adapting to new attacks takes care, evidence, and effort to ensure efforts to block attackers don’t impact real users on the way. Attackers have no such concerns and are primarily constrained by their time and their pool of proxies, and ensuring their infrastructure providers don’t shut down their accounts.

这种转变使防御方在经济上处于劣势。应对和适应新攻击需要谨慎、证据和努力,以确保在阻止攻击者的过程中不会影响真实用户。攻击者没有这样的顾虑,主要受限于他们的时间和代理池,并确保其基础设施提供商不会关闭他们的账户。

Their advantage is the cost of adaptation. Attackers can adapt as often and continuously as they need, while most defenses are deployed in discrete, managed releases. Cloudflare analyzes more than a trillion requests a day for signs of automated abuse, so we see how fast attackers change tactics. That gap in responsiveness is widening.

他们的优势在于适应成本。攻击者可以根据需要频繁且持续地进行适应,而大多数防御措施是以离散的、经过管理的版本部署的。Cloudflare 每天分析超过一万亿次请求以查找自动化滥用的迹象,因此我们能看到攻击者改变策略的速度有多快。这种响应速度的差距正在扩大。

The inconvenient truth: bot detection across the industry often rests on a hopeful assumption that if you make the wall tall enough, attackers stay out. In reality, a determined attack always finds a way through. The question is not whether a determined attacker can get through. They will. The question is what happens when they do.

一个不便的事实是:行业内的机器人检测往往基于一种乐观的假设,即如果你把墙筑得足够高,攻击者就会被挡在外面。事实上,坚定的攻击总能找到突破口。问题不在于坚定的攻击者能否突破防线,而是他们突破后会发生什么。

Today we are launching Adaptive Intelligence, a new bot detection engine that starts from the opposite idea. Rather than betting on a wall that keeps every attacker out, Adaptive Intelligence makes getting through so slow and costly that the attack stops being worth running.

今天,我们推出自适应智能(Adaptive Intelligence),这是一种全新的机器人检测引擎,它从相反的理念出发。与其押注于一道能阻挡所有攻击者的墙,自适应智能让突破变得如此缓慢和高昂,以至于攻击不再值得进行。

We believe that no other bot detection works this way.

我们相信,没有其他机器人检测系统以这种方式运作。

One attacker, many disguises

一名攻击者,多种伪装

Not every attack is obvious to spot. The most sophisticated ones are built to disappear into ordinary traffic.

并非所有攻击都显而易见。最复杂的攻击旨在融入普通流量中消失不见。

An attacker can spread requests across a large residential proxy network, keep the rate from each address low, and move patiently through a login, checkout, or account-recovery flow. Every request comes from a different address, often with a fresh user agent or a new bot fingerprint, so each one looks like a new visitor. No single source ever crosses a rate limit.

攻击者可以将请求分散到庞大的住宅代理网络中,保持每个地址的请求速率较低,并耐心地通过登录、结账或账户恢复流程。每个请求都来自不同的地址,通常带有新的用户代理或新的机器人指纹,因此每个请求看起来都像是一个新访客。没有任何单一来源会超出速率限制。

This is what makes the shape so hard to stop. Tighten the thresholds too far and real customers are turned away, which is the outcome you are trying hardest to avoid. The attack lives in the space between one request and the next, and a defense that studies each request on its own will never see it.

这正是该形态难以阻止的原因。如果将阈值设置得过于严格,就会误伤真实客户,而这正是你最极力避免的结果。攻击存在于请求与请求之间的空隙中,而仅对每个请求单独进行分析的防御机制永远无法发现它。

The flaw of deterministic detection

确定性检测的缺陷

The challenge with rule-based systems is that they hand the attacker a stationary target. They iterate in days while the model waits months for its next update, so by the time it catches up, the tooling has already moved on.

基于规则的系统的挑战在于,它们为攻击者提供了一个固定的目标。规则以天为单位进行迭代,而模型则需要等待数月才能进行下一次更新,因此当模型追上进度时,工具链早已向前发展。

Bot detection has always answered a new attack technique by writing a rule to catch it. That works, until the attacker studies the signal, learns how to circumvent it, and forces another rule to be written. Some of the most advanced attackers have even created tooling to semi-automate this process. The defender appears permanently disadvantaged.

机器人检测总是通过编写规则来应对新的攻击技术。这在初期是有效的,直到攻击者研究该信号、学习如何绕过它,并迫使编写另一条规则为止。一些最先进的攻击者甚至创建了半自动化工具来实现这一过程。防御者似乎始终处于劣势。

This kind of detection is “deterministic”, meaning that the same input always produces the same output. A defense that never changes teaches the attacker how to beat it and indirectly drives bot operators to build more capable automated attacks. Against a deterministic defense, automated probes return a clean yes or no, and over enough attempts that feedback teaches an attacker exactly where the edges of the system are. The economics are in the attacker’s favor.

这种检测方式是“确定性的”,意味着相同的输入总是产生相同的输出。一成不变的防御教会了攻击者如何击败它,并间接促使机器人操作者构建更强大的自动化攻击。面对确定性防御,自动化探测会返回明确的“是”或“否”,经过足够多次尝试后,反馈会让攻击者精确掌握系统的边界。经济利益站在攻击者一边。

Changing the economics of attack

改变攻击的经济性

Adaptive Intelligence aims to reverse the economics and put them back in the defender's favor.

Adaptive Intelligence 旨在扭转这种经济性,使其重新有利于防御方。

A defense that keeps changing flips that calculation, but only if two things are true at once. First, it has to cost the defender less to react than it costs the attacker to work around it. Second, attackers must be starved of the feedback they use to adapt, so they cannot simply learn their way back in. Get both right and the attacker's own loop turns against them: nothing they learned stays true, and each new attempt costs more than the last, until the attack is no longer worth running.

不断变化的防御翻转了这一计算,但前提是必须同时满足两个条件。首先,防御者做出反应的成本必须低于攻击者绕过它的成本。其次,必须切断攻击者用于适应的反馈,使他们无法简单地通过学习重新入侵。如果两者都做到位,攻击者自身的循环就会反噬他们:之前学到的经验不再适用,且每次新尝试的成本都比上一次更高,直到攻击变得不再值得执行。

Part of that is giving an attacker less to learn from. Adaptive Intelligence can recognize a bot from a signal without visibly reacting to it, so the attacker keeps relying on a tell they do not realize we can see. And it treats detection as a statistical judgment rather than a fixed rule. That makes it non-deterministic. It weighs many signals at once, so there is no single piece of logic for an attacker to isolate and beat.

这部分涉及让攻击者能利用的信息更少。Adaptive Intelligence 能够从信号中识别出机器人,而无需做出可见的反应,因此攻击者会继续依赖那些他们未意识到我们已能察觉的特征。此外,它将检测视为统计判断而非固定规则。这使得检测具有非确定性。它同时权衡多种信号,因此不存在单一逻辑供攻击者隔离并加以突破。

A new detection engine

全新的检测引擎

Your bot score already comes from several detection methods working together: machine learning, behavioral validation, JavaScript fingerprinting, a library of heuristics, and checks that recognize known, verified bots like search crawlers.

您的机器人评分已经来自多种检测方法的协同工作:机器学习、行为验证、JavaScript 指纹识别、启发式规则库,以及能够识别已知且经过验证的机器人(如搜索爬虫)的检查机制。

Adaptive Intelligence is a brand new bot detection engine that sits behind bot score. Where every other system is built to keep attackers out by accumulating rules, Adaptive Intelligence is built with the assumption that attackers will eventually get in, and makes that attempt as costly as possible.

Adaptive Intelligence 是一个全新的机器人检测引擎,位于机器人评分之后。其他系统旨在通过积累规则来阻止攻击者,而 Adaptive Intelligence 则基于攻击者最终会突破防线的假设构建,并尽可能提高其尝试的成本。

Below, we explain three components our Adaptive Intelligence detection engine will have, that are unique when compared to traditional models: improving itself, disposable rule generation, and learning from the traffic it protects. Launching today is its first component: the machine learning at the center of your bot score, now retraining continuously instead of shipping as a fixed version. It aggregates network signals from across Cloudflare's network and measures the probability of automated abuse for every request. Where a fixed model sits still, Adaptive Intelligence keeps moving. The second and third components explained below are soon to follow.

下文我们将解释 Adaptive Intelligence 检测引擎的三个组成部分,这些部分与传统模型相比具有独特性:自我改进、一次性规则生成以及从其保护的流量中学习。今天发布的是其第一个组成部分:作为您机器人评分核心的机器学习,现在改为持续重新训练,而不是以固定版本发布。它聚合来自 Cloudflare 整个网络的信号,并衡量每个请求发生自动化滥用的概率。固定模型静止不动,而 Adaptive Intelligence 不断演进。下文解释的第二和第三个组成部分即将推出。

1. Improving itself

1. 自我改进

The engine retrains continuously on live traffic. As new bypass tools and bot frameworks appear, it learns from them and folds that knowledge into the model behind your bot score, without waiting for a scheduled release. A technique that shows up this week is one the engine can recognize this week. The score you already build on stays close to what attackers are actually doing, rather than drifting further from reality between updates.

该引擎在实时流量上持续进行重新训练。随着新的绕过工具和机器人框架的出现,它会从中学习并将这些知识融入支撑您机器人评分的模型中,无需等待预定版本的发布。本周出现的技术,该引擎也能在本周识别。您已有的评分始终贴近攻击者的实际行为,而不是在更新之间与现实脱节越来越远。

2. Disposable rule generation

2. 一次性规则生成

A disposable rule is a rule that we expect the attacker to adapt to, but doesn’t improve the attacker's bot in the process. Adaptive Intelligence is designed to create disposable rules aimed at a specific attack, deploy and retire them at random intervals, and never leave them in place long enough to become a fixed target. Because the rules keep appearing and vanishing, they inject noise into the very signal an attacker relies on to train against us, so an attacker never gets the steady yes-or-no that a static defense leaks. No single rule has to be perfect or unbeatable. It only has to last long enough to do its job, then make way for the next one. By the time an attacker has reverse-engineered a specific pattern, the engine has already moved on, rendering their engineering effort worthless.

一次性规则是我们预期攻击者会适应的规则,但在此过程中并不会提升攻击者机器人的能力。Adaptive Intelligence 旨在创建针对特定攻击的一次性规则,以随机间隔部署并退役它们,且从不让它们停留足够长的时间成为固定目标。由于规则不断出现又消失,它们在攻击者依赖的训练信号中注入了噪声,使得攻击者无法获得静态防御所泄露的那种稳定的“是”或“否”的答案。单个规则无需完美或不可战胜。它只需存在足够长的时间以完成其任务,然后为下一个规则让路即可。当攻击者逆向工程出特定模式时,引擎早已转向,使其工程努力变得毫无价值。

3. Learning from the traffic it protects

3. 从其所保护的流量中学习

Adaptive Intelligence will also learn from the patterns it sees across millions of sites. When a customer flags a real visitor we scored incorrectly, or our own measurement catches a miss, that correction becomes a training signal. Over time the engine tunes to the problems Cloudflare's customers are actually facing, so the protection you get reflects the current threat landscape instead of a snapshot of an older one.

自适应智能(Adaptive Intelligence)还将学习其在数百万个网站中观察到的模式。当客户标记出我们评分错误的真实访客,或我们的内部测量发现漏报时,这些纠正措施将成为训练信号。随着时间的推移,引擎将针对 Cloudflare 客户实际面临的问题进行调优,因此您获得的防护将反映当前的威胁态势,而非旧有威胁的快照。

How it works

工作原理

更进一步:量化金融体系

看懂新闻只是起点——沿量化金融路径,把它变成能交付的工程能力

进入量化体系 →

相似阅读

另一事件,读法相近