Coding tokens是基础设施,AI Gateway提供细粒度预算管控
Coding tokens are basically infrastructure. Yet, the way companies have approach…
Coding tokens are basically infrastructure. Yet, the way companies have approached them amounts to:
编码令牌本质上是基础设施。然而,各公司对待它们的方式却相当于:
"Hey all, here's an AWS key. It can spin up anything from a 𝚝𝟹.𝚗𝚊𝚗𝚘 ($𝟹.𝟾𝟶/𝚖𝚘) to an 𝚙𝟻.𝟺𝟾𝚡𝚕𝚊𝚛𝚐𝚎 ($𝟺𝟶𝚔/𝚖𝚘). Go wild"
“大家好,这是一把 AWS 密钥。它既能启动 𝚝𝟹.𝚗𝚊𝚗𝚘(每月$𝟹.𝟾𝟶)这样的小型实例,也能启动 𝚙𝟻.𝟺𝟾𝚡𝚕𝚊𝚛𝚐𝚎(每月$𝟺𝟶𝚔)这样的大型实例。随便用吧。”
And obviously the reason companies don't do this for their core infra is that you need to govern, optimize, and observe usage and costs.
显然,公司不会对其核心基础设施采取这种做法,是因为你需要对使用情况和成本进行治理、优化和监控。
The intern might decide to host a static website in that 192 vCPU machine, and you won't be very happy about the bill.
实习生可能会决定在那台拥有 192 个 vCPU 的机器上托管一个静态网站,到时候账单会让你非常头疼。
AI Gateway fixes this for all your tokens, with per-key, and now per-user budgets.
AI Gateway 通过为每个密钥以及现在为每个用户设置预算,解决了所有令牌的这一问题。
更进一步:量化金融体系
看懂新闻只是起点——沿量化金融路径,把它变成能交付的工程能力