Harvey发布Tenet:基于Kimi K3微调的法律Agent模型
Harvey Introduces Harvey Tenet: A Kimi K3 Base Post-Trained with Fireworks for Long-Horizon Legal Agent Work
Harvey has released Harvey Tenet, its first post-trained model, as a research preview as of today. Tenet is a Kimi K3 base post-trained with Fireworks through asynchronous reinforcement learning on long-horizon legal work. The training corpus combined synthetic data, publicly available legal data, and human expert data. Harvey states no customer data was used. Against the base K3 model, Tenet completes almost twice as many held-out tasks on Harvey’s Legal Agent Benchmark (LAB) and 20% more on LAB: Contracts, raising all-pass rate by 9 and 2 percentage points respectively. Harvey reports state-of-the-art on LAB: Contracts and second place on LAB. The gains also transferred, untrained, to Mercor’s APEX Agents and Crosby’s Redline Bench. The stated goal is twofold: build frontier legal intelligence on open-weight models, and give law firms a path to own their own specialized models.
Is it deployable?
Not yet, Harvey Tenet is a research preview announced on August 20, 2026. Harvey has not published weights, a model card, or an API endpoint. The base model is open-weight; Tenet itself is Harvey’s own checkpoint, and the company says the work will move “from research to production” inside Harvey’s products over time. What ships today is the recipe, not the artifact.
- Company tier: Enterprise only. Access runs through Harvey’s platform, which is sold to law firms, mid-sized firms, and in-house legal teams. A lab with an RL stack could reproduce the method; training used roughly 150 NVIDIA B300 GPUs over two months.
- Industries: Legal services, corporate in-house legal, private equity and investment banking (M&A diligence), plus regulated sectors where contract volume drives cost — insurance, financial services, healthcare, energy.
- Applications: M&A due diligence memos over datarooms, contract drafting, review and redlining, structured extraction across up to 10,000 documents, and precedent search over a firm’s accumulated knowledge.
What the numbers say
Against the base K3 model, Tenet completes almost twice as many held-out tasks on Harvey’s Legal Agent Benchmark (LAB) and 20% more on LAB: Contracts, lifting all-pass rate by 9 and 2 percentage points respectively. Harvey reports state-of-the-art on LAB: Contracts and second place on LAB, using base-model scores from Vals.
The more interesting result is transfer. Tenet also improves substantially on Mercor’s APEX Agents (corporate law) and Crosby’s Redline Bench — neither seen during training — while holding performance on knowledge benchmarks including LegalBench, CUAD, MAUD, and Scale’s PRBench. Agentic training did not erode textbook legal reasoning.
Cost is co-optimized rather than traded away. Open weights lower price per token; reward shaping that prefers shorter trajectories at equal quality lowers tokens consumed. Harvey reports significant quality gains at stable cost.
How it was trained
Training used asynchronous reinforcement learning in sandboxed legal environments built like LAB tasks: a partner-style instruction averaging about 50 words, a client matter of key and peripheral documents, and an expert rubric of atomic pass/fail criteria — roughly 50 per task, hundreds at the extreme. A single rollout can exceed 1,000 turns.
Rollouts are graded by LLM-as-a-judge; ablations settled on Kimi 2.6. Reward combines the fraction of rubric criteria satisfied, a holistic count of legal issues solved, and an all-pass bonus. The policy is optimized with GSPO using a rank-64 LoRA over the full K3 network, eight task groups of eight rollouts per optimizer step, across ~1,750 environments and >10,000 rollouts per epoch. Fireworks co-built trainer and rollout deployments at the kernel level, with token-in-token-out and router replay, to keep a large MoE numerically aligned across training and inference.
Three capabilities trained separately
Harvey team also post-trained specialist models that Tenet can route to as tools or sub-agents:
- M&A diligence: On LAB: Diligence, a single task can traverse up to 80M tokens; no baseline passed more than 43.8% of criteria. With Baseten, Harvey moved to a Recursive Language Model harness where a root agent holds the dataroom in a REPL and delegates to sub-agents. A GLM-5.2 orchestrator alone reached 46.1%; post-training it in that harness via self-distillation reached 60.1%.
- Review Table: With Applied Compute, a post-trained GLM-5.2 improved answer quality by 3.6 points and citation quality by 12.1 points at roughly one-tenth the cost per cell, learning to abstain when a question does not apply.
- Firm knowledge: With Engram, a Qwen3.8-27B model studies ~100M tokens of client matters into 1M tokens of structured knowledge plus parametric memory. Criteria pass rate rose more than 15%, tokens in completed trajectories fell 58%, and cost per query dropped roughly 90% — 190.8 intelligence-per-token versus 129.3 for the best frontier configuration.
Marktechpost Independent Test Facts
Reality Check
Harvey Tenet — benchmark claims, verified
Audited: Harvey research preview, Aug 20, 2026 · and the Harvey X thread · Mode: default
78Inflation score
19Claims
1Verified
10Self-reported
6Flagged
2Unverifiable
Nothing Harvey published was contradicted. The score is high because Tenet appears on no public leaderboard — not Vals, not Artificial Analysis, not Mercor. Score formula: (8 × 6 flags) + (15 × 0 contradicted) + (3 × 10 self-reported) = 78.
Claim table
| Claim | Number | Independent check | Verdict |
|---|---|---|---|
| Completes ~2× more LAB held-out tasks than Kimi K3 base | ≈ 2× | Not on any public board | Self-reported |
| LAB all-pass rate lift | +9 pts | Same result stated as “+82%” on X | Flag F1 |
| LAB: Contracts all-pass lift | +2 pts | No public leaderboard exists | Self-reported |
| State-of-the-art on LAB: Contracts | SOTA | Benchmark owned, run and graded by Harvey | Flag F2 |
| Places second on LAB | #2 | Vals #1 is Muse Spark 1.1 at 20.00%; Harvey-run, tool delta never quantified | Flag F3 |
| Kimi K3 base on APEX Agents, corporate law | 58.8% | 58.8% (Kimi K3 Max) — matches exactly | Verified |
| Tenet substantially beats K3 base on APEX Agents | — | Harvey harness alone: 58.8% → 67.5% | Flag F4 |
| Beats K3 base on Crosby Redline Bench | Not given | Absent from the public leaderboard | Self-reported |
| APEX v1 Big Law Associate held — a knowledge benchmark, not the agentic board | Not given | Blind run commissioned from Mercor; not posted to the public v1 board | Self-reported |
| Holds on LegalBench, CUAD, MAUD | “strong” | Non-canonical metrics, applied to all models | Self-reported |
| PRBench hard subset | 36.0 → 36.8% | Harvey calls it not statistically significant | Self-reported |
| LAB: Diligence criteria pass rate | 43.8 → 60.1% | No public leaderboard | Self-reported |
| Review Table cost per cell | ≈ 1/10 | Baseline model never named | Flag F6 |
| Firm Knowledge intelligence-per-token | 190.8 | Engram write-up; metric is Harvey’s own | Self-reported |
| “Our first post-trained open-weight model” | — | Business Insider: proprietary, in-house | Flag F5 |
| “Less than a fourth the cost of leading foundation models” | < 25% | X only; comparators unnamed | Flag F7 |
| ≈150 NVIDIA B300 GPUs, 2 months, GSPO + rank-64 LoRA | — | Unverifiable by construction | Not checkable |
| No customer data used in post-training | — | Unverifiable by construction | Not checkable |
Flags explained
F1 · Denominator gameThe blog reports +9 and +2 percentage points. The X thread reports the same result as +82% and +22%. Both true; the social number sounds nine times larger.
F2 · Self-report as fact“SOTA on LAB: Contracts” is a win on Harvey’s own benchmark. Harvey states there is no public leaderboard for it and that all scores are internal Harvey runs. LAB launched deliberately without a leaderboard.
更进一步:量化金融体系
看懂新闻只是起点——沿量化金融路径,把它变成能交付的工程能力