Bonsai 27B多模态模型可在手机上本地运行
Huge if true!
Huge if true!
We are talking about a 27B multimodal model that runs locally on a phone. That's wild!
Bonsai 27B reaches up to 163 tok/s in 1-bit and 134 tok/s in Ternary on an NVIDIA GeForce RTX 5090.
On an M5 Max, it reaches up to 87 tok/s in 1-bit and 58 tok/s in Ternary.
更进一步：量化金融体系
看懂新闻只是起点——沿量化金融路径，把它变成能交付的工程能力