Google Research提出ME-POIs:将人类移动数据融入地点嵌入
Google Research Introduces ME-POIs: A Mobility-Informed Framework that Adds “How a Place Is Used” to Text-Based POI Embeddings
A team from Google Research and USC has released Mobility-Embedded POIs (ME-POIs), a framework that folds aggregate human movement into text-based place embeddings. The premise is that language models describe what a place is, but not how it is used. Two coffee shops can share a category, an address block, and a text vector, while one runs commuter turnover and the other holds customers for ninety minutes. ME-POIs encodes each visit as a contextualized vector, then uses contrastive learning to align those visits with one learnable prototype per POI. Across five map-enrichment tasks on Los Angeles and Houston mobility data, adding ME-POIs to strong text encoders improved 34 of 35 model-task pairings in Los Angeles, with relative gains up to 81.9% F1 on visit intent and a 24.7% MAE reduction on busyness. Notably, a variant trained on mobility alone beat Gemini embeddings on price-level classification.
Google Research 和南加州大学(USC)的一个团队发布了 Mobility-Embedded POIs(ME-POIs),这是一个将聚合的人类移动数据融入基于文本的场所嵌入的框架。其前提是,语言模型描述的是场所是什么,而不是它如何被使用。两家咖啡店可能共享相同的类别、地址区块和文本向量,但一家是通勤者频繁周转,另一家则能让顾客停留九十分钟。ME-POIs 将每次访问编码为上下文相关的向量,然后使用对比学习将这些访问与每个 POI 对应的一个可学习原型进行对齐。在洛杉矶和休斯顿移动数据的五个地图增强任务中,将 ME-POIs 添加到强大的文本编码器后,在洛杉矶的 35 个模型-任务配对中有 34 个得到了提升,访问意图的 F1 值相对提升高达 81.9%,繁忙程度的 MAE 降低了 24.7%。值得注意的是,仅使用移动数据训练的变体在价格等级分类上击败了 Gemini 嵌入。
Is it deployable?
它可以部署吗?
Partially, it is a framework you rebuild, not a checkpoint you download. As of publication, Google Research has released the paper but no public code or weights. The compute bar is low: the model is ~53.7M parameters and was pretrained on a single NVIDIA Tesla V100 16GB. The real gate is data — you need licensed foot-traffic or first-party visit logs plus POI polygons.
部分可以,它是一个你需要重新构建的框架,而不是一个你可以下载的预训练检查点。截至发表时,Google Research 已发布论文,但未公开代码或权重。计算门槛较低:该模型约有 53.7M 参数,并在单块 NVIDIA Tesla V100 16GB 上进行过预训练。真正的瓶颈在于数据——你需要获得许可的人流数据或第一方访问日志,以及 POI 的多边形数据。
How the framework works
框架的工作原理
Each visit is a triple: coordinates, arrival time and departure time. Three factorized encoders handle them: Space2Vec for multi-scale location, and two Time2Vec encoders for arrival and departure separately, so start time and dwell duration stay distinguishable. The concatenated vectors get sinusoidal positional encoding and pass through a 4-layer, 8-head Transformer (d_h = 512) to produce contextualized visit embeddings.
每次访问都是一个三元组:坐标、到达时间和离开时间。三个分解编码器分别处理这些数据:Space2Vec 用于多尺度位置,两个 Time2Vec 编码器分别用于到达和离开时间,以便起始时间和停留时长保持可区分。拼接后的向量经过正弦位置编码,然后通过一个 4 层、8 头 Transformer(d_h = 512)生成上下文相关的访问嵌入。
The core objective is contrastive. Every POI owns a learnable prototype, and an InfoNCE loss pulls each visit embedding toward its own POI’s prototype while pushing away the other POIs in the minibatch. The prototype becomes a functional centroid that averages out individual user schedules.
核心目标是基于对比学习。每个 POI 拥有一个可学习的原型,InfoNCE 损失函数将每次访问的嵌入拉向其所属 POI 的原型,同时推开小批量中的其他 POI 原型。该原型成为一个功能性的质心,对个体用户日程进行平均化处理。
Sparsity is the hard part. Only 9.07% of Los Angeles POIs and 7.04% of Houston POIs cleared the anchor threshold (100 and 50 total visits respectively). For the long tail, ME-POIs computes normalized Gaussian kernels at three bandwidths — 0.3 km, 1.0 km, 3.0 km — and transfers anchor visit histograms to sparse POIs, then adds a KL term forcing the sparse embedding to predict that prior. A second KL term supervises anchors against their own empirical distributions. A fourth loss maximizes cosine similarity with projected text embeddings, whose prompts follow the GeoLLM recipe: coordinates, category, address, and the ten nearest POIs with distance and direction.
稀疏性是难点。洛杉矶仅有 9.07% 的 POI 和休斯顿仅有 7.04% 的 POI 达到了锚点阈值(分别需要 100 次和 50 次总访问)。对于长尾部分,ME-POIs 在三个带宽(0.3 公里、1.0 公里、3.0 公里)下计算归一化高斯核,并将锚点访问直方图迁移到稀疏 POI,然后添加一个 KL 散度项,强制稀疏嵌入预测该先验分布。第二个 KL 散度项监督锚点与其自身的经验分布。第四个损失函数最大化与投影文本嵌入的余弦相似度,其提示遵循 GeoLLM 配方:坐标、类别、地址以及距离和方向最近的十个 POI。
What the numbers say
数据说明了什么
Evaluation covers two anonymized mobility datasets — Los Angeles (39,557 POIs, 6.9M visits, full-year 2019) and Houston (28,419 POIs, 715,604 visits, 20 days in March 2020) — across five map-enrichment tasks with frozen-embedding probing. Labels come from SafeGraph for opening hours and closures, and Google Maps for visit intent, busyness, and price level.
评估涵盖两个匿名移动数据集——洛杉矶(39,557 个 POI,690 万次访问,2019 年全年)和休斯顿(28,419 个 POI,715,604 次访问,2020 年 3 月的 20 天)——在五个地图增强任务中进行冻结嵌入探测。标签来自 SafeGraph 的营业时间和闭店信息,以及 Google Maps 的访问意图、繁忙程度和价格水平。
Adding ME-POIs improved 34 of 35 model-task pairings in Los Angeles. Peak relative gains: 16.2% F1 on weekly opening hours (OpenAI-large), 81.9% F1 on visit intent (Gemini), 6.5% F1 on permanent closure (E5), and a 24.7% MAE reduction on busyness (Gemini). In Houston, price-level F1 rose 75.1% for GTR-T5. The single regression was Gemini on permanent closure, down 0.4%.
加入 ME-POIs 后,洛杉矶有 34 对模型-任务组合得到提升。相对增益峰值:OpenAI-large 的每周营业时间 F1 值提升 16.2%,Gemini 的访问意图 F1 值提升 81.9%,E5 的永久闭店 F1 值提升 6.5%,Gemini 的繁忙程度 MAE 降低 24.7%。在休斯顿,GTR-T5 的价格水平 F1 值提升了 75.1%。唯一的回归任务是 Gemini 预测永久闭店,下降了 0.4%。
The more interesting result is the mobility-only variant. Trained with no text alignment at all, it reaches 0.600 accuracy on Los Angeles price level against Gemini’s 0.559 — collective behavior outperforming the words used to label the place. It also beats every trajectory-based baseline on every task.
更有趣的结果是仅基于移动数据的变体。在未进行任何文本对齐的情况下训练,它在洛杉矶价格水平分类上达到 0.600 的准确率,优于 Gemini 的 0.559——集体行为的表现超过了用于标记地点的文本。它还在所有任务上击败了所有基于轨迹的基线方法。
Explainer: the mechanism, step by step
原理解析:逐步机制
Key Takeaways
关键要点
- ME-POIs learns one context-independent vector per POI, not a trajectory-conditioned one.
- Contrastive alignment plus multi-scale KL transfer fixes the long tail: 91% of LA POIs are sparse.
- Gains reach 81.9% F1 on visit intent and 24.7% MAE reduction on busyness.
- Mobility-only embeddings beat Gemini text embeddings on price-level classification.
- No public code or weights yet; licensed visit data is the real barrier, not compute.
- ME-POIs 为每个 POI 学习一个上下文无关的向量,而非轨迹条件向量。
- 对比对齐加上多尺度 KL 迁移解决了长尾问题:洛杉矶 91% 的 POI 属于稀疏类别。
- 收益包括访问意图 F1 值提升 81.9%,以及繁忙程度 MAE 降低 24.7%。
- 仅基于移动数据的嵌入在价格水平分类上优于 Gemini 文本嵌入。
- 目前尚无公开代码或权重;受许可限制的访问数据才是真正的障碍,而非算力。
Check out the Paper and Technical details. Feel free to check out our GitHub Page for Tutorials, Codes and Notebooks.
请查阅论文和技术细节。欢迎查看我们的 GitHub 页面以获取教程、代码和笔记本。
Also, feel free to follow us on Twitter and don’t forget to join our 150k+ML SubReddit and Subscribe to our Newsletter. Wait! are you on telegram? now you can join us on telegram as well.
此外,欢迎在 Twitter 上关注我们,别忘了加入我们拥有超过 15 万成员的 ML SubReddit 并订阅我们的新闻通讯。等等!你在 Telegram 上吗?现在你也可以在 Telegram 上加入我们。
Need to partner with us for promoting your GitHub Repo OR Hugging Face Page OR Product Release OR Webinar etc.? Connect with us
需要与我们合作推广你的 GitHub 仓库、Hugging Face 页面、产品发布或网络研讨会等?请联系我们
The post Google Research Introduces ME-POIs: A Mobility-Informed Framework that Adds “How a Place Is Used” to Text-Based POI Embeddings appeared first on MarkTechPost.
本文最初发布于 MarkTechPost:Google Research 推出 ME-POIs:一种将“场所用途”融入基于文本的 POI 嵌入的移动感知框架
更进一步:量化金融体系
看懂新闻只是起点——沿量化金融路径,把它变成能交付的工程能力