Gary Marcus：AI行业自律不足，特朗普与科技巨头会面聚焦超级智能
Self-regulation 'not enough' for AI safety, Gary Marcus says
AMNA: WELCOME TO THE NEWS HOUR. TOP EXECUTIVES OF THE LEADING TECH COMPANIES IN THE U.S. MET WITH PRESIDENT DONALD TRUMP TODAY TO DISCUSS THE FUTURE OF ARTIFICIAL INTELLIGENCE -- AMIDST GROWING CONCERNS OVER AI MODELS LOSING CONTROL. GEOFF: THE MEETING CAME AFTER THE PRESIDENT UNVEILED A NEW AI-POWERED WEBSITE DESIGNED TO HELP AMERICANS NAVIGATE GOVERNMENT SERVICES. THE PRESIDENT IS ALSO PUSHING A NEW NAME FOR ARTIFICIAL INTELLIGENCE -- SUPERINTELLIGENCE -- AS HE ARGUES THE TECHNOLOGY IS TRANSFORMING THE ECONOMY AND THAT THE U.S.
AMNA：欢迎收看新闻时刻。美国领先科技公司的首席执行官们今天与唐纳德·特朗普总统会面，讨论人工智能的未来——随着人们对AI模型失控的担忧日益加剧。GEOFF：此次会议是在总统推出一个全新的AI驱动网站之后举行的，该网站旨在帮助美国人使用政府服务。总统还在推动将人工智能命名为“超级智能”（Superintelligence）——他认为这项技术正在改变经济，而且美国
CANNOT AFFORD TO LOSE ITS LEAD OVER CHINA. PRES. TRUMP: THIS IS ONE MORE EXAMPLE OF WHY I WILL NEVER STIFLE THE GROWTH OF TECHNOLOGY THAT WILL BE BIGGER THAN THE INDUSTRIAL REVOLUTION. PRESIDENT XI KNOWS THAT. WE'RE LEADING BY A LOT. AND WE DON'T WANT TO MIX IT UP TOO MUCH EITHER, YOU KNOW. SOMEBODY SAID, OH, LET'S DO A JOINT VENTURE. LET'S WORK TOGETHER WITH CHINA, BUT IF WE DO THAT, WE'RE GOING TO BE GIVING A LOT OF SECRETS THAT THAT WE HAVE THAT THEY JUST WOULD WANT TO HAVE OR ANYBODY ELSE.
无法承受失去对中国的领先地位。特朗普总统：这是又一个证明我永远不会扼杀那些规模将超越工业革命的新技术发展的例子。习主席深知这一点。我们遥遥领先。我们也不想把局面搞得太复杂，你知道的。有人说，哦，让我们搞合资企业吧。让我们与中国合作，但如果我们这样做，我们就会把我们拥有的许多秘密泄露给他们，或者任何其他人。
AND FRANKLY THERE IS NOBODY IN 3RD PLACE. I MEAN IT'S ALL BETWEEN US AND CHINA. GEOFF: THE PUSH FOR INNOVATION COMES AMID GROWING CALLS FOR RESEARCHERS AND LAWMAKERS FOR STRONGER SAFEGUARDS, AND GROWING CONCERN ABOUT WHETHER THOSE PROTECTIONS CAN KEEP PACE WITH THE TECHNOLOGY. FOR MORE ON THE FUTURE OF AI, I'M JOINED BY GARY MARCUS, PROFESSOR EMERITUS AT NEW YORK UNIVERSITY, AUTHOR OF TAMING SILICON VALLEY, AND THE SUBSTACK MARCUS ON AI.
坦率地说，没有人在第三位。我的意思是，这完全是我们和中国之间的事。GEOFF：在研究人员和立法者呼吁加强保障措施，并日益担心这些保护措施能否跟上技术发展步伐的背景下，创新推动力应运而生。关于AI未来的更多报道，我与纽约大学名誉教授、《驯服硅谷》作者以及Substack平台“Marcus on AI”的作者加里·马库斯连线。
THANK YOU FOR BEING WITH US. GARY: MY PLEASURE TO BE HERE. GEOFF: WE HAVE HEARD ON THIS PROGRAM FROM AI RESEARCHERS AND EXPERTS WHO HAVE WARNED ABOUT THE POTENTIAL FOR CATASTROPHIC, EVEN EXISTENTIAL RISKS FROM AI. YOU HAVE PUSHED BACK ON SOME OF THOSE WARNINGS. WHAT DO YOU SEE DIFFERENTLY? GARY: I DON'T THINK EXTINCTION IS A REAL, LIKELY RISK FOR HUMANITY. ALL OF THESE SCENARIOS, THE SO-CALLED DOOM SCENARIOS WHERE AI WIPES US OUT LIKE IN THE TERMINATOR, ALL ASSUME WE WON'T FIGHT BACK, AND WE WILL.
感谢您来到我们的节目。加里：很高兴来到这里。GEOFF：在本节目中，我们听到了AI研究人员和专家发出的警告，他们指出AI可能导致灾难性甚至存在性风险。您对这些警告中的某些内容提出了反驳。您的看法有何不同？加里：我认为灭绝并不是人类面临的真实且可能的风险。所有这些情景，即所谓的末日情景——像《终结者》中那样被AI抹去——都假设我们不会反击，而我们会。
THEY ALL MISSED DETAILS ABOUT HOW WE ARE GEOGRAPHICALLY DIVERSE, GENETICALLY DIVERSE. THEY ARE JUST FANTASIES AND NOT REALISTIC. EXTINCTION IS NOT LIKELY BUT CATASTROPHE MIGHT BE LIKELY. WE ALREADY HAD AN INCIDENT WHERE NAIA REPORTED SOMETHING WRONG AND IT ALMOST LEAD TO A WAR. WE WILL SEE MORE OF THOSE BECAUSE THE SYSTEMS MAKE ERRORS AND HALLUCINATIONS. WE ARE SEEING LOTS OF CYBER HACKING AND THAT MIGHT LEAD FOR EXAMPLE, THE TEMPORARY TAKEDOWN OF AN ELECTRIC GRID THAT LEADS TO THE TEMPORARY TAKEDOWN OF THE HOSPITAL.
它们都忽略了关于我们地理多样性和基因多样性的细节。它们只是幻想，并不现实。灭绝的可能性不大，但灾难可能是可能的。我们已经发生过一起事件，NAIA报告出现了错误，这几乎导致了一场战争。我们将看到更多此类情况，因为系统会犯错误并产生幻觉。我们看到大量的网络黑客攻击，这可能会导致例如电网暂时瘫痪，进而导致医院暂时停运。
WE SAW THAT IN THE U.K. A FEW YEARS AGO. THERE ARE LOTS OF VULNERABILITIES AND THERE MAY BE SERIOUS DAMAGE. I JUST DON'T THINK EXTINCTION IS ONE OF THE THINGS THAT SHOULD KEEP US UP AT NIGHT. GEOFF: AND IT RAISES THE QUESTION OF WHAT TO DO ABOUT IT. THE PRESIDENT MET WITH TECH LEADERS AND HE SEEMS FOCUSED ON SELF-REGULATION. IN FACT HE SAYS THE INDUSTRY IS CAPABLE OF WHAT HE CALLS TREMENDOUS SELF-REGULATION AND THEY SIGNED A VOLUNTARY AGREEMENT FOCUSED ON AI SAFETY REVIEWS.
我们几年前在英国看到了这一点。存在许多漏洞，可能会造成严重损害。我只是认为，灭绝并不是让我们夜不能寐的事情。杰夫：这就引出了该如何应对的问题。总统会见了科技领袖，他似乎专注于行业自律。事实上，他表示该行业有能力实现他所称的“强大的自我监管”，并且他们签署了一份侧重于人工智能安全审查的自愿协议。
IT IS SELF-R
这是自我监
更进一步：量化金融体系
看懂新闻只是起点——沿量化金融路径，把它变成能交付的工程能力