跳到正文
Dr Shahid Masood· 来源· @Shahidmasooddr · X·· 3 天前精选AI 评分72
推荐理由

作者实测指出Genie 4存在物理幻觉与对象持久性缺陷,揭示了合成世界训练具身智能的潜在风险。

正文 · 原文

𝗚𝗘𝗡𝗜𝗘 𝟰: 𝗚𝗢𝗢𝗚𝗟𝗘’𝗦 𝗦𝗬𝗡𝗧𝗛𝗘𝗧𝗜𝗖 𝗪𝗢𝗥𝗟𝗗𝗦, 𝗧𝗛𝗘 𝗔𝗣𝗢𝗟𝗟𝗢 𝗖𝗛𝗘𝗖𝗞𝗘𝗥𝗦 𝗗𝗘𝗠𝗢, 𝗔𝗡𝗗 𝗧𝗛𝗘 𝗠𝗨𝗦𝗧𝗔𝗡𝗚 𝗧𝗛𝗔𝗧 𝗧𝗨𝗥𝗡𝗘𝗗 𝗜𝗡𝗧𝗢 𝗔 𝗧𝗔𝗫𝗜.

Google DeepMind has officially unveiled Genie 4—its frontier real-time interactive world model designed to simulate dynamic physical reality from natural language and image prompts.

The strategic proposition is staggering: train the next generation of physical humanoid robots entirely inside synthetic worlds that do not exist. Compress decades of mechanical trial-and-error into hours of pure compute.

DeepMind’s headline demo showcases Apptronik’s Apollo humanoid playing checkers with zero physical hardware involved. But beneath the slick research preview sits a fragile algorithmic architecture where language models grade their own visual homework, steering inputs break, and basic object permanence collapses:

𝟭. 𝗧𝗵𝗲 𝗘𝗻𝗴𝗶𝗻𝗲: 𝗔 𝗧𝗵𝗿𝗲𝗲-𝗧𝗶𝗲𝗿 𝗔𝗜 𝗦𝘁𝗮𝗰𝗸 𝗪𝗮𝘁𝗰𝗵𝗶𝗻𝗴 𝗜𝘁𝘀𝗲𝗹𝗳

Genie 4 is not just a video generator—it is a closed-loop multi-agent simulator running on interactive keyboard, mouse, and natural language steering:

✦ 𝗧𝗵𝗲 𝗧𝘄𝗼-𝗠𝗶𝗻𝘂𝘁𝗲 𝗛𝗼𝗿𝗶𝘇𝗼𝗻: Interactive worlds now sustain coherence for approximately two minutes (up from 60 seconds in Genie 3, and barely 10–20 seconds in Genie 2). Google officially hedges this as "short sessions."

✦ 𝗧𝗵𝗲 𝗣𝗹𝗮𝗻𝗻𝗲𝗿 𝗟𝗮𝘆𝗲𝗿: Visual grounding is anchored by Gemini Omni, while Gemini 3.8 Flash acts as an autonomous frame-by-frame planner. Flash watches the generated stream, breaks high-level goals into tactical sub-steps, checks whether the simulation executed the command, and re-plans dynamically.

✦ 𝗡𝗮𝘁𝗶𝘃𝗲 𝗦𝗼𝘂𝗻𝗱𝘀𝗰𝗮𝗽𝗲𝘀 & 𝗦𝘆𝗻𝘁𝗵𝗜𝗗: Generates simultaneous native audio—ambient acoustics, spatial sound, dialogue, and music—with every frame watermarked via Google’s SynthID.

✦ 𝗚𝗮𝘁𝗲𝗱 𝗗𝗲𝗽𝗹𝗼𝘆𝗺𝗲𝗻𝘁: Currently restricted to a closed research preview for trusted testers, with a waitlist rolling out for Project Genie (which previously locked access to US Ultra subscribers aged 18+).

𝟮. 𝗧𝗵𝗲 𝗔𝗽𝗼𝗹𝗹𝗼 𝗜𝗹𝗹𝘂𝘀𝗶𝗼𝗻: 𝗭𝗲𝗿𝗼 𝗥𝗲𝗮𝗹 𝗔𝘁𝗼𝗺𝘀

DeepMind is aggressively positioning Genie 4 as the synthetic sandbox for physical robotics, using Apptronik’s flagship robot as the test case:

• The Setup: Gemini 4 Argon decomposes the strategic game of checkers into discrete mechanical steps.

• The Execution: Those steps are fired as text prompts directly into Genie 4, which generates a real-time interactive simulation of the Apollo humanoid grasping and moving checkers across the board.

• The Caveat: Not a single real-world servo, actuator, or sensor was deployed. Google’s documentation quietly confirms these showcase clips are shortened, curated recordings of keyboard-and-mouse sessions.

𝟯. 𝗧𝗵𝗲 𝗚𝗹𝗶𝘁𝗰𝗵 𝗶𝗻 𝘁𝗵𝗲 𝗠𝗮𝘁𝗿𝗶𝘅: 𝗧𝗲𝘀𝘁𝗲𝗿 𝗧𝗲𝗹𝗲𝗺𝗲𝘁𝗿𝘆

While the photorealism and procedural lighting look cinematic, independent testing reveals where the underlying physics engine fractures:

✦ 𝗦𝘁𝗲𝗲𝗿𝗶𝗻𝗴 𝗜𝗻𝗲𝗿𝘁𝗶𝗮: Dynamic assets—whether a biplane, a car, or a running animal—frequently ignored real-time user steering attempts entirely.

✦ 𝗧𝗵𝗲 𝗠𝘂𝘀𝘁𝗮𝗻𝗴 𝗧𝗮𝘅𝗶 𝗔𝗻𝗼𝗺𝗮𝗹𝘆: Coherence degrades rapidly over time. Turn the camera around and the environment mutates. In one direct test, a rendered Ford Mustang suddenly reversed direction, drove away, and morphed into a yellow taxi cab.

✦ 𝗗𝗲𝗲𝗽𝗠𝗶𝗻𝗱’𝘀 𝗢𝗳𝗳𝗶𝗰𝗶𝗮𝗹 𝗟𝗶𝗺𝗶𝘁𝗮𝘁𝗶𝗼𝗻𝘀: Google openly lists object permanence drift, illegible text rendering, long-session temporal decay, and spatial inaccuracies as unsolved boundaries.

𝗧𝗛𝗘 𝗦𝗬𝗡𝗧𝗛𝗘𝗧𝗜𝗖 𝗧𝗥𝗔𝗣

In physical reality, gravity and Newtonian mechanics are the ultimate, unforgiving judges. If an actuator miscalculates torque or friction, the robot falls.

In Genie 4, the laws of physics are negotiated by an algorithmic model. And in the Apollo demo, another Gemini model is the sole referee deciding whether the simulated robot obeyed the laws of nature.

If a neural net masters a world whose underlying physics are hallucinated, it learns fatal habits. A Mustang mutating into a taxi is an amusing glitch in a tech demo. In the real world, training physical machines on fluid, hallucinated physics produces robots that fail the second they touch real ground.

Unlimited synthetic training data is worthless without absolute physical truth.

#Genie4 #GoogleDeepMind #WorldModels #Robotics #Gemini
https://t.co/08vrQdMqmp

来源:Dr Shahid Masood · x.com