LIVE
Anthropic files IPO prospectus, with risk disclosures taking center stage26/10/26 · Anthropic|Robot policy trained only in simulation matches top real-world systems26/10/26|OpenAI unveils GPT-6.1 Terra, a model built for computer use26/10/26 · OpenAI|OpenAI models are coming to Google Cloud21/10/26 · OpenAI|OpenAI details ChatGPT's new advertising infrastructure21/10/26 · OpenAI|Anthropic reportedly posted a net loss of over $80 billion in H1 202620/10/26 · Anthropic|Self-Evolving Interfaces Help a Mid-Sized Open Model Beat GPT-5.5 and Claude Opus20/10/26|OpenAI publishes a page announcing 'GPT-6.1 Terra', with no technical details available26/10/26 · OpenAI|EBench benchmark maps the limits of a frontier MLLM agent for robot control26/10/26|Cohere flags concerning behavior in a popular open-weight AI model26/10/26 · Cohere|Hob: an open-source, on-device alternative to Claude Cowork and ChatGPT26/10/26|OpenAI details collaboration with academic communities on complex scientific problems26/10/26 · OpenAI|Anthropic files IPO prospectus, with risk disclosures taking center stage26/10/26 · Anthropic|Robot policy trained only in simulation matches top real-world systems26/10/26|OpenAI unveils GPT-6.1 Terra, a model built for computer use26/10/26 · OpenAI|OpenAI models are coming to Google Cloud21/10/26 · OpenAI|OpenAI details ChatGPT's new advertising infrastructure21/10/26 · OpenAI|Anthropic reportedly posted a net loss of over $80 billion in H1 202620/10/26 · Anthropic|Self-Evolving Interfaces Help a Mid-Sized Open Model Beat GPT-5.5 and Claude Opus20/10/26|OpenAI publishes a page announcing 'GPT-6.1 Terra', with no technical details available26/10/26 · OpenAI|EBench benchmark maps the limits of a frontier MLLM agent for robot control26/10/26|Cohere flags concerning behavior in a popular open-weight AI model26/10/26 · Cohere|Hob: an open-source, on-device alternative to Claude Cowork and ChatGPT26/10/26|OpenAI details collaboration with academic communities on complex scientific problems26/10/26 · OpenAI|
Research

Robot policy trained only in simulation matches top real-world systems

Researchers introduce ZAP, a robot control recipe built on a 27B vision-language model that learns manipulation entirely from simulated data yet reaches 96.7% success on real-world tasks.

October 26, 20264 min readPublished byarXiv

A new paper introduces Zero-real Agent Policy (ZAP), a method for teaching robots to perform manipulation tasks without ever training on real-world robot data. The approach starts from a pretrained 27-billion-parameter vision-language model, which already carries general world understanding and reasoning capabilities. The researchers then apply supervised fine-tuning and reinforcement learning (GRPO) on simple simulated tasks to teach the model how to actually move a robotic arm, using a lightweight tool harness to connect the model's outputs to physical actions.

The resulting system reportedly reaches 96.7% success on real-world evaluation tasks, a figure the authors say matches a reference system called GPT-6 Astra tested under the same harness, while substantially outperforming a comparison vision-language-action model, MolmoAct2, which scored 33.3%. ZAP is also described as three times faster and seventeen times cheaper to run than the GPT-6 Astra baseline, which, if confirmed, would make it a notably more practical option for deployment.

Beyond raw success rates, the paper emphasizes generalization. ZAP is shown handling tasks and objects absent from its training data: placing a test tube into a specific hole of a rack on request, passing a test tube between two robotic arms in mid-air, marking an X on a tic-tac-toe board, and playing chess. None of these scenarios were part of the simulated training curriculum, suggesting the model's pretrained reasoning transfers into novel physical and linguistic contexts rather than simply memorizing trained behaviors.

The system also transfers to a robot embodiment it was never trained on. Tested on a single-arm Franka robot, ZAP achieves 55.9% success on the RoboLab-120 benchmark, edging out the best competing vision-language-action or world-action-model baseline by 4.9 percentage points. This cross-embodiment transfer is one of the more demanding tests for generalist robot policies, since control strategies often do not carry over cleanly between different hardware setups.

The core claim worth noting is architectural: separating 'what' a task requires, handled by a large pretrained model, from 'how' to execute it physically, learned cheaply in simulation, may offer a more data-efficient path to generalist robot control than collecting large real-world robot datasets. If the reported numbers hold up under independent scrutiny, this split-training strategy could reduce the cost and time needed to deploy capable robot policies across new tasks and hardware.

Tags
roboticsvision-language-modelsim-to-realgeneralizationreinforcement-learning

Read also

Robot policy trained only in simulation matches top real-world systems · nAIvigate