LIVE
OpenAI models are coming to Google Cloud21/10/26 · OpenAI|OpenAI details ChatGPT's new advertising infrastructure21/10/26 · OpenAI|Anthropic reportedly posted a net loss of over $80 billion in H1 202620/10/26 · Anthropic|Self-Evolving Interfaces Help a Mid-Sized Open Model Beat GPT-5.5 and Claude Opus20/10/26|Moonshot AI releases Kimi K3.1 Pro and a Highspeed variant23/10/26 · Moonshot AI|Sweden bans ChatGPT and Claude across government offices23/10/26|OpenAI details hardened security for its frontier model training environment23/10/26 · OpenAI|SpectralCanary: A Lightweight Method to Detect Unauthorized Training Data Use22/10/26|Low-bit n-gram tables cut memory use in language models22/10/26|NVIDIA releases OpenShell, a runtime for fleets of autonomous AI agents22/10/26 · NVIDIA|Ai2 releases OlmoEarth v1.3, an upgraded geospatial embeddings model22/10/26 · Ai2|NVIDIA Introduces Minerva, an Observability Platform for AI Factories22/10/26 · NVIDIA|OpenAI models are coming to Google Cloud21/10/26 · OpenAI|OpenAI details ChatGPT's new advertising infrastructure21/10/26 · OpenAI|Anthropic reportedly posted a net loss of over $80 billion in H1 202620/10/26 · Anthropic|Self-Evolving Interfaces Help a Mid-Sized Open Model Beat GPT-5.5 and Claude Opus20/10/26|Moonshot AI releases Kimi K3.1 Pro and a Highspeed variant23/10/26 · Moonshot AI|Sweden bans ChatGPT and Claude across government offices23/10/26|OpenAI details hardened security for its frontier model training environment23/10/26 · OpenAI|SpectralCanary: A Lightweight Method to Detect Unauthorized Training Data Use22/10/26|Low-bit n-gram tables cut memory use in language models22/10/26|NVIDIA releases OpenShell, a runtime for fleets of autonomous AI agents22/10/26 · NVIDIA|Ai2 releases OlmoEarth v1.3, an upgraded geospatial embeddings model22/10/26 · Ai2|NVIDIA Introduces Minerva, an Observability Platform for AI Factories22/10/26 · NVIDIA|
Research

VioLA: a humanoid control policy trained mostly on human motion data

A new generalist policy for humanoid robots predicts motion latents rather than joint commands, allowing it to leverage vast human demonstration data and follow instructions without task-specific fine-tuning.

October 8, 20263 min readPublished byarXiv

Researchers have introduced VioLA, a generalist control policy for humanoid robots designed to address two persistent bottlenecks in the field: the tightly coupled nature of joint-level action spaces, where legs, arms and fingers must move in coordination to preserve balance, and the scarcity of teleoperated demonstrations, which normally force task-specific fine-tuning before any deployment.

The core idea is to change what the policy actually predicts. Rather than outputting joint commands directly, VioLA generates latent representations of body and hand motion. Pretrained controllers then translate these latents into actual robot commands, while dedicated motion encoders map both human and robot movement into a shared latent space. This means a recording of a human performing a task can be automatically labeled within the robot's own action space, bypassing the need for teleoperated data collection.

This design unlocks access to a far larger training pool: the dataset used comprises 140.6 million frames, 93.2% of which come from human motion rather than robot demonstrations. The reported results are notable. On real-robot locomotion tasks executed zero-shot, VioLA reaches 100% success, compared with 16.7% for GR00T N1.7 and 0% for Ψ0. On manipulation tasks, also without task-specific fine-tuning, success reaches 88.6%.

The authors report that the method generalizes across two vision-language-action backbones as well as a world-action model, suggesting the approach is not tied to a single architecture. Code and checkpoints are slated for release, which should allow independent verification and testing on other humanoid platforms. If these results hold up at larger scale, relying on human motion data instead of teleoperated demonstrations could meaningfully cut the data-collection costs that currently limit the deployment of generalist humanoid robots.

Tags
humanoid-robotsrobot-learningimitation-learningvlazero-shotlatent-actions

Read also