LIVE
Anthropic reportedly posted a net loss of over $80 billion in H1 202620/10/26 · Anthropic|Self-Evolving Interfaces Help a Mid-Sized Open Model Beat GPT-5.5 and Claude Opus20/10/26|Anthropic says Claude helped trace the origin of NIST's mysterious ECDSA seeds16/10/26 · Anthropic|Reflection AI unveils Beam, a 501-billion-parameter open model16/10/26 · Reflection AI|Meta releases Muse Spark Open, a mixture-of-experts model built for local Mac Studio inference15/10/26 · Meta|Meta releases Muse Spark Open, an open-weight multimodal model15/10/26 · Meta|AI-assisted robots for stroke rehabilitation therapy20/10/26|NVIDIA unveils Cosmos3-H-Dreams, a generative model for surgical simulation20/10/26 · NVIDIA|NVIDIA co-generates video and 3D motion for arbitrary skeletal rigs20/10/26 · NVIDIA|NVIDIA Extends Spatiotemporal Robot Memory to Warehouse Fleets20/10/26 · NVIDIA|Adaptive Multi-Token Prediction: How Far Should Decoding Speculate?20/10/26|Anthropic Uses Claude to Design Protein Binders Against Scorpion Neurotoxins20/10/26 · Anthropic|Anthropic reportedly posted a net loss of over $80 billion in H1 202620/10/26 · Anthropic|Self-Evolving Interfaces Help a Mid-Sized Open Model Beat GPT-5.5 and Claude Opus20/10/26|Anthropic says Claude helped trace the origin of NIST's mysterious ECDSA seeds16/10/26 · Anthropic|Reflection AI unveils Beam, a 501-billion-parameter open model16/10/26 · Reflection AI|Meta releases Muse Spark Open, a mixture-of-experts model built for local Mac Studio inference15/10/26 · Meta|Meta releases Muse Spark Open, an open-weight multimodal model15/10/26 · Meta|AI-assisted robots for stroke rehabilitation therapy20/10/26|NVIDIA unveils Cosmos3-H-Dreams, a generative model for surgical simulation20/10/26 · NVIDIA|NVIDIA co-generates video and 3D motion for arbitrary skeletal rigs20/10/26 · NVIDIA|NVIDIA Extends Spatiotemporal Robot Memory to Warehouse Fleets20/10/26 · NVIDIA|Adaptive Multi-Token Prediction: How Far Should Decoding Speculate?20/10/26|Anthropic Uses Claude to Design Protein Binders Against Scorpion Neurotoxins20/10/26 · Anthropic|
ResearchNVIDIA

NVIDIA Extends Spatiotemporal Robot Memory to Warehouse Fleets

A new system called Industrial ReMEmbR lets warehouse robot fleets share semantic memory while limiting compute, bandwidth and storage costs, with a built-in GDPR compliance mechanism.

October 20, 20263 min readPublished byarXiv

Researchers have introduced Industrial ReMEmbR, an extension of NVIDIA's ReMEmbR memory system designed for fleets of industrial robots. The motivating problem is practical: diagnosing a recurring aisle blockage in a warehouse can require reviewing hours of video captured by multiple robots across several shifts, an exercise that becomes expensive if every stream has to be processed continuously.

The proposed architecture splits work between the robot and the server. On each unit, an NVIDIA Jetson board encodes video clips into several representations: retrieval embeddings via Cosmos-Embed1, vision tokens via Cosmos3-Edge, and reconstruction latents via the Wan2.2 VAE. No raw camera frames are uploaded to the server, which reduces bandwidth requirements. The same encoding models are reused to detect people within image patches and mask them automatically, a mechanism intended to support GDPR-compliant deployments.

The central technical contribution is splitting Cosmos3-Edge at the boundary between its vision and language components: the vision encoder stays on the robot, while the language decoder runs on an on-premises server. A Nemotron-based agent then queries this shared memory by content, position and time, relying on cached vision tokens instead of regenerating scene descriptions at write time. The authors report that this split reproduces the output of the unsplit model across all 450 tested decodes.

The work reflects a broader direction in industrial robotics: pushing part of multimodal processing to the edge to contain infrastructure costs while still maintaining a usable, fleet-wide memory. The approach remains experimental, with no documented large-scale deployment yet, but it offers a concrete response to a recurring operational problem in automated warehouses.

Tags
roboticsedge-computingnvidiamultimodalgdprwarehouse-automation

Read also