Ep#106: Flex-Ď: A Multi-Stream World-Action Model with Compute Flexibility
Open original episodeFlex-Ď is a 6B-parameter World-Action Model (WAM) for robotics that goes beyond RGB-only prediction by jointly denoising 3D pointmaps and DINO semantic features alongside color in a shared latent space, achieving 2â7Ă better performance over baselines on real-world bimanual manipulation tasks with greater demonstration efficiency.
Why this matters: The "free lunch" findingâthat a frozen RGB video VAE encodes 3D pointmaps almost losslesslyâhas direct implications for researchers building robot policies without needing new sensors or pre-training pipelines.