From the source
From the source
Robotics engineer praises MolmoAct 2's out-of-the-box spatial awareness and generalization.
Ai2 published a testimonial from robotics engineer Binh Pham, who used the open model MolmoAct 2 to build a voice-controlled robot at a hackathon.
Pham reported that the model demonstrated spatial awareness and generalized to tasks it was not specifically trained on, calling it "the GPT-2 moment of robotics."
MolmoAct 2 is available with model weights, data, training code, and fine-tuning scripts.
From the source
“The model actually has very good spatial awareness,” says Pham. “MolmoAct 2 can identify objects really well.” In robot learning, often the hardest part is connecting an instruction to the scene in front of the robot, reasoning about where objects are, and producing actions that make sense for the hardware. “This is the first time I can actually see a model that wasn’t trained on the tasks that I had given, but can actually do it,” adds Pham.
allenai.org
