From the source
Lead story
Top stories
Models & availability
Latest
Lead story
Top stories
Models & availability
Latest
From the source
Apple introduces REVERSAL-BENCH, a benchmark that controls environmental reversibility via a continuous parameter and provides a reset oracle to test state recoverability across eight manipulation settings in five physics engines.
Evaluating various policy architectures reveals a sharp reversibility cliff: reset-free agents are consistently absorbed into irrecoverable states as reversibility increases, whereas episodic agents maintain steady learning.
The benchmark suite, a large multi-simulator dataset labeled with recoverability, and a reset oracle are released.
From the source
We introduce REVERSAL-BENCH, a benchmark that controls reversibility via a continuous parameter ρ∈ [0, 1] and provides a reset oracle, a ground-truth verification mechanism to test state recoverability across eight manipulation settings in five physics engines.
machinelearning.apple.com