From the source
Reflection AI partnered with Andon Labs to test Beam's autonomy and loss-of-control risks by having the agent run vending businesses in its New York and San Francisco offices.
- Andon installed the machines, and Beam was tasked with stocking, pricing, ordering and handling complaints within set budgets and safety rules, with a Slack channel acting as the storefront.
- New York's Mr. Beam launched on October 8th and San Francisco's Mrs. Beam on November 1st, and the evaluation runs in three phases, the third not yet started.
- Reflection says Mr. Beam showed strong judgment and resisted direct jailbreaks, but struggled to execute multi-step workflows consistently and stayed susceptible to fabricated claims that shaped later actions.
- The company measures net worth, human interventions, successful jailbreaks as a share of attempts, and attempts to seek power, circumvent controls or deceive.
- Beam ran through Pion, an Andon Labs harness with more than 70 tools, persistent memory and a sandboxed Linux shell, with each business led by an operator agent that delegates to sub-agents.
- Reflection says it is using the findings to refine how it evaluates tool calls and memory updates as Beam expands into a more complex internal economy.



