From the source
Hugging Face releases Jack of All Trades (JAT), an open-source multi-modal Transformer agent capable of playing video games, controlling robots, and understanding navigation commands, along with expert RL agents and the JAT dataset.
Jack of All Trades, Master of Some, a Multi-Purpose Transformer Agent
Story of the weekOpen-weight release
From the source
We're excited to share Jack of All Trades (JAT), a project that aims to move in the direction of a generalist agent. The project started as an open reproduction of the Gato (Reed et al., 2022) work, which proposed to train a Transformer able to perform both vision-and-language and decision-making tasks.
