Hugging Face· PlatformStory of the weekOpen-weight release

Jack of All Trades, Master of Some, a Multi-Purpose Transformer Agent

Hugging Face releases Jack of All Trades (JAT), an open-source multi-modal Transformer agent capable of playing video games, controlling robots, and understanding navigation commands, along with expert RL agents and the JAT dataset.

From the source

We're excited to share Jack of All Trades (JAT), a project that aims to move in the direction of a generalist agent. The project started as an open reproduction of the Gato (Reed et al., 2022) work, which proposed to train a Transformer able to perform both vision-and-language and decision-making tasks.

huggingface.co