Titans + MIRAS: Helping AI have long-term memory
Research paper
Google Research introduces the Titans architecture and MIRAS framework, which enable AI models to update their core memory in real-time, combining the speed of RNNs with the accuracy of transformers.
The approach uses a 'surprise metric' to selectively store novel information, allowing efficient handling of massive contexts.