From the source
Baseten's Base Labs reran its continual-learning experiment with real sports facts to separate interference between facts from general model damage.
- The earlier paper wrote invented facts that conflicted with world knowledge into Qwen3 models, and repeated learning of those facts damaged the model's general ability, making it hard to tell how much forgetting came from interference.
- The new run uses talkie-1930-13b-it, a 13B model trained only on text published before 1931, and writes twenty sports results from 2011-2019, facts that are new to the model but ordinary.
- Recall rose from 0% at base to 91% immediately after each fact's write and fell to 33% after all twenty writes, with late facts surviving and early ones lost.
- Losses were often abrupt: the 2011 Wimbledon women's champion was recalled perfectly until the 2019 US Open women's champion was written three facts later, then dropped to zero.
- Overwritten facts were not erased and could be relearned faster, and activation patching showed the overwrites happen largely in later-layer MLP weights.
- Code, data and checkpoints are released at basetenlabs/talkie-facts-replication.




