# Sakana AI — Transformer²: Self-Adaptive LLMs

- Company: Sakana AI (sakana.ai)
- Announced: 2025-01-14T15:00:00+00:00
- Category: research-paper
- Subject: Sakana models
- Source: https://sakana.ai/transformer-squared
- Record: https://forck.live/items/4724-transformer-self-adaptive-llms

Sakana AI announces a research paper titled Transformer², which proposes a self-adaptive machine learning system that dynamically adjusts its weights for various tasks using Singular Value Finetuning (SVF) and reinforcement learning, outperforming static approaches like LoRA.

## Evidence

Verbatim from https://sakana.ai/transformer-squared:

> This vision of self-adaptive AI is at the heart of our latest research paper , Transformer² (‘Transformer-squared’) , where we propose a machine learning system that dynamically adjusts its weights for various tasks.

---

Record: https://forck.live/items/4724-transformer-self-adaptive-llms
Catalogue: https://forck.live/llms.txt
Feed: https://forck.live/feed.md