# Together AI — Plan, divide, and conquer: How weak models excel at long context tasks

- Company: Together AI (together.ai)
- Announced: 2026-03-26T00:00:00+00:00
- Category: research-paper
- Subject: Inference platform
- Models affected: GPT-4o, Llama-3-70B, Qwen-72B
- Source: https://www.together.ai/blog/plan-divide-conquer
- Record: https://forck.live/items/2366-plan-divide-and-conquer-how-weak-models-excel-at-long-context-tasks

Together AI presents research showing that smaller models using a strategic Divide & Conquer framework can match or beat GPT-4o single-shot on long context tasks, with benefits of lower cost, faster processing, and easier tuning.

## Evidence

Verbatim from https://www.together.ai/blog/plan-divide-conquer:

> Our research, "When Does Divide and Conquer Work for Long Context LLM?" (ICLR 2026), introduces a framework to study this. We found that smaller models using a strategic "Divide & Conquer" design can match or beat GPT-4o single-shot on long context tasks.

---

Record: https://forck.live/items/2366-plan-divide-and-conquer-how-weak-models-excel-at-long-context-tasks
Catalogue: https://forck.live/llms.txt
Feed: https://forck.live/feed.md