# Alibaba — Generalizing an LLM from 8k to 1M Context using Qwen-Agent

- Company: Alibaba (alibaba.com)
- Announced: 2024-06-06T03:59:59+00:00
- Category: capability-change
- Subject: Qwen
- Models affected: Qwen2
- Source: https://qwenlm.github.io/blog/qwen-agent-2405/
- Record: https://forck.live/items/2313-generalizing-an-llm-from-8k-to-1m-context-using-qwen-agent

An agent built on Qwen2 models with an 8k context size can handle documents with 1M tokens, surpassing RAG and native long-context models.

## Evidence

Verbatim from https://qwenlm.github.io/blog/qwen-agent-2405/:

> We’ve created an agent using Qwen2 models with an 8k context size to understand documents with 1M tokens, surpassing RAG and native long-context models.

---

Record: https://forck.live/items/2313-generalizing-an-llm-from-8k-to-1m-context-using-qwen-agent
Catalogue: https://forck.live/llms.txt
Feed: https://forck.live/feed.md