From the source
From the source
Together AI upgraded its fine-tuning platform, adding support for over a dozen large models (including
DeepSeek, Qwen,
Meta, and
OpenAI's gpt-oss), extending context lengths by 2x-4x (up to 131k tokens), and integrating with
Hugging Face Hub for model fine-tuning.
Given this trend, we wanted to make it possible for AI developers to harness long-context abilities in fine-tuning. To make this happen, we have overhauled our training systems and identified ways to increase the maximum supported context length for most of our models — at no additional cost to you. On average, you can expect 2x-4x increases to the context length, with some settings (like Llama 3.1-8B or Gemma 3-4B) jumping to their maximum length of 131k tokens.
