# Amazon — Introducing the Amazon SageMaker JumpStart Model Leaderboard

- Company: Amazon (amazon.com)
- Announced: 2026-11-18T22:31:04+00:00
- Category: capability-change
- Coverage: not counted
- Announcement: yes
- Group: announcements
- Source: https://aws.amazon.com/blogs/machine-learning/introducing-the-amazon-sagemaker-jumpstart-model-leaderboard/
- Record: https://forck.live/items/38295-introducing-the-amazon-sagemaker-jumpstart-model-leaderboard
- Subject: Bedrock / Nova

AWS added a Model Leaderboard to SageMaker JumpStart, a view in SageMaker Studio that ranks open-weight models side by side on quality, speed and cost. It answers a practical question for JumpStart users: comparing models otherwise means reading model cards one at a time and hunting for benchmark scores published under different conditions. Quality scores come from three reasoning benchmarks, BIG-Bench Hard, GPQA Diamond and MMLU-Pro, which AWS runs itself with the same evaluation setup for every model. Performance and cost metrics come from sending a standardized test workload to an endpoint using each JumpStart deployment configuration, so the numbers are like-for-like. At launch the leaderboard covers 70+ models from providers including Meta, Google, Qwen, IBM and Arcee, with more added over time. Estimated cost reflects SageMaker instance cost only, based on the on-demand hourly rate for the configuration's default instance type, and excludes data transfer, storage, inference component costs and discounts such as Reserved Instances or AWS Savings Plans.

## Evidence

Verbatim from https://aws.amazon.com/blogs/machine-learning/introducing-the-amazon-sagemaker-jumpstart-model-leaderboard/:

> Amazon SageMaker JumpStart gives you hundreds of open-weight foundation models you can deploy quickly. That choice is powerful, but it also creates a real question: Which model should you start with? Comparing models usually means reading model cards one at a time and hunting for benchmark scores that different sources published under different conditions. Then you still must guess how each model will perform, and what it will cost, for your use case.
> 
> Today we are launching the Amazon SageMaker JumpStart Model Leaderboard , a new way to compare JumpStart models side by side on quality, speed, and cost, directly in Amazon SageMaker Studio. In this post, we explain what the leaderboard shows, define the key terms in plain language, and walk through how to go from a shortlist to a deployed model.
> 
> What is the JumpStart Model Leaderboard?
> 
> The leaderboard is a new view of the JumpStart base models page in SageMaker Studio, right next to the Categories and All models views. It uses the same search bar and filters you already know, and it opens on a leaderboard of large language models (LLMs). You see rankings immediately without answering setup questions first.

---

Record: https://forck.live/items/38295-introducing-the-amazon-sagemaker-jumpstart-model-leaderboard
Catalogue: https://forck.live/llms.txt
Current issue: https://forck.live/feed.md
