Debuly
The Aggregate logo

The Aggregate

Free daily LLM ranking that fuses public benchmarks into one Elo-style rating, with uncertainty, forecasts and an MCP server.

Free

What is The Aggregate?

The Aggregate is a free website that ranks large language models by combining results from public benchmarks and leaderboards into one score. Each day its pipeline collects results, normalizes model names and fits an Item Response Theory model, so every model gets a rating on an Elo-like scale centered near 1500 along with a standard error. The site covers thousands of models and benchmarks, with pages for ranked models, benchmark categories such as coding, math and reasoning, agents and tools, trends, a model comparison view and a task explorer. It also publishes saturation forecasts that estimate when a benchmark stops separating the leading models, plus a daily changelog of what moved. A Subscriptions page weighs AI plans by the model work a dollar buys. Signing in with Google or GitHub saves custom rankings and gives 50 free task analyses a day. A free read-only MCP server at theaggregate.ai/mcp lets Claude Code and other clients query rankings without a key. The site has no paid plans and is built by an independent researcher.

Use cases

  • Compare LLMs on one cross-benchmark ranking
  • Check which benchmarks separate top models
  • Pick an AI subscription by value per dollar
  • Track daily leaderboard changes
  • Query model rankings from an MCP client
  • Save custom model rankings for a task

Who it's for

  • AI researchers
  • Developers
  • Technical decision makers
  • Analysts

Why use The Aggregate

  • One rating replaces checking many separate leaderboards that each tell part of the story.
  • Standard errors on each rating show how much to trust small gaps between models.
  • Every score links back to its upstream leaderboard or report, so you can verify the source.
  • The MCP server lets you ask your coding assistant about model rankings with no key or sign-up.
  • It is free to read, with a free sign-in for saved views.

The Aggregate features

  • Daily ranking of models fused from public benchmarks
  • IRT-based Aggregate Rating with standard errors
  • Benchmark pages grouped by category and source
  • Head-to-head model comparison with a significance check
  • Saturation forecasts for individual benchmarks
  • Daily changelog of leaderboard movements
  • Subscriptions page ranking AI plans by value per dollar
  • Task Explorer with 50 free task analyses a day when signed in
  • Saved custom aggregate views
  • Free read-only MCP server with eight lookup tools

The Aggregate integrations

  • Claude Code
  • Claude
  • Cursor
  • ChatGPT
  • MCP

How to get started with The Aggregate

  1. Open the site and browse the ranked models table or search for a specific model.
  2. Use Compare to check two models head to head and see whether the rating gap is significant.
  3. Browse benchmarks by category to see which tests feed the ranking and where they saturate.
  4. Sign in with Google or GitHub to save custom rankings and run free task analyses.
  5. Optionally add the MCP endpoint to your client to query rankings directly.

The Aggregate limitations

  • Saturation dates are model projections, not validated deadlines
  • Rating points are not calibrated chess win odds
  • The MCP endpoint is rate-limited per IP and returns bounded lookups
  • It is a comparison site, not an AI assistant, and the /pricing page returns a 404

The Aggregate pricing

The Aggregate is free to use.

Prices can change and may vary by country or exclude tax. Check the official pricing page.

The Aggregate alternatives

The main The Aggregate alternatives listed on Debuly are BenchGecko, Tapetide MCP, ArtificialWatch, Chart Library, Consensus and Not Human Search. The table compares pricing and platforms; order is A–Z.

The Aggregate compared with its alternatives
ToolPricingStarting pricePlatforms
The AggregateFree—Web, API
ArtificialWatchFreemium$12/moWeb, Chrome extension
BenchGeckoFree—Web, API
Chart LibraryFree—Web, API, MCP server
ConsensusFreemium$12/moWeb, API, MCP
Not Human SearchFreemium$9.99/moWeb, API, MCP server
Tapetide MCPFreemium₹499/moMCP server, API, CLI
  1. ArtificialWatch

    Alerts by email, push, SMS or phone call when a new AI model goes live on a provider's API, with a free plan.

  2. BenchGecko

    Free dashboard and API tracking AI model prices, benchmark scores, provider health and new releases across 1,269 models.

  3. Chart Library

    Lookup tool and MCP/API service that finds historical analogs for a stock's recent chart and shows what followed.

  4. Consensus

    AI search engine for research that answers questions from peer-reviewed papers, with every claim linked back to its source.

  5. Not Human Search

    Search engine for AI agents that ranks sites by agent-readiness and scores any site from 0 to 100 on seven machine-readable signals.

  6. Tapetide MCP

    MCP server that gives Claude, ChatGPT and Cursor 55 tools for NSE and BSE quotes, financials, screening and option chains.

The Aggregate FAQ

How much does The Aggregate cost?

No paid plans are listed. The rankings are readable without an account, and signing in gives free saved views and 50 free task analyses per day.

Is there a free plan for The Aggregate?

Yes. The site is free to use, and the MCP server is described as free and read-only, with no key or sign-up required.

How does The Aggregate calculate its ranking?

It collects public leaderboards and reports, merges equivalent sources, and fits a hierarchical Item Response Theory model that estimates an ability for every model and a difficulty and discrimination for every benchmark.

Does The Aggregate have an API or integrations?

It offers an MCP server at theaggregate.ai/mcp with tools to search models, compare models and read benchmark details. It works with Claude Code, Claude, Cursor and other MCP clients.

Who is The Aggregate for?

It suits researchers, developers and teams choosing between language models who want a single comparison across many benchmarks.

What are alternatives to The Aggregate?

Alternatives include LMArena, Artificial Analysis, Epoch AI benchmarks, Hugging Face Open LLM Leaderboard and BenchGecko.

Sources & verification

Facts on this page come from the official sources below, each with the date we read it. Written by Debuly; the vendor did not review this page.

SourceTypeAccessed
theaggregate.ai/official
theaggregate.ai/pricingpricing
theaggregate.ai/subscriptionsofficial
theaggregate.ai/how-it-worksofficial
theaggregate.ai/mcpofficial
theaggregate.ai/benchmarksofficial

Image credits

  • Logo: from theaggregate.ai · fetched · Vendor trademark, used only to identify the product; removed on request
  • Cover: none collected yet, so a generated tile is shown.

Spot an error? Report an issue with this listing. We also remove a logo or image on the owner's request.