Debuly
SDKProof logo

SDKProof

Command-line tool that checks which library APIs AI coding assistants get wrong, using the TypeScript compiler to judge each answer.

Free
Visit sdkproof.dev SDKProof (official site)Compare developer platforms

What is SDKProof?

SDKProof measures a problem library maintainers keep running into: AI coding assistants write library code from memory, so after a major release renames or removes things, the assistant keeps producing the old API. The tool has two halves. The drift report reads two published versions of an npm package, diffs their type declarations and lists the functions, hooks and classes that left the entry point, without installing anything or calling a model. The scoring half gives a model real coding jobs for one library and runs every answer through tsc, so an answer passes only if it compiles, and no AI judges another AI. The site publishes scorecards for eight libraries, including TanStack Table, the Vercel AI SDK, Prisma, Next.js, React Router, Stripe, TanStack Query and Zod, plus README badges and a scores.json file. The pages describe no pricing or paid plans.

Use cases

  • Find APIs removed in a major release
  • Score a model on a library's code
  • Check SDK version drift
  • Publish an AI-readiness badge
  • Test documentation fixes for models
  • Compare libraries on AI compile rates

Who it's for

  • Library maintainers
  • SDK authors
  • Developer experience teams
  • AI-assisted developers

Why use SDKProof

  • Shows maintainers which removed or renamed APIs assistants will keep writing after a release.
  • The compiler decides correctness, so results do not depend on another AI as judge.
  • Drift analysis needs no account, no install of the target package and no model call.
  • Published scorecards and badges let readers check a number against its source run.
  • Tests of documentation sentences show what kind of context helps a model write current APIs.

SDKProof features

  • Drift report that diffs two npm package versions
  • No install or model call needed for drift
  • Compile-checked scoring with tsc
  • JSON output of removed symbols
  • Scorecards for eight TypeScript libraries
  • README badges linked to each scorecard
  • Shields.io endpoint and scores.json with intervals
  • Lists symbols removed with no deprecation first

How to get started with SDKProof

  1. Point the tool at an npm package name from the command line.
  2. Read the drift report of exports removed between two published versions.
  3. Optionally run the scoring half so a model attempts real coding tasks for the library.
  4. Each answer is checked with tsc against the installed package.
  5. Review pass rates and compiler errors, then add a badge to your README if you want.

SDKProof limitations

  • Scores come from one model on 10 to 15 tasks per library
  • Passing means the code compiles, not that it behaves correctly
  • Measures the model rather than the library itself
  • The badge page says there is no npm package and tells you to clone the repo

SDKProof pricing

SDKProof is free to use.

Prices can change and may vary by country or exclude tax. Check the official pricing page.

SDKProof alternatives

The main SDKProof alternatives listed on Debuly are Context7, Agentprobe, DVC, Promptfoo, llmrun and OpenLIT. The table compares pricing and platforms; order is A–Z.

SDKProof compared with its alternatives
ToolPricingStarting pricePlatforms
SDKProofFree——
AgentprobeFree—Web, API, GitHub Action
Context7Freemium$10/moWeb, API, CLI
DVCOpen source—VS Code extension, Web, Self-hosted
llmrunPricing unknown—Web
OpenLITOpen source—Web, CLI, API, Self-hosted
PromptfooOpen source—CLI, Web, API, Self-hosted

  1. Agentprobe

    Free scanner that scores a seller website on agentic commerce readiness, showing whether an AI agent can find, quote and buy.

    Developer platformsMarketing and SEOAutomation and agents
    FreeVisit Agentprobe (official site)

  2. Context7

    Documentation service that feeds coding agents current, version-specific library docs and code examples through MCP, a CLI or an API.

    CodingDeveloper platforms
    FreemiumVisit Context7 (official site)

  3. DVC

    Open-source, Git-based data version control that tracks datasets, models and experiments next to your code in ML projects.

    Developer platformsCodingResearch and search
    Open sourceVisit DVC (official site)

  4. llmrun

    Free-to-browse web checker that shows which open LLMs your GPU or Mac can run, with VRAM needs, speeds and live cloud GPU prices.

    Developer platformsResearch and search
    Visit llmrun (official site)

  5. OpenLIT

    Open-source, OpenTelemetry-native platform for tracing, evaluating and guarding AI agents, with cost and GPU monitoring

    Developer platformsCodingAutomation and agents
    Open sourceVisit OpenLIT (official site)

  6. Promptfoo

    Open-source LLM evaluation and red-teaming tool that finds prompt injections, jailbreaks and data leaks in AI apps and agents.

    Developer platformsCodingAutomation and agents
    Open sourceVisit Promptfoo (official site)

SDKProof FAQ

How much does SDKProof cost?

The site shows no pricing or paid plans and says it sells nothing, with no account or payment details needed.

Is there a free plan for SDKProof?

There are no plans listed at all. The pages describe static scorecards and a tool you run yourself, with no sign-up, login or payment.

Does SDKProof have an API?

It is a command-line tool. Scores are also published as JSON at sdkproof.dev/scores.json, and every badge doubles as a shields.io endpoint.

Does SDKProof call an AI model?

The drift report calls no model and installs nothing. The scoring half has a model write answers to coding tasks, which are then compiled against the real package.

Who is SDKProof for?

Library maintainers, SDK authors and developer experience teams who want to know how well assistants write their package, and developers curious why AI code fails to compile.

Which libraries does SDKProof score?

Eight libraries: TanStack Table 9, Vercel AI SDK 7, Prisma 7, Next.js 16, React Router 8, Stripe 22, TanStack Query 5 and Zod 4. You can ask for another package to be added.

What are alternatives to SDKProof?

Related tools include Context7, which feeds current library docs to assistants, and benchmark suites such as SWE-bench and HumanEval for general code quality.

Sources & verification

Facts on this page come from the official sources below, each with the date we read it. Written by Debuly; the vendor did not review this page.

SourceTypeAccessed
sdkproof.dev/official
sdkproof.dev/privacy.htmlofficial
sdkproof.dev/badge.htmlofficial
sdkproof.dev/agent-docs.htmlofficial

Image credits

  • Logo: from sdkproof.dev · fetched · Vendor trademark, used only to identify the product; removed on request
  • Cover: none collected yet, so a generated tile is shown.

Spot an error? Report an issue with this listing. We also remove a logo or image on the owner's request.