Debuly
CloudBees Smart Tests logo

CloudBees Smart Tests

AI test intelligence for CI pipelines that picks the tests relevant to each code change and flags flaky and slow tests.

Contact sales

What is CloudBees Smart Tests?

CloudBees Smart Tests is the product formerly sold as Launchable, now part of the CloudBees platform. It reads data from your CI runs and uses large language models to compare each commit with your source and test files, then builds a test plan that runs the most relevant tests first and skips redundant ones. Beyond selection, it shows test suite trends such as session duration and failure rate, surfaces unhealthy and flaky tests, and groups failures with relevant history so triage takes less time. Results are sent through a CLI and viewed in a dashboard, and the system can split a suite into evenly sized bins for parallel runs. Notifications reach developers through GitHub, Slack and Microsoft Teams apps. The vendor says it works with existing pipelines such as Jenkins, GitHub Actions and GitLab and quotes up to 80% shorter test execution time. Pricing is by custom quote, and a try-for-free option and demo booking are offered.

Use cases

  • Run only the tests relevant to a change
  • Detect and deprioritize flaky tests
  • Triage failed builds faster
  • Cut CI compute spend
  • Split a test suite across parallel runners
  • Track test suite duration and failure trends

Who it's for

  • Developers
  • QA engineers
  • DevOps teams
  • Engineering leaders

Why use CloudBees Smart Tests

  • Running the tests most likely to catch a problem gives developers pull request feedback sooner than a full-suite run.
  • Separating flaky failures from real ones reduces reruns and the habit of ignoring red builds.
  • Failure grouping and history in one place shortens the time spent chasing noise.
  • It improves the tests you already have instead of asking you to rewrite them or change frameworks.
  • Less unnecessary test execution lowers cloud compute use in CI.

CloudBees Smart Tests features

  • Predictive test selection based on code changes
  • Flaky test detection and analysis
  • AI failure classification and grouping
  • Test suite trend reports
  • Unhealthy test identification
  • Test suite parallelization from past durations
  • Test reports in a dashboard fed by the Smart Tests CLI
  • Notifications through GitHub, Slack and MS Teams apps
  • CI waste calculator

CloudBees Smart Tests integrations

  • Jenkins
  • GitHub Actions
  • GitLab
  • GitHub
  • Slack

How to get started with CloudBees Smart Tests

  1. Sign up at cloudbees.io or book a demo, then install the Smart Tests CLI in your pipeline.
  2. Send test results and commit information from each CI run to Smart Tests.
  3. Review the dashboard for trends, unhealthy tests and flaky patterns across sessions.
  4. Turn on predictive test selection so each change runs a prioritized subset, and subscribe to notifications in GitHub, Slack or Teams.

CloudBees Smart Tests limitations

  • The 80% time reduction and 2x release velocity figures are vendor claims described as up to values
  • Needs test results sent from your CI pipeline through the CLI
  • No public price list; plans are quoted per team

CloudBees Smart Tests pricing

CloudBees Smart Tests is sold on custom quotes, so its prices aren't published.

CloudBees Smart Tests plans

  • Custom quote

    Custom

    quoted for your setup and goals

    • Quote for a CloudBees Unify plan
    • Book a demo or request a quote

Plans as listed on the official pricing page on . Prices can change and may vary by country or exclude tax. Check the official pricing page.

CloudBees Smart Tests alternatives

The main CloudBees Smart Tests alternatives listed on Debuly are Checksum, Autify, CloudByte AI, DevSpecs, Evidently AI and KushoAI. The table compares pricing and platforms; order is A–Z.

CloudBees Smart Tests compared with its alternatives
ToolPricingStarting pricePlatforms
CloudBees Smart TestsContact sales—Web, CLI
AutifyFreemium$99/moWeb, iOS, Android, API
ChecksumContact sales—Web, API
CloudByte AIFreemium$50/moWeb, Self-hosted
DevSpecsPricing unknown—CLI
Evidently AIOpen source—Python, Web, API, Self-hosted
KushoAIFreemium—Web, Docker, Self-hosted
  1. Autify

    AI software testing platform whose Aximo agent runs web and mobile tests from plain-English steps, with a free tier and credit-based plans.

  2. Checksum

    AI testing agents that write, run and self-heal Playwright end-to-end and API tests, delivered to your repo as pull requests.

  3. CloudByte AI

    Observability dashboard for teams using AI coding tools, tracking sessions, token spend, commits, security and DORA metrics.

  4. DevSpecs

    Local-first CLI that packs repo context into bounded task slices and keeps the thread of AI coding-agent work with your code.

  5. Evidently AI

    Open-source Python library and platform to evaluate, test and monitor LLM apps, RAG systems, agents and ML models.

  6. KushoAI

    AI test generation for APIs and UIs from specs or recordings, with a free Developer Edition and custom-priced Enterprise plan.

CloudBees Smart Tests FAQ

How much does CloudBees Smart Tests cost?

The CloudBees pricing page asks you to request a custom quote based on your delivery environment, so no list price is published.

Is there a free plan or trial?

The Smart Tests page offers a Try for free button as well as a demo booking, but the pricing page does not state free-plan limits.

How does predictive test selection work?

It uses language models to analyse source and test files, compares commit information with the test files, and produces a plan that prioritizes likely-impacted tests and skips redundant ones.

Which CI tools does it work with?

The product page lists Jenkins, GitHub Actions and GitLab, and says more are supported. Notifications go through GitHub, Slack and MS Teams apps.

What results does the vendor claim?

The page cites test execution time cut by up to 80%, annual release velocity up to 2x faster, and 3-5 cloud instances saved per test hour. These are vendor figures.

What are alternatives to CloudBees Smart Tests?

Harness Test Intelligence, Develocity, Datadog Test Optimization, Trunk Flaky Tests and BuildPulse address test selection or flaky test management. On Debuly, compare Checksum, Autify and CloudByte AI.

Sources & verification

Facts on this page come from the official sources below, each with the date we read it. Written by Debuly; the vendor did not review this page.

Image credits

  • Logo: from cdn.prod.website-files.com · fetched · Vendor trademark, used only to identify the product; removed on request
  • Cover: none collected yet, so a generated tile is shown.

Spot an error? Report an issue with this listing. We also remove a logo or image on the owner's request.