A CLI tool that isolates flaky tests locally before they reach CI

Flaky tests that only surface in CI cost engineering teams hours of re-run cycles and erode confidence in the entire test suite. Existing tools like BuildPulse and Trunk require cloud connectivity and catch flakiness after it has already contaminated the main branch. This CLI runs locally, detects non-deterministic tests on the developer's machine before a push, and quarantines or flags them so only stable tests gate the build.

Demand Breakdown

120

Issues

Social Proof 2 sources

The Hidden Costs of Flaky Tests - widely shared dev ops engineering post 2025

@ecosystem4engineering · 2025-11-01

120 GH

GitLab Flaky Test Intervention tracking issue - active CI quality concern

@GitLab Engineering · 2025-09-01

Gap Assessment

CompetitiveMultiple tools exist but differentiation opportunities remain

3 tools exist (BuildPulse, Trunk Flaky Tests, Datadog CI Visibility) but gaps remain: No local CLI mode; requires cloud connectivity and CI integration before flakiness is visible; catches flakiness after it has already reached the shared pipeline, not before the push.; Cloud-only detection loop; the Trunk Analytics CLI uploads to their cloud, it does not run isolation logic locally; flakiness is identified only after CI run data accumulates in their backend, not on the developer's machine pre-push..

Features6 agent-ready prompts

Local multi-run flakiness detector

▶

Pre-push git hook integration

▶

Quarantine registry

▶

CI integration reporter

▶

Root cause classifier

▶

Team config and baseline sharing

▶

Competitive LandscapeFREE

Product	Does	Missing
BuildPulse	Cloud SaaS dashboard that ingests CI test results via a GitHub Action reporter, tracks flaky test history, and quarantines known flaky tests from blocking builds.	No local CLI mode; requires cloud connectivity and CI integration before flakiness is visible; catches flakiness after it has already reached the shared pipeline, not before the push.
Trunk Flaky Tests	CI reliability platform (backed by a16z, $40M Series B) that receives test run uploads from CI via the Trunk Analytics CLI, detects flaky patterns across runs, and auto-quarantines offending tests.	Cloud-only detection loop; the Trunk Analytics CLI uploads to their cloud, it does not run isolation logic locally; flakiness is identified only after CI run data accumulates in their backend, not on the developer's machine pre-push.
Datadog CI Visibility	Enterprise observability platform with a CI Visibility module that surfaces flaky test rates across branches and correlates them with infrastructure signals.	Requires full Datadog stack; priced for enterprise teams; no developer-side local pre-push isolation; overkill for teams that just want to gate their own push.