Connect Clawsmith to your coding agent. Ship products like crazy.Unlimited usage during betaGet API Key →
← Back to ideas
clawsmith.com/idea/validate-and-test-openclaw-plugins-before-publish
IdeaUnderservedCLIOPEN-SOURCEDEVTOOLLive

A CLI tool that validates, tests, and dry-runs OpenClaw plugins in an isolated sandbox before publishing to ClawHub

OpenClaw's plugin ecosystem ships broken packages to production. The Brave plugin v2026.5.2 went live with only TypeScript source and no compiled dist/, crashing every gateway that installed it into an unrecoverable 1.2-second restart loop. Four separate GitHub issues filed for the same root cause. The new defineToolPlugin SDK (v2026.5.18) gives plugin authors a typed API, but there is no validation step between writing a plugin and publishing it to ClawHub where 44,000+ skills live. This tool runs a full lifecycle check in an isolated container: schema validation, build verification, dependency audit, gateway integration test, and provider registration smoke test. It catches the exact class of bugs that took down Brave search users.

Demand Breakdown

GitHub
68

Gap Assessment

UnderservedExisting solutions leave gaps. Underserved market

2 tools exist (openclaw plugins validate (built-in), qa-patrol (community plugin)) but gaps remain: No build verification (doesn't check if dist/ exists), no integration test (doesn't boot a gateway), no pre-publish tarball check. Misses the entire class of 'source-only publish' bugs.; Tests agent behavior, not plugin packaging. Doesn't validate plugin build artifacts or catch provider registration failures..

Features3 agent-ready prompts

Schema and build validator that checks plugin manifest, verifies compiled dist/ exists, and catches missing exports before publish
Docker-based integration test runner that boots a disposable OpenClaw gateway, installs the plugin, and verifies provider registration succeeds without crashes
Pre-publish dry-run that simulates npm publish, compares the tarball contents against what the manifest declares, and blocks publish if dist/ is missing

Competitive LandscapeFREE

ProductDoesMissing
openclaw plugins validate (built-in)Basic manifest validation via the CLI. Checks JSON structure and required fields.No build verification (doesn't check if dist/ exists), no integration test (doesn't boot a gateway), no pre-publish tarball check. Misses the entire class of 'source-only publish' bugs.
qa-patrol (community plugin)AI-powered QA testing skill for OpenClaw. Automated browser testing with 39 bug patterns.Tests agent behavior, not plugin packaging. Doesn't validate plugin build artifacts or catch provider registration failures.

Sign in to unlock full access.