Startup Ideas

How to score your next startup idea before you build it

Li LiuJul 17, 20269 min read
Score every candidate on 5 axes, demand, money, competition gap, build effort, and distribution, 0 to 3 points each, 15 max. Build only if the total clears 10 and demand scores at least 2. Kill anything scoring 0 on competition no matter how high the rest runs. Three real ideas pulled from Clawsmith score 9, 10, and 6, landing in watch, build, and kill.
How to score your next startup idea before you build it. Dark editorial illustration.

Score every candidate on the same 5 axes before you touch code

You already have 2, 5, maybe 10 ideas sitting in a notes app. The question isn't where to find another one, it's which of the ones you already have is worth a month of your life. Browse live demand signals if you want to add to that shortlist, but the actual job here is ranking what's already on it.

Score each candidate on 5 axes, 0 to 3 points per axis, 15 points max: demand evidence, monetizability, competition and gap, build effort, and distribution reach. Add the 5 numbers. Build the one that clears 10 total with a demand score of at least 2. Kill anything that scores a 0 on competition, no matter how high the rest of the total runs. Everything in between goes on a 30 to 60 day watch list.

The rubric: what a 3 looks like versus a 1, per axis

Each axis has a hard definition per point value. Pull real numbers for each one before you score it, don't eyeball it.

Axis0 points1 point2 points3 points
Demand evidenceNo verifiable engagement, or a single anecdote under 20 combined reactions1 source, 20 to 300 combined reactions (one repo or one thread)2 to 3 independent sources across different platforms, 300 to 1,000 combined reactions4 or more independent sources across 3 or more platforms, 1,000 or more combined reactions
MonetizabilityEvery comparable product in the space is free or open source, zero pricing precedent1 weak paid precedent, early-stage or unclear pricing2 or more funded or bootstrapped competitors charging in an adjacent category, no direct comp in this exact nicheDirect paid comps at a proven price point in this exact niche, a named dollar figure from a funding round, acquisition, or live pricing page
Competition and gap3 or more funded or paid competitors already cover the exact feature set, no differentiated gap named1 to 2 competitors cover most of the need, gap is thinCompetitors exist but each has a named structural gap (OSS-only, no dashboard, no team management, enterprise-only pricing)No direct competitor found, only adjacent or partial tools touch the problem
Build effortMulti-quarter build needing infra a solo builder can't stand up alone (model training, hardware, heavy compliance)Several weeks, 5 or more services and integrations, ops-heavy (queueing, multi-tenant auth, billing)1 to 2 weeks on top of an existing framework or API, single deploy targetDays, one well-documented API wrapper or CLI, no infra to run
Distribution reach0 leads pulled, no named people asking for it publiclyA handful of complainers on 1 thread, no reusable listActive discussion across 2 or more dev communities with named handles you can reachCross-platform buzz plus a pulled lead list of people who already publicly asked for it

Pull the demand numbers yourself, don't trust your gut

Run these before scoring the demand axis. Each one takes under a minute.

Hacker News, via the free Algolia search API, for any candidate topic:

curl -s "https://hn.algolia.com/api/v1/search?query=agent+budget+runaway+cost&tags=story&numericFilters=points%3E50" \
  | jq '.hits[] | {title, points, num_comments, url}'

GitHub, for existing tools already solving the same problem, sorted by stars:

curl -s "https://api.github.com/search/repositories?q=agent+budget+kill+switch+OR+mcp+credential+proxy&sort=stars&order=desc" \
  | jq '.items[] | {full_name, stargazers_count, pushed_at}'

Reddit and Product Hunt, as plain search operators, no API key needed:

site:reddit.com "agent" "budget" ("runaway" OR "burned through")
site:news.ycombinator.com "AI agent" ("budget" OR "cost overrun")
site:producthunt.com "budget" "AI agent"
"agent budget" pricing site:github.com

If a candidate returns fewer than 300 combined points, stars, and reactions across these 4 checks, it's a 1 on the demand axis. If it returns nothing at all, it's a 0. Don't score a 3 off vibes.

Pull the exact same evidence through Clawsmith's MCP

Clawsmith runs these searches on a schedule already, across 12 platforms, and keeps the totals. Instead of running 4 separate manual checks, one MCP call returns a signal's combined engagement as a single virality score:

Tool: search_signals
Args: {"query": "agent budget cost overrun", "limit": 5}

Response (real, pulled 2026-07-17):
{
  "slug": "ai-coding-agent-usage-cost-no-per-task-hard-ceiling",
  "signal_type": "issue",
  "virality_score": 102,
  "topic_tags": ["ai-agent-mcp", "agent-reliability"]
}

Pull the full brief on a candidate and the tool returns every source with its own engagement count, ready to sum by hand for the demand axis:

Tool: get_idea
Args: {"idea_slug": "agent-budget-kill-switch"}

issues_solved (6 sources, real):
- HN "Uber torches 2026 AI budget on Claude Code in four months": 402 points
- HN "Are the costs of AI agents also rising exponentially?": 306 points
- GitHub dipampaul17/AgentGuard: 168 stars
- HN "Show HN: AgentGuard": 73 points
- LeanOps benchmark (200 enterprise agent deployments): 42 reactions
- HN follow-on Uber thread: 28 points

6 sources across 3 platforms, 1,019 combined points and stars. That's a 3 on the demand axis under the rubric above.

Check who already built it before you score competition

The competition axis is the one people skip, and it's the one that kills the most ideas. Run the same GitHub search from above but read every result's README, not just the star count. A 160-star repo with 1 maintainer and no dashboard is a different competitive picture than a 1,900-star repo backed by a funded security company.

For SaaS competitors with pricing pages, search the exact feature plus "pricing" or "$/mo":

"credential proxy" agents pricing
"budget enforcement" AI agents "$" per month
site:producthunt.com "kill switch" agents

Cross-reference every result against the funding and revenue signals Clawsmith already tracks for a given idea:

Tool: get_competitors
Args: {"signal_id": "<signal-uuid-or-slug>"}

That call returns a table of every existing product, what it does, what's missing, and what it charges, so the gap you're about to build into is a documented one and not a hope.

Score 3 real ideas pulled from Clawsmith, side by side

Pulled these 3 via the MCP's get_ideas and get_idea tools, all inside Clawsmith's ai_agent_mcp and dev_tool_cli categories, all with real sourced evidence.

IdeaDemandMoneyGapEffortDistributionTotalCall
MCP credential proxy (scoped, time-limited keys for agent tool calls)322119Watch
Agent budget kill switch (hard dollar and token caps that terminate runaway sessions)3131210Build
Multi-provider search aggregation proxy for agents130206Kill

MCP credential proxy, 9 total. Demand is real, 24,008 secrets were found exposed in MCP config files according to GitGuardian's 2026 report, and the Infisical/agent-vault open source project alone sits at 1,900-plus GitHub stars. But 4 competitors already exist (Infisical, OneCLI, Peta, Alter), each with a named gap, no self-serve tier for solo developers, which caps the gap axis at 2 instead of 3. The build is 8 features deep (proxy, scoping, rotation, audit log, policy engine, team roles), so effort is a 1. 9 total, real signal, not urgent yet, revisit in 30 days.

Agent budget kill switch, 10 total. Uber burned through its entire 2026 AI budget on Claude Code in 4 months, a story that hit 402 points on Hacker News alone. The only existing tools are free and open source with 1 maintainer (AgentGuard, 160 stars) or unclear pricing (MintMCP), so the gap axis hits a full 3. Nobody's proven a direct paid comp in this exact niche yet, which caps money at 1. Total of 10, demand of 3, clears both thresholds. Build.

Search aggregation proxy, 6 total. Money looks incredible on paper, Tavily sold to Nebius for $275 million in February 2026 and Exa raised a $22 million Series A charging $5 per 1,000 queries. But an open source project (Search Stack MCP) already aggregates Tavily, Serper, and SearXNG behind one MCP tool, for free, and Tavily, Exa, and SerpAPI are already funded and selling into this exact use case. Competition scores a 0. Money being a 3 doesn't matter, a 0 on competition is an automatic kill.

The go/no-go rule, written as one function

Codify it so scoring stays consistent across every candidate you run through it:

def score(demand, money, gap, effort, dist):
    total = demand + money + gap + effort + dist
    if gap == 0:
        return total, "KILL (saturated, no gap)"
    if total >= 10 and demand >= 2:
        return total, "BUILD"
    return total, "WATCH (recheck in 30-60 days)"

score(3, 2, 2, 1, 1)  # MCP credential proxy -> (9, 'WATCH (recheck in 30-60 days)')
score(3, 1, 3, 1, 2)  # Agent budget kill switch -> (10, 'BUILD')
score(1, 3, 0, 2, 0)  # Search aggregation proxy -> (6, 'KILL (saturated, no gap)')

3 rules, in order: a 0 on competition kills it regardless of total. A total of 10 or more with demand at 2 or higher builds it. Everything else goes on the watch list and gets rescored in 30 to 60 days, because virality scores move. A signal sitting at 2,506 today can double by the next scan or get undercut by a new funded competitor.

Score every idea on your shortlist the same way, in the same sitting, so the numbers are comparable to each other and not just to your mood that day. If 2 ideas both clear 10, ship the one with the higher demand score first, since that's the axis that predicts whether anyone shows up on day 1. Check pricing once you've picked a winner and want the full feature prompts and lead list for the build, or keep browsing the startup ideas category for more candidates to add to the shortlist before you score the next round.

FAQ

How is scoring a shortlist different from finding a startup idea in the first place?

Finding an idea means sourcing raw demand from scratch, reading complaints until a pattern shows up. Scoring means you already have 2 to 10 candidates and need one number per idea to rank them. The 5-axis rubric below turns a gut call into 15 points split across demand, money, competition gap, build effort, and distribution, so 2 ideas that both feel promising can be told apart on paper. Do the sourcing first, then run every survivor through this rubric before you write a line of code.

What's a good total score to greenlight a build?

Build when the total hits 10 or more out of 15 and the demand axis alone scores at least 2. In the worked example below, the agent budget kill switch idea hit exactly 10 (3 demand, 1 money, 3 gap, 1 effort, 2 distribution) and got the build call. A 9 or below with real demand isn't dead, it goes on a 30 to 60 day watch list instead of a hard no.

How many demand sources do I need before I trust a signal?

4 or more independent sources across at least 3 platforms, with combined engagement over 1,000, earns the full 3 points on the demand axis. 1 source under 300 combined reactions is a 1, worth watching but not enough alone. The agent budget kill switch idea had 6 sources (HN, GitHub, an industry blog) totaling 1,019 combined points and stars, which is what pushed it to a 3.

Should I ever build something that scores 0 on competition?

No. A 0 on the competition and gap axis means 3 or more funded or paid competitors already cover the exact feature set with no differentiated angle, and that kills the idea regardless of the total score. The search aggregation proxy example below scored 6 out of 15 overall but the competition axis alone was 0, because a free open source project already ships the same fanout and caching. Total score never overrides a 0 on this axis.

How often should I rescore a shortlist?

Rescore anything on the watch list every 30 to 60 days, since demand and competition both move. A signal sitting at a 2,506 virality score today can climb past 5,000 or get undercut by a new funded competitor within a quarter. Pull fresh numbers from the same sources each time rather than trusting the old score, and only re-run the full rubric on ideas still in your shortlist, not the ones you already killed.

Sources

  1. 01The State of Secrets Sprawl 2026: AI-Service Leaks Surge 81% and 29M Secrets Hit Public GitHubgitguardian.com
  2. 02Infisical/agent-vaultgithub.com
  3. 03dipampaul17/AgentGuardgithub.com
  4. 04Nebius Agrees to Buy AI Agent Search Company Tavily for $275 Millionbloomberg.com
  5. 05Uber torches 2026 AI budget on Claude Code in four monthsnews.ycombinator.com

Keep reading

Find what to build next

Clawsmith reads real posts across the web, finds the demand, and hands your coding agent a full build brief. Free to start.

Try Clawsmith
See a live idea