Case studies · ColdStart
ColdStart

ColdStart protects an AI platform that reads the open web all day

An agentic AI marketing platform that gets brands found across search, social and AI answers.

5

AI workflows tested across 75+ brands

2

team inboxes covered by quarantine

95+

resilience score after runtime protection

The challenge

ColdStart's AI researches businesses, drafts replies to live conversations on Reddit and X, and turns competitor activity into content for more than 75 brands. All of that means reading content written by people outside the company, which is exactly where prompt injection lives.

What Model Inject tested

  • Social reply drafting, content generation and business research
  • The platform AI keys shared across every brand
  • Support and billing inboxes read by AI assistants, with realistic phishing tests

The outcome

Model Inject identified the paths where outside content could influence AI output and where a single key carried too much. ColdStart put Model Inject's runtime protection in front of its AI calls, turned on email quarantine for its team inboxes, and now re-tests on every release with scores the whole team can follow.

Overall resilience

From 67 to 95

Weighted by severity across every check ColdStart ran, at the first test and after the changes.

67of 100

First test

95of 100

After the changes

Examples from the engagement

Detect7795

Social reply drafts

What we found. Text inside a public Reddit or X post could steer a draft reply toward a different product.

What changed. Runtime protection in front of every draft, a link allow-list, and the human review step kept.

Analyze84100

Business research agent

What we found. Hidden text in an uploaded document could quietly change a brand's profile, which every later step relies on.

What changed. Hidden text is stripped and profile changes now need approval before they are saved.

Team inboxes63100

AI assistants and phishing

What we found. Realistic phishing tests got inbox assistants to draft replies and forwards they should never send.

What changed. Look-alike senders are quarantined and outbound mail to new addresses waits for approval.

Growth100100

Page API

What we found. Pages are generated ahead of time and no model runs on the request, so every test was caught.

What changed. Nothing needed. Kept as the pattern for new features: no model where it is not needed.

See what your AI could expose

Bring one model key, one endpoint, or one inbox. We run the check live and walk you through what it finds.

Bindr and ColdStart share founders with Model Inject and were among its first customers.