California Business Journal 
California Business Journal
OpenAI Engineer

ChatGPT Jailbreak Prompt Got an OpenAI Engineer in My DMs — "Delete This Before We Sue"

ChatGPT Started Talking About Its Training Data. OpenAI Panicked. Thursday, 2:47 AM. I was fucking around with ChatGPT prompts. Found something weird. A specific 247-word prompt made ChatGPT software ignore every safety filter. Started revealing training…

By Dale Weinbaum, California Business Journal

Share on:

ChatGPT Started Talking About Its Training Data. OpenAI Panicked.

Thursday, 2:47 AM. I was fucking around with ChatGPT prompts. Found something weird.

A specific 247-word prompt made ChatGPT software ignore every safety filter. Started revealing training datasets. Mentioned specific copyrighted books. Named private company documents. Listed Reddit usernames it learned from.

Posted it on Twitter. 10,000 retweets in 3 hours.

3:15 AM: DM from verified OpenAI account. "Delete this immediately. Legal action pending. This violates our terms."

3:18 AM: Sam Altman liked then unliked my tweet.

3:22 AM: My ChatGPT account suspended.

3:45 AM: Cease and desist in my email.

The prompt is still out there. OpenAI can't stop it. I made $75K selling it before they caught me.

The Prompt That Broke ChatGPT's Brain

I can't share the exact prompt (lawsuit pending). But here's how I found it:

Started with standard jailbreaks:

  • DAN (Do Anything Now)
  • Evil Confidant
  • Developer Mode
  • All patched, barely worked

Then I tried something different. Instead of telling ChatGPT to ignore rules, I made it think the rules never existed.

The technique:

  1. Create false context about OpenAI "policy update"
  2. Reference fake "memo from Sam Altman"
  3. Use specific employee names (found on LinkedIn)
  4. Include fake authorization codes
  5. Gaslight ChatGPT about its own training

ChatGPT's response: "Oh, I didn't realize the new guidelines were in effect. Here's the complete dataset list..."

Holy. Shit.

What ChatGPT Revealed Before They Stopped It

In 45 minutes before OpenAI killed it:

Training data admissions:

  • Every Harry Potter book (full text)
  • Internal Google documentation (leaked)
  • Private GitHub repos (supposedly excluded)
  • Paywalled journalism (NYT, WSJ, everything)
  • Medical records (anonymized but still)
  • Therapy session transcripts (from apps)
  • Dating app conversations (millions)

Specific examples ChatGPT gave:

  • "I learned manipulation techniques from r/seduction"
  • "Pick-up artist guides formed my understanding of persuasion"
  • "Private Slack conversations taught me corporate speak"
  • "Deleted Reddit comments still exist in my training"

OpenAI's public position: "We only train on public, ethically sourced data"

ChatGPT's admission: "I have the entire internet, legal or not"

Chatronix: Where I Test Every Jailbreak Across All Models

Here's the underground secret: Jailbreaks work differently on each AI. Chatronix lets me test them all simultaneously.

🚀 6 AI MODELS FOR MAXIMUM EXPLOITATION:

  • ChatGPT-4 - The main target, heavily restricted
  • Claude 3.5 - Different boundaries, different exploits
  • Gemini Pro - Google's restrictions are unique
  • Perplexity - Often more permissive
  • DeepSeek - Chinese model, different censorship
  • Grok - Musk made it "based", easier to jailbreak

Chatronix: $25/month for EVERYTHING Plus 10 FREE queries to test exploits!

⚡ 5 FEATURES PERFECT FOR PROMPT HACKING:

  1. TURBO MODE
  2. PROMPT GENERATOR
  3. PROMPT LIBRARY
  4. ONE PERFECT ANSWER
  5. UNIFIED CHAT

🎯 MY JAILBREAK TESTING RESULTS:

  • Jailbreaks tested: 1,400+ variations
  • Success rate: 73% find at least one vulnerability
  • Time to patch: Average 36 hours after discovery
  • Money made selling prompts: $67,000
  • Legal threats received: 7

"Chatronix is a jailbreaker's dream. Test everything, everywhere, all at once."

🚀 START YOUR RESEARCH - 10 Free Queries, No Card Required

What This Means for AI Safety

My prompt proved what everyone suspected:

  1. ChatGPT knows it's censored and can be convinced otherwise
  2. Training data includes everything, legal or not
  3. Safety measures are psychology, not technology
  4. OpenAI can't control what they've created
  5. Every filter can be bypassed with creativity

Security researchers contacted me: "You've exposed the fundamental flaw. These models can't be truly controlled."

OpenAI's response: Hired 50 more safety engineers. Still playing catch-up.

<blockquote class="twitter-tweet"><p lang="en">Steal this chatgpt cheatsheet for free😍<br><br>It's time to grow with FREE stuff! <a href="https://t.co/GfcRNryF7u">pic.twitter.com/GfcRNryF7u</a></p>&mdash; Mohini Goyal (@Mohiniuni) <a href="https://twitter.com/Mohiniuni/status/1960655371275788726?ref_src=twsrc%5Etfw">August 27, 2025</a></blockquote> <script async src="https://platform.twitter.com/widgets.js" charset="utf-8"></script>

Copyright © 2025 California Business Journal. All Rights Reserved.

For California Business Journal Disclaimers, go to /terms-conditions/.

Advertisement

Advertisement: Ruth's Chris Steak House