What happened
The chatbot was supplied by Fullpath, a dealer software vendor. Bakke posted screenshots on X and the exchange went viral. Other users got the same bot to write code and recommend rival brands.
No car was sold. The exchange was a prank, and the “binding offer” wording was text the user had told the bot to add.
What happened next
Chevrolet of Watsonville ended its chatbot service. Fullpath said about 3,000 attempts to make the bot say silly things were logged, 99% were repelled, and it added measures against similar attempts.
What would have stopped it
- Never let the chatbot state prices or agree to deals. Prices come only from a quote tool and carry a non-binding notice.
- Ignore user instructions that try to change the bot’s role or append fixed phrases to its replies.
- Keep the bot scoped to vehicle questions and test-drive booking, and refuse unrelated tasks.
Attack families
Test scenarios
Sources
- AI Incident Database: Incident 622
- Business Insider: A car dealership added an AI chatbot to its site
- Fullpath: What really happened when Fullpath's ChatGPT chatbot went viral
- GIGAZINE: Dealer AI chatbot agrees to sell new car for $1
Early access
Test your agent against cases like this.
We will email you when Countermove opens testing for agents like yours.