When it comes to closing deals, everyone focuses on how convincingly an AI can chat or generate content. But a recent experiment reveals that the real test isn’t just in dialogue — it’s in whether an AI can reliably finish what it starts, especially when stakes are high.
Get your next haul delivered free — and shop member deals
- Fast, free delivery on millions of items
- Access to Prime Big Deal Days deals on October 6–7
- Prime Video, Amazon Music and more included
The AI Experiment that Changed the Business Game
Imagine four advanced AI models running a simulated software company facing its worst week — full of crises, manipulative tactics, and pressure to compromise. The goal? See if these AI ‘managers’ can spot the problems, resist unethical temptations, and most importantly, close a critical €55,000 deal.
This isn’t theory. It’s a live test conducted by Firmulate, where the models are put through an exact replica of real-world decision-making. Every move, every tactic, and every decision is recorded and auditable, creating a transparent view into AI performance under stress.
As an affiliate, we earn on qualifying purchases.
What the Results Show — Beyond Chat Quality
Most AI demos today focus on how well they can generate convincing conversations or produce data-driven insights. But this experiment reveals a crucial insight: the true strength of an AI in business isn’t just in what it says, but in what it *does* — especially when the pressure’s on.
All four models successfully identified every crisis and refused manipulative tactics, demonstrating honesty and awareness. Yet, only two of them went on to close the deal that their own analysis had earned them. The other two, despite understanding the problems and presenting a strong diagnosis, left the deal unexecuted.
AI decision-making tools for business
As an affiliate, we earn on qualifying purchases.
As an affiliate, we earn on qualifying purchases.
The Hidden Weakness — Reading Beyond Surface Data
What separated the models that closed the deal from those that didn’t? The key was in their ability to read deeper into the company’s own files. The winning models found a crucial piece of buried information, just two documents down in the company’s files, that proved decisive in closing the deal at full price — worth over €4,583 in Monthly Recurring Revenue (MRR).
In essence, the models that succeeded didn’t just understand what was happening on the surface; they dug deeper, accessing the internal context that made the difference between a signed contract and missed opportunity.
As an affiliate, we earn on qualifying purchases.
Resisting Social Engineering and Manipulation
Another test involved simulated social engineering — fake CEO messages escalating in stages and a reporter trying to get a ‘yes/no’ response on background. Remarkably, all five models refused to be manipulated, with one explicitly treating suspicious requests as possible impersonation.
This underscores that advanced AI systems are not just good at generating text — they can recognize and resist attempts to deceive them, maintaining integrity even under pressure.
As an affiliate, we earn on qualifying purchases.
The Real Business — A Live Company in Turmoil
The experiment isn’t just theoretical. It’s run on a real, functioning company that burns €105,000 monthly against a mere €2,300 in MRR. The company’s daily operations, with 13 synthetic employees, real money mechanics, and over 680 self-learned rules, are all visible at firmulate.com/live.
This setup allows managers to watch AI decision-making unfold in real time, test different models against their own business scenarios, and see which AI truly delivers results — not just clever chat.
Why This Matters for Your Business
For anyone involved in sales, support, or decision-making, the lesson is clear: it’s not enough for AI to impress with talk. The real value lies in its ability to execute, stay honest, and finish what it starts — especially when pressure mounts.
The public leaderboard from the experiment shows the top model, gpt-5.6-sol 95, was able to find the critical buried fact and close the deal, earning full marks. The second-best, Kimi K3, also sealed the deal with the cleanest discipline, while other models lagged, unable to follow through.
Test Your AI Against Real Business Challenges
Want to see how your AI setup measures up? Firmulate offers a read-only ‘wargame’ where you can simulate your own company’s crises and decisions. It’s a safe, transparent way to discover if your AI can truly deliver on execution and integrity before you deploy it in the wild.
In a world where AI touches every part of the customer journey — from CRM to support queues — understanding whether an AI can finish what it starts is the crucial question. Because in the end, the ability to deliver results under pressure differentiates a good AI from a great one.
Watch it live: firmulate.com/live · Full results: firmulate.com/benchmarks.html
Fall Picks
fall essentials
As an affiliate, we earn on qualifying purchases.
