Why spam still gets past your CAPTCHA: solving services and AI
You installed a CAPTCHA and the spam kept coming, just a little less. That is not bad luck or a broken setup. Getting past a CAPTCHA is a cheap, well-organised business, and researchers have been measuring it for more than a decade.
The short answer
If spam reaches you through a CAPTCHA, the CAPTCHA was solved, either by software or by people paid a tiny amount per puzzle. Researchers found human solving services selling solutions for around one dollar per thousand as early as 2010 [1], and by 2023 automated attacks solved most CAPTCHA types more accurately than people [3]. A CAPTCHA adds a small cost for spammers; it doesn’t stop them.
Why your CAPTCHA lets spam through
A CAPTCHA only asks: "can whoever is sending this solve the puzzle?". For a spammer, that is a technical problem with two well-known solutions: software that solves the puzzle, or a person who solves it for them. Both are sold as services.
Human solving services
A spam bot fills in your form, and when it meets the CAPTCHA it forwards the puzzle to a solving service. A worker somewhere sees the image, answers it within seconds, and the bot submits your form with the correct answer. To your website it looks exactly like a person solved it, because a person did.
Researchers at UC San Diego studied this market in detail and found solutions sold at retail for around one dollar per thousand, with the workers earning a small fraction of that [1]. In their tests, most services solved the CAPTCHAs of popular websites correctly more than 70% of the time, within about 20 seconds [2]. At those prices, sending thousands of spam messages through a CAPTCHA costs a spammer a few dollars.
Software solvers and AI
For many CAPTCHA types, spammers no longer need people at all. The 2023 study of modern CAPTCHAs compared human results with the best published attacks [3]:
- Distorted text: machines reach 99.8% accuracy in under a second; people managed 50–84%.
- reCAPTCHA checkbox: 100% accuracy in about 1.4 seconds, using automatically created "trusted" cookies [4].
- hCaptcha images: 98% for an attack, against 71–81% for people.
- Audio challenges: defeated with ordinary speech recognition [5].
Even Google's invisible reCAPTCHA v3, which scores visitors instead of showing puzzles, has been gamed: researchers reported an attack that earned high "human" scores 97% of the time [5].
Why a harder CAPTCHA doesn’t help
The natural reaction is to turn the CAPTCHA up to its hardest setting. The research shows why that backfires: on hCaptcha's difficult setting, human accuracy fell from 81.4% to 70.6% [3], while attackers simply adapt. A harder puzzle mostly moves the cost from the spammer to your customers. What people who give up cost you is covered in is CAPTCHA costing you customers?
What actually stops it
The answer is checks that don't depend on anyone solving anything, run on your own server where spammers can't see them:
- A signed, one-time token issued when a real visitor starts the form. Bots that post straight to your form's address don't have one, and a copied token works only once.
- A minimum time between opening the form and sending it.
- A hidden trap field that automated form-fillers fill in.
- Link rules, because most spam exists to place links.
- A rate limit per visitor, which stops floods, including from paid human spammers.
- A spam log, so you can see what was blocked and why.
Nothing automatic can stop a real person who is paid to paste an advert into your form. But rate limits and link rules make it slow and unprofitable, and none of it costs your customers anything. See how to stop bots from submitting your contact form.
Common questions
Why do I get spam that looks written by a real person?
Because often it is: either typed by a paid worker, or written by AI and sent by a bot that got past the CAPTCHA through a solving service [1]. Rate limits and link rules are what slow this kind of spam down.
Is my reCAPTCHA set up wrong?
Probably not. Spam getting through a correctly installed CAPTCHA is expected: automated attacks and solving services are designed to pass it [3][1]. Also check that your form doesn’t accept submissions sent directly to its address without the CAPTCHA being checked on the server.
Would switching to hCaptcha or another CAPTCHA help?
Not much. The same solving services and attacks cover the popular CAPTCHA types, and published attacks solve hCaptcha with 98% accuracy [3].
Is it legal for these services to exist?
They operate openly in many places and describe themselves as data-entry or accessibility services. Whatever their legal status where you are, you can’t rely on them disappearing, so rely on protection they can’t buy their way past.
Sources
Numbers in this guide come from these studies and publications. Links open the original.
- Re: CAPTCHAs – Understanding CAPTCHA-Solving Services in an Economic ContextMotoyama, Levchenko, Kanich, McCoy, Voelker, Savage (UC San Diego). USENIX Security Symposium, 2010
- How Secure is Your Website? A Comprehensive Investigation on CAPTCHA Providers and Solving ServicesarXiv, 2023
- An Empirical Study & Evaluation of Modern CAPTCHAsSearles, Nakatsuka, Ozturk, Paverd, Tsudik, Enkoji (UC Irvine, ETH Zürich, Microsoft). USENIX Security Symposium, 20231,400 participants solved 14,000 CAPTCHAs; 200 popular websites inspected. Participants were paid online workers.
- I am Robot: (Deep) Learning to Break Semantic Image CAPTCHAsSivakorn, Polakis, Keromytis (Columbia University). IEEE European Symposium on Security and Privacy, 2016
- Dazed & Confused: A Large-Scale Real-World User Study of reCAPTCHAv2Searles, Prapty, Tsudik (UC Irvine), 202313 months, more than 3,600 real users who did not know they were being studied.