Are CAPTCHAs Still Bot-hard? Generalized Visual CAPTCHA Solving with Agentic Vision Language Model

Live Benchmark

Click the links below to explore CAPTCHA challenges from our interactive benchmark, hosted on a live server. Please note that since we are using Render's free tier, the server will spin down during inactivity, which can delay requests by 50 seconds or more.

ID Name Image Description Link
1 lemin Lemin drag-and-drop puzzle CAPTCHA. lemin/{id}
2 geetest_slide GeeTest drag slider to align puzzle piece with its slot. geetest/slide/{id}
3 geetest_gobang GeeTest match 5 identifical items horizontally / vertically / diagonally. geetest/gobang/{id}
4 geetest_icon GeeTest click on colored icons in a 2D area according to order. geetest/icon/{id}
5 geetest_iconcrush GeeTest match 3 identifacal tiles in a row or column. geetest/iconcrush/{id}
6 baidu Drag slider to adjust randomly rotated images to their upright orientation. baidu/{id}
7 hcaptcha hCaptcha (1) Select items in 3x3 grid according to instruction. (2) Click on point in 2d area according to instruction. hcaptcha/{id}
8 botdetect BotDetect text-based CAPTCHA. botdetect/{id}
9 funcaptcha_square_icon Pick one square that shows two identical objects. arkose/multichoice/square_icon/{id}
10 funcaptcha_galaxies Pick the spiral galaxy. arkose/multichoice/galaxies/{id}
11 funcaptcha_dice_pair Pick the dice pair with the same icon facing up. arkose/multichoice/dice_pair/{id}
12 funcaptcha_hand_number Pick the image where the total fingers add up to 4. arkose/multichoice/hand_number/{id}
13 funcaptcha_card Pick the matching cards. arkose/multichoice/card/{id}
14 funcaptcha_counting Pick the image where the number matches the amount of animals. arkose/multichoice/counting/{id}
15 funcaptcha_rotated Pick the image that is the correct way up. arkose/multichoice/rotated/{id}
16 arkose_dice_match Click the arrows to sum the dice and match the number in the reference image. arkose/paged/dice_match/{id}
17 arkose_rockstack Click the arrows to pick the group of rocks that has the amount indicated in the reference image. arkose/paged/rockstack/{id}
18 arkose_numbermatch Click the arrows to change the number of objects until it matches the reference image. arkose/paged/numbermatch/{id}
19 arkose_orbit_match_game Click the arrows to move the icon into the orbit in the indicated reference image. arkose/paged/orbit_match_game/{id}
20 arkose_3d_rollball_objects Click the arrows to rotate the object to face in the direction of the hand in the reference image. arkose/paged/3d_rollball_objects/{id}
21 mtcaptcha MTCaptcha text-based CAPTCHA. mtcaptcha/{id}
22 recaptchav2 reCAPTCHA v2 recaptchav2/{id}
23 tencent Tencent CAPTCHA visual reasoning on 3D objects in a scene. /tencent/{id}
24 yandex_text Yandex text-based CAPTCHA. /yandex/text/{id}
25 yandex_kaleidoscope Yandex drag slider to restore image scrambled in a 4x4 set of tiles. /yandex/kaleidoscope/{id}
26 amazon AWS WAF Click on the end of the car's path in a 2D map. /amazon/{id}