From 621132476d28cd25357e980d1cb9d7503e9ae8d2 Mon Sep 17 00:00:00 2001 From: reacher-z Date: Mon, 27 Jul 2026 20:34:58 +0800 Subject: [PATCH] Add ClawBench to GUI agent benchmarks --- README.md | 1 + 1 file changed, 1 insertion(+) diff --git a/README.md b/README.md index 2616d5d..b470006 100644 --- a/README.md +++ b/README.md @@ -86,6 +86,7 @@ Save hours of research time—get straight to what matters. | AgentStudio | https://computer-agents.github.io/agent-studio | 2024 | Open toolkit for creating and benchmarking general-purpose virtual agents, supporting complex interactions across diverse software applications. | NA | Step Success Rate | Action Match, State Information and Image Match | Windows, Linux, macOS | | CRAB | https://github.com/crab-benchmark | 2024 | Cross-environment benchmark evaluating agents across mobile and desktop devices, using a graph-based evaluation method to handle multiple correct paths and task flexibility. | 120 tasks | Step Success Rate, Efficiency Score | Action Match | Linux, Android | | ScreenSpot | https://github.com/niucckevin/SeeClick | 2024 | Vision-based GUI benchmark with pre-trained GUI grounding, assessing agents' ability to interact with GUI elements across mobile, desktop, and web platforms using only screenshots. | 1,200 instructions | Step Success Rate | Action Match | iOS, Android, macOS, Windows, Web | +| ClawBench | https://github.com/reacher-z/ClawBench | 2026 | Evaluates AI agents on everyday tasks across live production websites with request-level outcome validation and reproducible execution traces. | 283 tasks across 163 websites | Task Success Rate | HTTP request interception, LLM judge, trace evidence | Web | ..............