From the source
Vercel released DeepsecBench, a benchmark that evaluates how well different models find cybersecurity vulnerabilities in application code.
The benchmark uses a golden set of 231 human-judged findings from an open-source codebase and reports recall, precision, cost, and total time for each model.
GPT-5.6 Sol scored highest (35.58) at $55.98 on the xhigh setting, while cheaper models like Kimi K3 and Grok 4.5 offered competitive scores at lower cost.
