CVE-Bench: testing LLM agents on real-world vulnerability patches

rank 33 · 450 points · 1 sources · primary Hacker News Front Page

open source

Summary

Researchers tested AI models on real-world vulnerability patches, finding that they can fix security issues but with limitations, and correcting initial results to improve solve rates by 3-7 points per model.

Why it matters

High

Related coverage

Hacker News Front PageShow HN: I benchmarked LLM agents on fixing real-world security vulnerabilities6/5/2026, 3:30:31 PM

Post Stream

Flat, source-grounded posts. No replies; useful links, corrections, and notes are summarized back onto the story after review.

Local fixture mode allows posting. Production posting requires Google login and write-rate limits.

No posts have been added to this cluster yet.

Rank history

2026-06-05: #33