By Vero SecurityBuilt and funded by Vero Security, the AI Security Engineering platform.Read the charter

Testing defenses against adaptive attacks

A defense that blocks a fixed attack set can still fall to an attacker who adapts. Benchmark agent defenses in realistic task environments and test them with adaptive attacks before you trust a published success rate.

Read in this order

  1. PaperAgentDojo: A Dynamic Environment to Evaluate Prompt Injection Attacks and Defenses for LLM AgentsStart here: a benchmark with realistic agent tasks and attacks.
  2. PaperThe Attacker Moves Second: Stronger Adaptive Attacks Bypass Defenses Against LLM Jailbreaks and Prompt InjectionsShows adaptive attacks breaking defenses that looked strong on fixed sets.
  3. ArticleTechnical Blog: Strengthening AI Agent Hijacking Evaluations (NIST)NIST's advice on making hijacking evaluations harder to game.

Save your progress

We email you a sign-in link. No password.

By signing in you agree to the terms. The privacy policy explains how we use your details.

Join the AI security engineering community

Free. Roadmap updates, chapters near you, and first word when credentials open.

We’ll email you community updates. Unsubscribe anytime. By sending this you agree to the terms. The privacy policy explains how we use your details.