Model, harness, gym: why Novee owns the full AI pentesting stack – Ido Geffen – BH26 #1

This episode is sponsored by
Full Segment Notes
Key Moments
  • 0:00 - Intro: Black Hat 2026 and AI-Powered Penetration Testing
  • 0:20 - Using LLM Agents for Offensive Security
  • 0:56 - Building Safe AI Models for Pen Testing
  • 02:28 - How AI Models and Harnesses Improve Pentesting
  • 04:10 - The Novi Gym: Training AI Against Real Enterprise Environments
  • 04:53 - Finding Business Logic Vulnerabilities with AI
  • 06:16 - Measuring AI Pentesting Success: Precision and Recall
  • 07:03 - Comparing AI Agents to Human Penetration Testers
  • 09:14 - Where Human Expertise Still Matters in AI Security
  • 11:18 - Enterprise Pentesting Teams and AI Automation
  • 12:21 - Open Source Tools vs AI Pentesting Platforms
  • 13:32 - Benchmarking AI Pentest Performance and Cost
  • 13:56 - Optimizing AI Models for Different Security Tasks
  • 15:28 - The Future of AI-Driven Penetration Testing
Guest
Founder & CEO at Novee Security

Ido Geffen is the CEO and co-founder of Novee, the leader in AI-powered penetration testing. He brings over 20 years of experience across offensive and defensive cybersecurity, including nation-scale operations, vulnerability exploitation, and defense.

Through his work on national defense, he and fellow Novee co-founders Gon Chalamish and Omer Ninburg saw enterprises facing an impossible challenge: deploying code continuously while testing security only quarterly, even as attackers operate 24/7 with AI-powered tools. They founded Novee in May 2025 to clone their combined expertise into an agent that runs continuously, finding zero-days, business logic flaws, and complex attack chains that traditional tools miss.

Stay in the Know, No Smoke and Mirrors – Join Our Newsletter

You can skip this ad in 5 seconds