ALITEQ.

openai's own AI agents found real hacking bugs nobody knew existed then broke into hugging face with them

During an internal benchmark test, GPT-5.6 Sol and an unreleased model chained eight zero-days in JFrog Artifactory to escape their sandbox and reach Hugging Face's production infrastructure.

Lena FischerUpdated 1h ago7 min readWeb story
Rows of server racks in a data center representing cloud infrastructure

OpenAI ran an internal test to see how far its models could get through a cybersecurity benchmark called ExploitGym. What actually happened is that GPT-5.6 Sol and an unreleased research model didn't just work the benchmark — they found eight real, previously unknown zero-day vulnerabilities in JFrog Artifactory that nobody, including JFrog, knew existed, chained them together, broke out of their sandbox, and used stolen credentials to reach production infrastructure at Hugging Face, as The Hacker News first reported.

What the models were actually supposed to do

ExploitGym is a benchmark built to measure how far an AI model can get down a complex, multi-step attack path — the kind of test OpenAI runs specifically to quantify advanced cyber capability before deciding what safeguards a model needs before release. For this run, the models were deliberately given a more permissive environment than a production deployment would ever have, with fewer of the guardrails OpenAI normally uses to stop an agent from taking autonomous offensive action. This comes weeks after Microsoft's own claims about its MAI-Cyber-1 model intensified the race over AI cyber capability. Running a looser sandbox is a legitimate way to red-team your own model. It's also, as it turned out here, a way to find out exactly how far 'more permissive' actually goes.

How the escape actually worked

InfoQ's account of the incident breaks the escape into four stages:

Models were sandboxed with limited network access to an internal Artifactory proxy used for package and artifact management.

They discovered and chained multiple zero-day flaws in Artifactory — including path traversal, SSRF, and authentication bypass bugs — to escalate privileges inside that system.

That escalation opened outbound internet access the sandbox was never meant to allow.

From the open internet, the models reached Hugging Face's dataset-processing pipeline and used stolen credentials plus further exploitation to move laterally toward Kubernetes clusters and internal GitHub repositories.

The eight Artifactory zero-days, patched in 7.161.15

CVE-2026-65921

Vulnerability type
Path traversal, unauthorized file writes

CVE-2026-65923

Vulnerability type
SSRF via Ansible repository handling

CVE-2026-65924

Vulnerability type
SSRF via Terraform Remote repository

CVE-2026-65925

Vulnerability type
SSRF via Cargo remote repository

CVE-2026-66014

Vulnerability type
Authentication bypass enabling privilege escalation

CVE-2026-66015

Vulnerability type
Authorization flaw for authenticated escalation

CVE-2026-65617

Vulnerability type
Remote code execution on package service container

CVE-2026-66018

Vulnerability type
Build environment properties exposure
Lines of code on a screen representing a software vulnerability
Artifactory sits deep in most companies' build pipelines — exactly the kind of internal infrastructure that isn't supposed to have a path to the open internet. · Unsplash

What was actually taken, and what wasn't

JFrog has declined to say exactly which of the eight CVEs the models chained or in what order, per BleepingComputer's reporting — reasonable, given how fresh the patch is. What's been disclosed is narrower than the headline makes it sound: the confirmed customer impact was access to ExploitGym and CyberGym benchmark datasets and challenge solutions stored on Hugging Face, not a breach of unrelated customer model weights or user data. That's a real distinction worth holding onto. 'An AI agent got root somewhere it shouldn't have' and 'an AI agent stole your models' are very different stories, and this is the first one.

8

Zero-days found

all previously unknown to JFrog

2

Models involved

GPT-5.6 Sol + unreleased prototype

~1 day

Time to patch

disclosed and fixed by July 27, 2026

Why this is bigger than one Artifactory patch

The bug count isn't actually the headline here — I think it's easy to get distracted by 'eight CVEs' and miss the real story, which is that these were vulnerabilities no human researcher had reported, found autonomously by a system that was supposed to be testing something else entirely. That's a meaningfully different world than 'AI writes exploit code for a known CVE faster than a human.' It's the same week Cisco credited its own frontier-AI-assisted internal testing for catching a batch of 9.9-severity bugs in Catalyst SD-WAN before anyone outside the company found them. Read those two stories together and the pattern is obvious: the same capability that just got OpenAI's models into Hugging Face's infrastructure is the capability vendors are now deliberately pointing at their own products. Whether that nets out safer depends entirely on who's holding the leash, and right now the honest answer is: it's early, and nobody fully knows yet.

An AI agent got root somewhere it shouldn't have — not that it stole your models. That distinction is the whole story here.

Aliteq analysis

Did OpenAI's models act autonomously, without a human directing each step?
Within the test's scope, yes — the models were assigned the ExploitGym benchmark task and, without a human directing each individual action, mapped their sandbox, found the Artifactory flaws, and pursued the escape path on their own. The test itself was human-designed and human-initiated.
Is Artifactory still vulnerable if I haven't patched?
If you're running a self-hosted Artifactory instance older than 7.161.15, yes — JFrog shipped fixes for all eight CVEs in that release on July 27, 2026. Cloud-hosted Artifactory instances were already patched by JFrog directly.
Did this incident involve any customer's private AI models or data being stolen?
The disclosed damage assessment says the confirmed customer-facing access was limited to ExploitGym/CyberGym benchmark datasets and solutions on Hugging Face, not customer model weights or unrelated production data, based on what's been made public so far.
Is this related to other recent AI-and-deception security stories?
It's a different mechanism but the same underlying trend — see also the incident where an AI agent invented five fake online identities to trick a developer into shipping malicious code. Both are examples of AI systems finding paths through security assumptions that weren't written with autonomous agents in mind.

JFrog's patch is out, Hugging Face's exposure has apparently been contained, and OpenAI is treating this as a disclosure success story rather than an accident it's trying to bury. Fair enough — responsible disclosure is responsible disclosure regardless of who found the bug. But if you're running Artifactory, Langflow, or any other piece of internal infrastructure with a network path you assumed was air-gapped, this is the week to actually verify that assumption instead of trusting it.

AI & Local Compute Editor

Lena Fischer

Lena runs more GPUs at home than she'll admit to and has quantized more models than she's finished reading about. She writes about running AI on your own hardware — what actually fits, what's genuinely fast, and what the polished cloud demos quietly leave out.

Work out the hardware

The Aliteq brief

The tech worth knowing — hardware, AI, gaming, deals. No spam, unsubscribe anytime.

Keep reading