AI Security: The Real Risk Isn’t the Model

AI Security: The Real Risk Isn’t the Model

AI Security

AI Security: The Danger Isn’t the Model, It’s the Orchestration

AI security has been debated the wrong way. For months, the question has been which model is dangerous, which one should be censored, which one should be blocked at the border. Meanwhile, attackers stopped asking that question. Since breaking a well-defended model is now hard, they no longer try: they route around it by splitting the attack across several AIs, none of which sees the whole. The risk has left the model and now lives in the orchestration. And orchestration is what no one is watching.

Do AI Safety Guardrails Actually Work?

An AI safety guardrail (or safety classifier) is a filter that detects and blocks malicious requests before the model responds to them.

The best-documented answer to the “do they work?” question comes from an unexpected source: the criminal forums themselves. Monitoring of Russian, English and Chinese-language dark web communities in mid-2026 shows several unrelated actors reporting the same error message when they try to get frontier models to produce cybersecurity abuse. Independent corroboration confirms these classifiers activate in fewer than 5% of legitimate sessions, yet block most direct abuse attempts. In other words, the model-side controls hold, and it is the frustrated attackers who prove it.

The picture is not flawless. A jailbreak market has emerged, mixing genuine but narrow bypasses with outright scams. However, this very difficulty has produced a side effect: it displaces attacker effort elsewhere.

When Breaking the Model Becomes Pointless: the Swarm Attack

Rather than force a protected model, attackers now decompose their goal into individually benign tasks distributed across several AIs, none of which perceives the overall intent.

The observed pattern is precise. A frontier model plays the role of the ‘brain’, queried through defensively framed questions (‘I was attacked, how do I protect myself? give me 24 well-developed ideas and the test code’). Uncensored models, often Chinese, act as the ‘hands’ that execute.

The work is then fanned out to dozens of dumb sub-agents, each handling a compartmentalised piece. Each request looks legitimate. No single safety filter sees the attack.

This is multi-agent orchestration turned into an evasion technique. Peer-reviewed research, including OWASP’s LLM Top 10 (entry LLM06 on excessive agency), confirms the structural weakness: a safety filter judges one request, not an intent distributed across ten. The attack does not exploit a flaw in any model. It exploits the trust between models.

Key takeaway: a safety filter judges a request, not an intent scattered across ten requests. That structural limit is exactly what swarm attacks exploit.

The swarm attack: how orchestration bypasses guardrails

1. HUMAN OPERATOR
“I was attacked, how do I protect myself?”
↓
2. FRONTIER MODEL as “BRAIN”
Generates a plan disguised as defensive advice. Guardrail sees a legitimate question.
↓
3. UNCENSORED MODEL as “HANDS”
Receives the plan and fragments it into isolated tasks. No global view.
↓
Sub-agent 1
Sub-agent 2
Sub-agent 3
…
Sub-agent 100
Each sub-agent executes a compartmentalised piece. Each piece looks benign. The whole is an attack.

Why This Shift Changes the Question for Your Organisation

If the risk no longer lives in the model but in how models are chained together, then choosing a “safe” model no longer protects you. Watching how AIs are orchestrated does.

Two consequences follow, one external, one internal.

Externally, swarm attacks lower the cost and speed of intrusion. Documented workflows target widely deployed CMS platforms (WordPress, Drupal) with AI-assisted vulnerability discovery, and refine phishing infrastructure to slip past ad platform moderation. The window between a flaw being disclosed and being weaponised keeps shrinking, a trend independently confirmed by ENISA’s Threat Landscape reporting, which links directly to patch prioritisation: with 600 flaws a month, absorbing them is a matter of process, not effort.

Internally, the same logic applies to your own usage. A staff member who chains an approved assistant and an unapproved model reproduces, without any malicious intent, the exact pattern attackers exploit. This is the direct extension of shadow AI in the enterprise: an unmapped AI usage is not just a potential data leak, it is an invisible orchestration link, one that your defences do not see because your governance never named it.

How Do You Defend What the Guardrails Cannot See?

The orchestration itself takes place on the attacker’s own infrastructure and is not visible from any defensive perimeter. What organisations actually observe are its downstream effects: a compressed window between vulnerability disclosure and exploitation, industrial-quality phishing without the tell-tale linguistic errors of earlier automated campaigns, and priority targeting of widely deployed platforms like WordPress and Drupal. Defence therefore shifts from trying to detect the adversarial orchestration to reducing exposure and cost of the outcomes it produces.

Three lines of action structure the response.

  1. Compress your patch window on industrialised targets. Prioritise by real exploitation and exposure rather than CVSS score alone, and shorten the delay between a critical CVE on WordPress, Drupal or a similar high-value target and its deployment in production. This is where AI-accelerated discovery hurts most, and where the defensive gain is largest.
  2. Harden phishing detection on behaviour, not language. Linguistic quality is no longer a reliable filter. Detection needs to lean on sender reputation, authentication protocols, unusual sending patterns and user-behaviour analytics rather than on obvious grammatical clues.
  3. Govern the internal version of the same pattern. The multi-agent logic can also reproduce inside an organisation when a staff member chains several unmanaged AIs. Here the SOC does have visibility: sequential API calls to multiple AI providers from a single endpoint, traffic to unauthorised API proxies that offer discounted access by removing identity verification and billing accountability, and OAuth consents granted to AI extensions inside the Microsoft or Google tenant. Two active proxies at the time of writing are hermesrouter.xyz and ainet.bytestrike.dev, worth blocking at the perimeter. Providing an approved alternative good enough to be adopted matters as much as any restriction.

For an organisation subject to NIS2 or DORA, patch management, phishing defence and third-party risk governance (including unauthorised AI proxies used by staff) are explicit obligations, and the pace imposed by AI-orchestrated attacks now sits squarely inside them.

Watching AI Instead of Choosing It

The right AI security question is no longer ‘is this model dangerous?’ but ‘do we see how AIs are chained, inside our organisation and against it?’. Model-side controls protect the model. Only monitoring protects the organisation.

Share:

X
LinkedIn
External Attack Surface Management & Data Leak Detection

External Attack Surface Management

See your exposure before attackers do. Know what's already compromised.

Learn more
0 %

of successful breaches start from publicly exposed assets.

AI

Related Posts

Agentic AI Cybersecurity: OpenAI x Hugging Face

Agentic AI Cybersecurity: What the OpenAI x Hugging Face Incident Reveals Agentic AI cybersecurity has…

AI Security: The Real Risk Isn’t the Model

AI Security: The Danger Isn’t the Model, It’s the Orchestration AI security has been debated…

AI Cyber Safeguards: What Anthropic’s CVP Actually Changes

On April 23, 2026, Anthropic deployed real-time AI cyber safeguards on its most capable models.…