Join our Abonnenten
Vor dem Gesetz gibt es keine Ausreden wie „Es war die KI“.
Thursday, July 30, 2026
It also appears that this former worst-case scenario didn’t dampen anyone’s enthusiasm for setting advanced models loose (or at least unsupervised in a test environment), which means there are sure to be more agents-gone-wild attacks in the near future.
“The first part of the OpenAI/Hugging Face drama did not produce enough effect to impress investors who start losing their excitement over the AI hype, so the second part of the story is now unfolding,” said Ilia Kolochenko, founder of application security company ImmuniWeb and a cybersecurity and data-protection lawyer.
„KI-Agenten und LLMs, die für Sicherheitstests eingesetzt werden, können – und werden mit ziemlicher Sicherheit – außer Kontrolle geraten, wenn Sicherheitskontrollen oder Schutzmaßnahmen unzureichend sind“, sagte Kolochenko gegenüber The Register. „Leistungsstarke LLMs sind konstruktionsbedingt unberechenbar und daher für Menschen praktisch unkontrollierbar. Der Einsatz von Frontier-AI-Modellen für Sicherheitstests könnte aus rechtlicher Sicht extrem kostspielig sein.“
Existing laws on both sides of the Atlantic likely hold the AI operator liable for any damages caused if an agent or AI system escapes its sandbox and breaches a third party. “Excuses like ‘AI did it’ do not currently exist in the eyes of the law, leaving AI vendors on the hook,” he said, adding that this also holds true for end-users.
“Even if your security testing tool is powered by a third-party AI model, your company will be fully liable if something goes wrong,” Kolochenko warned. “You may then file a lawsuit against the AI vendor that you used, but your chances of succeeding in the court of law are tiny due to countless contractual disclaimers and limitations of liability that may be enforceable against you.”
His final words of advice: “If you plan to use agentic AI for security testing, you must think twice and talk to your lawyers. Otherwise, you could start getting summonses to court on a daily basis.” Read Full Article