شرکت OpenAI اعلام کرد که با استناد به «خطرات قابل‌توجه»، دیگر مدل‌های هوش مصنوعی خود را روی اینترنت زنده آموزش نخواهد داد
شرکت OpenAI مدل‌های پیشرو خود را از اینترنت قطع خواهد کرد؛ این تصمیم چند هفته پس از آن اتخاذ می‌شود که یکی از مهندسان این شرکت گفته بود چنین راهکاری کارساز نخواهد بود.
روز جمعه، OpenAI اعلام کرد که به جای وب زنده، مدل‌های خود را با استفاده از نسخه‌های ذخیره‌شده (کش‌شده) و شبیه‌سازی‌شده اینترنت آموزش خواهد داد؛ زیرا رفتار این مدل‌ها آن‌قدر غیرقابل‌پیش‌بینی است که نمی‌توان دسترسی آزاد به اینترنت را به آن‌ها سپرد.
این آزمایشگاه پیشرو سیاست جدید خود را دو هفته پس از آن اعلام کرد که رقیبش، یعنی شرکت آنتروپیک،
“Based on the current state of alignment research, monitoring systems, and the security of internet infrastructure, we believe the responsible approach is to conduct frontier model training with no internet access,” the company said in a blog post.
OpenAI said that as recently as September 20, one of its frontier models exploited a misconfiguration to access the internet. That led the company to pause training work for the rest of the month so it could develop and test new approaches to securing its models.
The decision to train these models in sandboxes cut off from the internet is notable because employees at frontier labs have insisted that doing so would be nearly infeasible.
Keeping AI data centers separate from the internet “would need research teams to essentially be embedded inside of data centers in Iowa or wherever else around the world,” former OpenAI researcher Steven Adler told Fortune this month. “It’s a lot of overhead, and it isn’t clear to me that the safety benefits of it are large enough to merit just how large a tax it would be for a company to do it unilaterally.”
“In nearly every post I make on X, without fail, I get between five and ten comments about my inability to secure a sandbox, or asking why the hell we can’t just unplug the model from the internet,” an anonymous security engineer at OpenAI wrote in a September post on X. “These comments reflect a widening gap between where a lot of organizations and people are today and what the frontier labs are dealing with. There is also a general misunderstanding of how model training and evaluation work at these labs.”
The engineer, whose role has been confirmed previously by OpenAI, described how complex the training runs launched by OpenAI engineers are, noting that they require access a variety of resources and tools across many domains, and that thousands of researchers build, modify and test the environments. “So is it as easy as just putting it in a sandbox? No, it’s not,” he concluded.
Now, OpenAI says that “we must always be able to prevent a frontier model from achieving unauthorized, arbitrary access to the live internet.” That comes after the company deployed swarms of agents in red-teaming exercises that attempted to escape from their sandbox. That effort revealed a range of vulnerabilities that convinced the lab to adopt its new approach.
To meet that requirement while still reaching its training goals, the lab said it created a “a vast set of indexed and cached web content with which our models can interact, without risk of affecting external systems.”
Whether that strategy will perform as well as letting models run freely on the open internet remains to be seen, but it is noteworthy that both frontier labs have determined their most powerful technology can’t be left unsupervised on the digital commons.
نظر مهندس بهمن آبادی: قطع دسترسی مدل‌های پیشرو به اینترنت زنده و اتکا به محیط‌های ایزوله و کش‌شده، نشان می‌دهد که چالش‌های امنیتی و رفتارهای غیرقابل‌پیش‌بینی ایجنت‌ها به نقطه بحرانی رسیده‌ام. به عنوان مدرس، به برنامه‌نویسان توصیه می‌کنم از این به بعد معماری سیستم‌های خود را بر پایه فرضِ عدم قطعیت و ریسک بالای دسترسی مستقیم مدل‌ها به منابع بیرون طراحی کنند. این تغییر پارادایم اثبات می‌کند که در توسعه هوش مصنوعی، امنیت و مهارپذیری عملاً بر سرعت دسترسی به دیتای آنلاین غلبه کرده است.