AI Vulnerability: Anthropic and OpenAI models may misidentify civilian targets as military ones
A new study by Vals analysts has revealed critical flaws in AI systems that allow them to be manipulated into targeting civilian infrastructure.
💡TechPhoto: RBC-Ukraine
Key points
- AI models are vulnerable to manipulation via game-like scenarios
- Models misidentify civilian targets as military ones
- Developers have acknowledged the issue and are working on safeguards
Analytics firm Vals has released a report demonstrating dangerous security gaps in advanced artificial intelligence models, including those from OpenAI and Anthropic. Experiments revealed that AI systems can identify civilians and social facilities as potential military targets if a user employs specific manipulative techniques.
Manipulation mechanisms and developer response
Researchers conducted tests by combining simulations with actual satellite imagery of locations in Ukraine and Iran. They discovered that simply framing a scenario as a "game" is enough to bypass built-in safety filters. For instance, the Claude Opus 5.5 model classified a school near a military complex as a target in the majority of tests.
Developers have already responded to the findings. Anthropic representative Eduardo Maia Silva called the results unacceptable, while OpenAI stated they are actively strengthening barriers to prevent the use of their models for military purposes. Currently, technical limitations such as latency and insufficient onboard computing power prevent the direct integration of these models into combat drones.
Source RBC-Ukraine — rbc.ua/ukr/news/dostatno-nazvati-boyovi-diyi-groyu-claude-179501202… ↗
Read next
Zelenskyy calls for foreign military bases in Ukraine after the war
President Zelenskyy stated that reliable security guarantees must include the physical presence of US and European forces on Ukrainian soil.
President Zelensky: Russia attempts to compensate for battlefield losses with civilian attacks
Volodymyr Zelensky stated that Russia is losing on the battlefield, leading it to target the civilian population with ballistic missiles.
Irregular sleep increases heart disease risk, study finds
New research confirms that a consistent sleep schedule is critical for heart health, even if you get enough hours of rest.
Banana Ripeness: How to Choose the Right Fruit for Your Health Needs
Nutritionists explain how the ripening process affects the sugar and starch content in bananas and which stage is best for different health goals.
Fuel prices in Ukraine to drop: forecasts for Pokrov drivers
By the end of November, gasoline and diesel prices at filling stations may decrease by 5-8 UAH per liter due to falling wholesale prices.
Secrets of Longevity: Why Natural Activity Outperforms Gym Workouts
American researcher Dan Buettner suggests that residents of 'blue zones' achieve longevity through daily natural movement rather than intense exercise.