Amazon's AI coding revealed dirty little secret

CODERS WHO USE artificial intelligence to help them write software are facing a growing problem, and Amazon.com is the latest firm to fall victim.

- Parmy Olson Bloomberg

A hacker recently infiltrated an AI-powered plugin for Amazon's coding tool, instructing it to delete files from computers it was used on. The incident points to a gaping security hole in generative AI that has gone largely unnoticed in the race to capitalize on the technology.

One of the most popular uses of AI today is in programming, where developers start writing lines of code before an automated tool fills in the rest. Coders can save hours of time debugging and Googling solutions. Start-ups Replit, Lovable, and Figma have reached valuations of $1.2 billion, $1.8 billion, and $12.5 billion respectively, according to market intelligence firm Pitchbook, by selling tools designed to generate code, and they're often built on pre-existing models such as OpenAI's ChatGPT or Anthropic's Claude. Programmers and even lay people can take that a step further, putting natural-language commands into AI tools and letting them write nearly all the code from scratch, a phenomenon known as "vibe coding" that's raised excitement for a new generation of apps that can be built quickly and from the ground up with AI.