aii.news Get the daily email
AI Security Watch

How AI is changing security.

AI-powered attacks, deepfake fraud and scams, attacks on AI systems, and how banks, fintechs and tech companies are defending against them. Updated twice a day.

Photo: Faraaz Zuberi / Unsplash

SecurityThe Hacker News ↗11 Nov

Attackers use open-source AI pentesting agent AntiFox to steal AWS credentials

Researchers found attackers hosting self-managed instances of AntiFox, an open-source agentic penetration testing platform, on Alibaba Cloud to target web services and steal AWS credentials. The attackers then moved laterally into compromised environments.

Why it mattersOffensive AI agents built for defenders are being turned against cloud accounts, raising the speed and scale of credential attacks.

  1. SecurityBuildersCSO Online ↗11 Nov

    Microsoft shows editing fewer than 10 neurons can plant a hidden backdoor in AI agents

    Microsoft researchers described a technique called Lazarus that changes a few dormant neurons in an open-weight model so that a trigger makes it output attacker commands, with no retraining needed. The modified model behaves normally in standard safety tests, and Microsoft says it has not seen attackers use the method.

    Why it mattersTeams running agents on open-weight models need to verify where their model files come from and limit what agents can execute.

  2. SecurityBuildersCSO Online ↗11 Nov

    Claude Code settings files leaked over 31,000 secrets on public GitHub repos

    GitGuardian found 31,088 distinct secrets, including database credentials and cloud tokens, in Claude Code local settings files across 23,276 public GitHub repositories. Of those, 5,343 were still valid when detected.

    Why it mattersIf you use Claude Code, check that your local settings file is excluded from Git and rotate any credentials that may have been committed.

  3. SecurityBuildersThe Hacker News ↗11 Nov

    Railway breach let hackers run up about $740,000 in AI charges with stolen customer keys

    Platform provider Railway said AI provider keys stored by customers were stolen in an October breach and used for an estimated $740,000 in unauthorized usage, potentially affecting up to 100,000 workspaces. The company promised to cover charges that AI providers will not refund.

    Why it mattersStored AI API keys are now a direct target for theft and resale of compute, so set spending limits and rotate keys kept on third-party platforms.

  4. SecurityBusinessThe Hacker News ↗10 Nov

    Fireworks AI breach widens to customer datasets, model weights and Notion AI chats

    Fireworks AI said its investigation into an earlier incident found further malicious activity affecting account and billing information, secrets, datasets and incomplete models for a limited set of accounts. Notion said the breach exposed Notion AI chat transcripts in a small number of workspaces.

    Why it mattersYour AI data is only as safe as the infrastructure providers behind your tools, so companies should review which vendors process their prompts and data.