mythsthe AIDisney / NullBulge2024media

everyone assumed:

an employee's pet AI tool can't touch production

what was actually true:

A personal device and a work account are not separate systems when one holds the credentials to the other.

how it happened

  1. whomalicious AI toolon a personal computer
  2. the gappassword vaultheld work logins
  3. the result~1.1TB leakednearly 10,000 channels
the gap that let it happen the result

what everyone assumed

A personal-device hobby tool feels sealed off from work systems, a private choice with private consequences. The assumption is that what someone installs on their own machine stays on their own machine, far from anything corporate.

what happened

The malware harvested credentials from the device, including a password vault, which contained the keys to the employee’s work accounts. With those, the attacker reached an internal communications platform and pulled data from thousands of channels. A personal download had touched production after all.

step by step

  1. an employee installs an unsanctioned AI tool at homeThe download carries malware.the assumption breaks here
  2. it harvests a password vaultThe vault holds the keys to work accounts.
  3. the attacker enters internal chatData is pulled from thousands of channels.
  4. July 2024about 1.1 terabytes leakedFrom nearly 10,000 channels. The attacker later pleads guilty.

how it surfaced

In July 2024 roughly 1.1 terabytes of internal data from nearly 10,000 channels was exfiltrated and leaked. The attacker, operating as NullBulge, later pleaded guilty. The entry point was an unsanctioned AI tool on a personal machine.

A personal device and a work account are not separate systems when one holds the credentials to the other.

An unvetted AI tool is software with whatever access the machine it runs on can reach.

picture it at a company like yours

The company here is made up. The other two paths are not: they happened, and each links to the story.

your company
a normal dayAn employee tries a free AI app at home, on the laptop where they also log into work.
the gap nobody seesTheir password manager holds every work login, and the app is malware.company data flowing into AI tools nobody vetted
  1. in this story
    the day it mattersThe malware copies the password manager and the attacker signs into your team chat.
    what it costs youYears of internal conversations are downloaded and posted publicly.
  2. or it goes like this
    howEngineers paste code and notes into a free chatbot to get help.
    what leavesconfidential code and meeting noteswho ends up with itan AI vendor on consumer terms
    it happenedSamsung, 2023
  3. or it goes like this
    howThe AI vendor leaves its own database open.
    what leaveseveryone's chats and the vendor's keyswho ends up with itanyone on the internet
    it happenedDeepSeek exposed database, 2025

sources

  1. BleepingComputer, 2025

← all myths

your turn

what you can do about it

  1. this week

    Give people a sanctioned AI tool and a clear line on what may run on work devices.

    Someone in your company will download an unvetted AI tool this month because it looks useful, onto a device that also holds their work credentials. That bridge is the NullBulge path. A sanctioned tool and a clear line about what runs where is what stands in for luck.

  2. go deeper

  3. if you're not sure where to start

    Run the offboarding checklist on one leaver. It covers every account and token to close when someone leaves.

    open the checklist →

the letter · every two weeks

one access gap in your inbox, with the fix.

Every issue takes one way access creeps in, shows a real incident where it went wrong, and ends with one thing to check that week. Written for the people who run the tools, without a security team behind them.

  • 1one mechanism, explained plainly
  • 2one real incident, taken apart
  • 3one step you can take on Monday

get the next issue

One email every two weeks. Your address stays here and is never passed to vendors. One click to unsubscribe. Privacy.