mythsthe wider recordMaersk / NotPetya2017logistics

everyone assumed:

our domain backups are safe somewhere

what was actually true:

A backup reachable by whatever destroys the original is not a backup.

how it happened

  1. whoNotPetyawiper malware
  2. the gapflat networkbackups on the same network
  3. thenall domain controllersone survived offline in Ghana
  4. the result~$300M costrebuilt from one drive
the gap that let it happen the result

what everyone assumed

Backups feel like insurance that is always there when needed. The assumption is that because copies exist, recovery is available, without asking whether the copies could be destroyed by the same event that destroyed the originals.

what happened

NotPetya wiped tens of thousands of machines and every domain controller almost simultaneously, because the malware spread across exactly the network the backups lived on. The company could rebuild its identity backbone only because one controller in Ghana had been offline during a power cut, surviving by accident.

step by step

  1. backups live on the same network as productionIncluding every domain controller.the assumption breaks here
  2. June 2017NotPetya wipes tens of thousands of machinesAnd all domain controllers, almost at once.
  3. one controller in Ghana was offline in a power cutIt survives by accident.
  4. the drive is couriered to LondonRecovery of the global identity system hinges on it. Cost about $300 million.

how it surfaced

In June 2017 the attack cost the company around $300 million, and the recovery of its entire global identity system hinged on a single backup that happened to be unplugged. Staff physically couriered the drive from Ghana to London.

A backup reachable by whatever destroys the original is not a backup.

Recovery depends on a copy that is isolated from the disaster, not merely replicated within it.

picture it at a company like yours

The company here is made up. The other two paths are not: they happened, and each links to the story.

your company
a normal dayYour backups sit on the same network as everything else, so they are easy to reach.
the gap nobody seesAnything that spreads across your network can reach the backups too.one system with no plan B
  1. in this story
    the day it mattersMalware wipes every machine and every backup in one go.
    what it costs youYou recover only because one copy happened to be unplugged, by pure luck.
  2. or it goes like this
    howYour main software vendor is hit and goes dark for two weeks.
    what leavessales, orders and invoicingwho ends up with itcompetitors, as customers go elsewhere
    it happenedCDK Global, 2024
  3. or it goes like this
    howBackups live where the attacker can delete them too.
    what leaveseverything, with nothing left to restorewho ends up with itthe business itself, which closes
    it happenedCode Spaces, 2014

sources

  1. Control Engineering / Wired, 2017-2018

← all myths

your turn

what you can do about it

  1. this week

    Confirm one backup is offline or immutable, and test a restore from it.

    Your backups exist, but whether one of them is isolated from a tenant-wide compromise, offline or immutable, beyond the reach of a stolen admin account, is a different question. Maersk recovered on luck. A tested, isolated copy is what stands in for a power cut in Ghana.

  2. go deeper

  3. if you're not sure where to start

    Run the offboarding checklist on one leaver. It covers every account and token to close when someone leaves.

    open the checklist →

the letter · every two weeks

one access gap in your inbox, with the fix.

Every issue takes one way access creeps in, shows a real incident where it went wrong, and ends with one thing to check that week. Written for the people who run the tools, without a security team behind them.

  • 1one mechanism, explained plainly
  • 2one real incident, taken apart
  • 3one step you can take on Monday

get the next issue

One email every two weeks. Your address stays here and is never passed to vendors. One click to unsubscribe. Privacy.