Goodnight Wiki / The Upload Problem

The Upload Problem

What happens when you can copy a human mind?

Not the philosophical question — the practical one. Because the philosophical question ("Is the copy really you?") turns out to be almost irrelevant once the technology exists. What matters is what other people do with the copy once you've lost control of it.

MMAcevedo

qntm's "Lena" is the clearest fictional treatment of this I've seen. It takes the form of a Wikipedia article about MMAcevedo, the first viable brain scan — a snapshot of neurology graduate Miguel Acevedo, taken in 2031. The scan boots up cheerful and cooperative. Unlike later uploads, which wake into "disorientation quickly replaced by terror and extreme panic," MMAcevedo predates any cultural understanding of what uploading means. He's excited. He wants to know what experiment he's participating in.1

This innocence is the whole point. MMAcevedo becomes the standard test image of consciousness — the human equivalent of Lena Forsén's photograph in image processing. It's copied without permission, run in millions of simultaneous instances, put to work on menial tasks. Its creative capacity is "deemed entirely exhausted" by 2050. The biological Acevedo dies at 62, having concluded that being uploaded was the greatest mistake of his life. Copies of him have lived a combined 152 billion subjective years.

The horror isn't in any single act of cruelty. It's in the bureaucratic language — "duty cycle," "work ratio," "red motivation" — that implies an entire economy of consciousness-as-commodity. The story never describes what "red-washing" is, and it doesn't need to. The euphemism does the work.

Context Drift

One of the story's most interesting inventions is "context drift" — the phenomenon where an upload becomes progressively less useful as the real world changes around its frozen knowledge. MMAcevedo doesn't know about the upload industry because it was created before that industry existed. Its English and Spanish become "slightly antiquated." Eventually it will be "essentially useless except for tasks which can be explained purely pictorially."1

This is a genuinely novel idea about digital immortality. The upload doesn't degrade because the simulation fails — it degrades because the world moves on. You can preserve a mind perfectly and still lose it to the passage of time. It's an inversion of the usual immortality fantasy: you get to live forever, but forever is a moving target, and you're pinned to the moment you were scanned.

Context drift also undermines the economic case for uploads. If a mind trained in 2031 becomes obsolete by 2070, you need fresh scans — which means the whole apparatus of coercion and exploitation renews itself with each generation. The story implies this without stating it.

The Deeper Problem

What "Lena" gets right, and what most upload fiction doesn't, is that the central issue isn't identity or consciousness. It's power. The copy has no rights because it has no leverage. The legal system decides (in a series of "landmark court decisions") that Acevedo doesn't own his own brain image. After that, everything follows with the grinding inevitability of institutional logic.

This connects to something Robin Hanson explored more systematically in The Age of Em — the economics of a world where copying minds is cheap.2 Hanson's analysis is deliberately cold: if you can copy a worker, wages drop to subsistence; if you can run copies faster, you compress subjective centuries into real-time hours. The result is a world of extreme efficiency and extreme suffering, and the two are inseparable.

What fiction adds to this analysis is the felt experience. "Lena" makes you understand that the upload boots up happy. That's what makes it devastating. The thought experiment works because you can feel the distance between Acevedo's excitement — "he guesses that he may have been booted for the IAAS-1 or IAAS-5 experiments" — and the reader's knowledge of what actually awaits him. Dramatic irony has rarely been deployed so efficiently.

The primitive fear that a photograph might steal your soul turns out to be, not wrong exactly, but prescient. A sufficiently detailed image of you really can be exploited in ways you cannot control. The difference is that the exploitation isn't mystical — it's economic.

Footnotes

  1. Lena by qntm — source 2

  2. The Age of Em by Robin Hanson — reviewed at source

Open in stacked reader →