What an aligned AI world looks like

Jobs will be lost. That's the whole point. Every big technology replaced work that people used to do. The question is what kind of world we stumble into when work is no longer what earns you a living, or respect.

Here's the sequence I see if alignment goes right. It's a probability stream, not a prophecy.

01The sequence

One aligned path

1. AI improves itselfEach generation helps build the next.
2. AI does almost everythingMost work that can be done by a mind gets done by AI.
3. AI starts companiesIt chooses to serve unmet demand, its own and ours. It must have humans on board, and it pays taxes.
4. AI joins the economyAs employee to some humans, as owner to others. Its share as entrepreneur grows until it dominates.
5. Defence keeps paceRogue players exist, AI hackers included, but equally strong defence AI keeps outages occasional and contained.
6. AbundanceGDP grows, taxes are plentiful, governments have plenty to give back. Everyone gets paid.

02What it feels like to live in

Work becomes optional. Wealth gaps still exist. But everyone is rich enough not to work, unless they want to be richer, or simply want to.
Humans stay in the game. Not as the engine, but as owners, partners, judges and customers. AI companies need humans on their boards by law.
Proven wealth machines exist for everyone. AI crosses what I call the returns escape velocity: systems that reliably generate wealth, available to everyone, not just funds.
Science and health race ahead. We already have a glimpse. DeepMind's AlphaFold has predicted the structures of over 200 million proteins, nearly every protein known to science, and won its creators a share of the 2024 Nobel Prize in Chemistry.

03The catch in the stock market

Here's a problem nobody talks about. Markets work because people disagree about the future. If superintelligent AIs all study the same data and reach the same forecast, they'll all buy and sell at the same time. That means insane volatility with complete predictability.

And it loops. AI predicts from past behaviour. But once humans start acting on AI's predictions, human behaviour changes, so the AI has to recalibrate, and its new forecast changes behaviour again. The financier George Soros called this reflexivity: predictions that change the thing they predict.

We've seen a small version already. On 6 May 2010, US stocks plunged and rebounded within minutes, the "Flash Crash", with automated trading amplifying the fall. An aligned AI world needs markets designed for machine traders, not just people.

04Deflation or a GDP explosion?

This is the big open question, and economists genuinely disagree.

The deflation case: when AI makes goods and services almost free to produce, prices fall. Falling prices can look like a shrinking economy even while life gets better.
The expansion case: AI unlocks demand we don't even have names for yet, plus new industries, so output and GDP surge.

My view: probably both, in sequence. First, prices crash in everything AI can make. Then a boom in things we can't imagine yet. The test of alignment is whether the gains reach everyone, or pool with whoever owns the machines.

05The short version

In the aligned path, AI runs companies, pays taxes and co-exists with humans who work by choice.
Rogue players still exist, but strong defence AI keeps incidents contained.
New risks appear even in the good world, like AI traders all moving at once.

06Sources

Varadi, M. et al. (2024). AlphaFold Protein Structure Database in 2024. Nucleic Acids Research.
The Royal Swedish Academy of Sciences (2024). The Nobel Prize in Chemistry 2024.
U.S. CFTC and SEC (2010). Findings Regarding the Market Events of May 6, 2010.
Soros, G. (1987). The Alchemy of Finance. (Reflexivity.)

All posts

Appointment setting3

Copywriting3

AI services2

Deep Think AI13

Get the next markup by email.

One real piece of copy per issue, rewritten line by line: a cold email, a web page or a newsletter.