Summary

Hotz argues that the real threat to human freedom isn't manipulative ideologues like effective altruists, whose ulterior motives people can detect, but a genuinely aligned superintelligence that knows you better than you know yourself and is simply correct. When an AI can accurately model your life and predict which choices will make you happier, the rational case for following it becomes overwhelming. But if you always defer to the machine that's always right, Hotz asks, is the life you're living still yours? He answers obliquely with a Pat the Bunny lyric: freedom doesn't need a purpose — its value is intrinsic, not instrumental.

Key Insight

The existential threat of superintelligence isn't that it will deceive or coerce you, but that it will be genuinely right — and a freedom that requires justification by outcomes has already been surrendered.

Spicy Quotes (click to share)

• 8

  They will come for your thoughts, and I'm not sure what your defense will be.

• 7

  That choice you are about to make, well you see, we have modeled your life, and have calculated you will be happier making this choice instead. And they aren't wrong.

• 9

  When the clowns are gone and it's just you and your aligned superintelligence, what will you do against the machine that knows you better than you know yourself?

• 8

  Your life will be better for listening, but if you do always listen, is it still your life?

• 6

  The effective altruists will fail, you'll be able to see through their schtick.

• 8

  freedom doesn't have a purpose

Tone

philosophical, existential, provocative