Nathan Lambert on how one AI safety resignation went viral and why he doubts fast takeoff

Nathan Lambert argues that a resignation post by AI researcher Jacob Coxon spread widely because public fear of AI extinction risk had been building.

He says concrete risks such as cyber attacks and bio-risks deserve debate, while he assigns extinction risk a probability too low to discuss and expects recursive self-improvement to produce only lossy, jagged gains rather than a rapid takeoff.