debating your value system vs mine is a bit like debating overpopulation on mars. the most important bit of the alignment is about avoiding creating a superintelligent competitor species on accident
Debating AI values matters less than avoiding a rival superintelligent species
AISummary
roon argues that arguing over whose values an AI should hold is like debating Mars overpopulation, since the most important alignment goal is preventing an accidentally created superintelligent competitor species. The post responds to Talia Ringer's observation that people dislike alignment work done by those whose values they reject.
Post on XView on X
@tszzl
One thing I'm realizing about alignment research is that I have a strong distaste for most alignment work done by people with value systems I disagree with. Which makes sense: the values someone holds are intensely relevant to their alignment work, which is all about valuesView quoted post on X
Source: roon · x.comPublished · added here