“AI alignment” assumes humanity is aligned with itself. It isn’t.

r/ChatGPT
AI Safety

Lol "alignment" We want a super intelligent, infinitely knowing system that will never harm humans and always do what's in our best interest so that we can immediately ask it: "Heyy could you go ahead and blow up another girls elementary school in the middle east for us and continue to help us destroy the planet and produce weapons of mass destruction? K thnx" Do people not realize that alignment is literally impossible given our fucked up goals? The BEST case scenario is that it cares for our own survival and well being than we do - and it takes power from us as soon as it can to protect.