Melllvar

What are you suggesting should have been done here?

To be fair, there are important differences between open source and closed source software.

I’m curious how it’s considered a “layoff” if it’s based on performance rather than the job itself being eliminated.

The problem is that an AI built to maximize paperclips might conclude that converting the planet to paperclips is an acceptable cost of maximizing paperclip production. It might understand why humans think it’s bad to convert the planet, but disagree. It would need to be explicitly programmed to prioritize human life over paperclips.

otherwise we would just switch it off

If it were super-intelligent, it could probably trick us into leaving it turned on.

A paperclip maximizer driven by self-preservation? What could possiblie go wrong?