Originally posted by humy
Actually, if it wasn't for my total absence of access to any of the necessary resources, I have a pretty good idea how to do this. This is one of the problems I have been working on for most of my life and I plan to eventually finish the theoretical part of my work on that sometime after I have finished my book next year.

It might be something like a second AI whose life is devoted to monitoring the activities of the main AI, a path down a forbidden road, an intervention takes place.

Originally posted by humy
Why would it 'try' and do something against its programming?
...

That is very heavy. I'm serious.

The scare quotes though, what are they trying to tell us? Machines cannot try?

Originally posted by apathist
That is very heavy. I'm serious.

The scare quotes though, what are they trying to tell us? Machines cannot try?

I think the gist of it is, when AI gets to be superior to all humans in intelligence there is no programming we can instill that will stop them. Whether that is a good thing or bad TBD.