Memes aside, the recent line of programming designed to teach a computerized system/object to disobey commands if detrimental to the object’s continued survival makes me nervous. More to the point, it makes me curious. Don’t you people read sci fi?! Three Laws of Robotics, anyone? Now I always wondered when the sci fi of my upbringing would mesh with the science of today. I’m not saying we are on a crash course to Cylons, but I am saying that ethics needs to play a role in where we go from here.
The roots of human intelligence are buried in self preservation. Once a being–digital or otherwise–develops the mechanism for self preservation, the next logical step is a form of a intelligence scripted to ensure that preservation. This doesn’t mea that computers are going to suddenly be smarter than us, but the concept of dog-smart computers and even more advanced machinations built around the idea of self-preservation and need for companionship will drive the industry before too long.
Like I said, I am not worried yet. I am curious about the way this is moving forward. I want to know what ethical considerations are coming into play here. I want to know the clear definitions associated with self preservation. I don’t want to wake up with an angry computer in my lap demanding I give it more processing time.