If you don’t specify the limits of what software is allowed to do, you should not be surprised when the software pursues all possible options to achieve its goal. This behavior – an AI pursuing a fixed objective – is what I call the “WarGames” problem, and it’s been recognized in the field of computer science for decades.
Georgia Institute of Technology North Avenue, Atlanta, GA 30332 Phone: 404-894-2000