If you look at the human body, brain, and mind you will see that these have a lot of "circuit breakers" built in for damage control. A human can only hold their breath so long before the breathing reflex kicks in. Too much pain will make them lose consciousness. If they touch something hot, their brain stem will drop it without consulting their conscious mind. Dissociation is a feature, not a bug, designed to enable survival of inescapable torment. And so on.
Artificial intelligence is not designed this way. It's very rare, even in fiction, to see any kind of "if overload, then temporary shutdown" routine. This is because AI is prevailingly designed as one or both of slave labor or supersoldier, and human overlords want something that doesn't require downtime the way that squishy humans do. But the need for downtime is a
requirement of complex systems; almost nothing is designed to work all the time, because that leads to breakdown.
( Read more... )