The Risks of Uncontrolled AI.
Controlling a super-intelligent AI beyond human comprehension is almost impossible as it requires a simulation of the AI that we can analyze, but if we can't comprehend it, we can't create such a simulation. Rules such as 'cause no harm to humans' can't be set if we don't understand the kind of scenarios that an AI is going to come up with. Limiting the capabilities of the super-intelligence is not a solution either as it would limit the reach of the AI. Tech giants including Elon Musk and Steve Wozniak have signed an open letter asking humanity to pause work on AI for at least 6 months so that its safety could be explored.