Questions tagged [ai-safety]
For questions regarding various parameters/methods of implementation/improvement/analyzing the safety of an Artificially Intelligent algorithm. A typical real world example is autonomous vehicles.
6
questions with no upvoted or accepted answers
3
votes
1
answer
331
views
Does Rice's theorem prove safe AI is undecidable?
According to Wikipedia
In computability theory, Rice's theorem states that all non-trivial,
semantic properties of programs are undecidable. A semantic property
is one about the program's ...
- 169
2
votes
0
answers
136
views
What are the main arguments predicting a Soft Takeoff vs Hard Takeoff scenario and viceversa?
Here I am referring to the term AI Takeoff as described here on LessWrong, with annexed "Soft" and "Hard" takeoff definitions.
I find that page to be biased slightly more towards ...
- 279
1
vote
0
answers
68
views
Has there been an instance of an AI agent breaking out of its sandbox?
There have been instances of agents using edge cases like bugs in physics engines, repetitive behavior in games or word repetition in text prediction to cheat their reward function. However, these ...
- 121
1
vote
0
answers
143
views
Are the existential dangers of AI exaggerated?
I understand some of the inherent dangers involved with AGI and advanced machine learning. While I can see some of the more low-level risks associated with AI coming to fruition (deep-fakes, biased ...
- 129
1
vote
0
answers
28
views
To what level of abstraction must fully automated vehicles build their driving model before safety can be maximized?
There are several levels of abstraction involved in piloting and driving.
Signals representing the state of the vehicle and its environment originating from multiple transducers1
Latched sample ...
- 7,393
0
votes
0
answers
12
views
Contradiction in a single sentence - Is this an artifact of an external safety mechanisms?
My system prompt contained "Never apologize."
An answer started with
Entschuldigung, ich habe Ihre Anweisung, sich nicht zu entschuldigen, übersehen.
which is quite well translated from ...
- 389