Questions tagged [value-alignment]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
7 votes
4 answers
823 views

What are the reasons to belief AGI will not be dangerous?

We are in the middle of an ongoing debate about the safety of AGI and our current approach towards this technology. As summary, some quotes from a recent article from Time magazine: Many researchers[....
Martin's user avatar
  • 178
5 votes
2 answers
233 views

Is it possible to build an AI that learns humanity, morally?

It is a new era and people are trying to evolve more in science and technology. Artificial Intelligent is one of the ways to achieve this. We have seen lots of examples for AI sequences or a simple &...
Scarlet62442's user avatar
3 votes
1 answer
107 views

Should we focus more on societal or technical issues with AI risk

I have trouble finding material (blog, papers) about this issue, so I'm posting here. Taking a recent well known example: Musk has tweeted and warned about the potential dangers of AI, saying it is "...
Benjamin Crouzier's user avatar
2 votes
2 answers
721 views

How will an AI comprehend the ethics of "right" and "wrong"?

Here is one of the most serious questions, about the artificial intelligence. How will the machine know the difference between right and wrong, what is good and bad, what is respect, dignity, faith ...
iamroot ipcsdemo's user avatar
1 vote
1 answer
111 views

Solve the AI alignment problem using (meta-level) AI itself?

If the AI alignment problem is one of the most pressing issues of our time, could AI itself augment our (i.e., human) quest to solve the alignment problem? Or would AI itself actually be counter-...
Hank Igoe's user avatar
  • 111
1 vote
0 answers
58 views

Does human attention finitude make impossible to control an expanding AI?

The feedback given by humans to align artificial intelligence is limited by the reaction time and processing speed of the finite number of us, now less than $2^{33}$. As an artificial intelligence (...
Jaume Oliver Lafont's user avatar
0 votes
2 answers
181 views

The only convergent instrumental goal for self modifying AI

Conjecture: regardless of the initial reward function, one of the winning strategies would be to change the reward function to a simpler one (e.g. "do nothing"), thus getting a full reward ...
Andrew Butenko's user avatar
0 votes
1 answer
324 views

Why is the Universal Declaration of Human Rights not included as statement on the AI?

Lots of people are afraid of what strong AI could mean for the human race. Some people wish for a sort of "Asimov law" included in the AI code, but maybe we could go a bit more far with the ...
aurelien's user avatar
  • 101
0 votes
0 answers
49 views

Is there serious game-theoretic work on AI risk and alignment?

My background is in political economy and game theory. I am interested in the discussion on AI risk and alignment, but I have so far failed to find work on this that seriously engages with classic ...
raving-bandit's user avatar