Hot answers tagged

3

I think the colloquial understanding of Gödel's incompleteness theorems allows them to be too broadly applied. Gödel's second incompleteness regards the consistency of a formal system, which is a technical concept of formal systems that means the system cannot prove every formula. It is commonly framed as a system not being able to prove both a formula and ...


3

A relatively recent but interesting paper that discusses this topic in more detail is Reward is enough (Artificial Intelligence, 2021) by David Silver, Satinder Singh, Doina Precup, and Richard S. Sutton (so by some of the godfathers of RL, who are all at DeepMind). Their reward-is-enough hypothesis (RIEH) (page 4) is Hypothesis (Reward-is-Enough). ...


3

Before proceeding and answering the actual question, it's worth noting that AI and AGI are not the same thing, as was the case at the beginning in 1956, as suggested in the official proposal for the Dartmouth workshop. Nowadays, people that consider themselves "AI researchers" or "AI practitioners" (e.g. myself) typically are not trying ...


2

Would OpenCog fit the bill? I have had tremendous amounts of trouble building up the demos, which include some non-AGI stuff, but if I’ve read the manual correctly, I think there’s something here — https://opencog.org/


2

Not to my knowledge. The problem is that this is such an enormous task, it cannot really be tackled at once. So the obvious solution is to reduce the scope. In early AI people were using toy domains, whereas nowadays AI systems work more generally (but still perform better if the domain is restricted). So while (slow) progress is being made putting the ...


1

Any possible action, including changing the reward function, would be evaluated through the initial reward function. In order to avoid the scenario you described, a reward function needs to disincentivize changes to itself by giving those the lowest possible reward.


1

do we really need a human-level AI to start the Singularity, or will an AI with animal-level intelligence suffice? The requirement from "theory" of the singularity is that: The AI is able to design and implement a better AI than itself. The trait of being able to design better than itself continues to apply in each iteration. If both these ...


1

My sense is that everyone is pretending Intelligence doesn't have a grounded definition, from which all other definitions arise: Intelligence is a measure of utility in an action space μ(υ) It can be a relative measure, in relation to other rational agents, or absolute in relation to solved games (problems). An action space is any context, and formalized ...


1

I think we give ourselves too much credit by already referring to our algorithms and machines as actually thinking and acting on motivations. In my opinion we still have a bit to go before we can actually refer to a human creation as thinking or being able to have motivations more then basic physical ones. By that I would say that a Machines' or AI ...


Only top voted, non community-wiki answers of a minimum length are eligible