Hot answers tagged

8

"Current artificial intelligence research" is a pretty broad field. From where I sit, in a mostly CS realm, people are focused on narrow intelligence that can do economically relevant work on narrow tasks. (That is, predicting when components will fail, predicting which ads a user will click on, and so on.) For those sorts of tools, the generality of a ...


7

The authors do actually give an English definition in terms of the well-known agent formulation of AI: We intend this usage to be intuitive: death means that one sees no more percepts, and takes no more actions. It would seem that this becomes possible for a reinforcement learning agent such as AIXI in a formulation that uses semi-measures of ...


6

Is AIXI really a big deal in artificial general intelligence research? Yes, it is a great theoretical contribution to AGI. AFAIK, it is the most serious attempt to build a theoretical framework or foundation for AGI. Similar works are Schmidhuber's Gödel Machines and SOAR architecture. AIXI is an abstract and non-anthropomorphic framework for AGI which ...


4

AIXI is really a conceptual framework. All the hard work of actually compressing the environment still remains. To further discuss the question raised in Matthew Graves answer: given our current limited level of ability to represent complex environments, it seems to me that it doesn't make a lot of practical difference whether you start with AIXI as ...


1

This is known as reward hacking in the literature; see, e.g., https://medium.com/@deepmindsafetyresearch/designing-agent-incentives-to-avoid-reward-tampering-4380c1bb6cd for discussion and further links.


1

You make a lot of assumptions about AGI, namely that 'we need a computer to compute the utility and reward AGI'. It not clear to me that (1) we can achieve AGI, (2) AGI will be on a computer as we know it and (3) AGI will work with a utility / reward function as we know them. One thing I am sure though is that ML is known for "cheating" (see for ...


1

Gödel machine There is another mathematical framework for AGI: the Gödel machine, which was proposed by Jürgen Schmidhuber (who also worked with Marcus Hutter). In the paper Gödel Machines: Self-Referential Universal Problem Solvers Making Provably Optimal Self-Improvements (2003), Schmidhuber describes the Gödel machine as follows They are universal ...


Only top voted, non community-wiki answers of a minimum length are eligible