There are mainly two different areas of AI at the moment. There is the "learning from experience" based approach of neural networks. And there is the "higher logical reasoning" approach, with languages like LISP and PROLOG.

Has there been much overlap between these (I can't find much!)?

As a simple example, one could express some games in PROLOG and then use neural networks to try to play the game.

As a more complicated example, one would perhaps have a set of PROLOG rules which could be combined in various ways, and a neural network to evaluate the usefulness of the rules (by simulation). Or even create new PROLOG rules. (Neural networks have been used for language generation of a sort, so why not the generation of PROLOG rules, which could then be evaluated for usefulness by another neural network?)

As another example, a machine with PROLOG rules might be able to use a neural network to be able to encode these rules into some language that could be in turn decoded by another machine. And so express instructions to another machine.

I think, such a combined system that could use PROLOG rules, combine them, generate new ones, and evaluate them, could be highly intelligent. As it would have access to higher-order logic. And have some similarity to "thinking".


In reference to your exact question there is published research that attempts to bring these two areas together.

“HolStep: A Machine Learning Dataset for Higher-order Logic Theorem Proving” by Cezary Kaliszyk, François Chollet, Christian Szegedy (2017) https://arxiv.org/abs/1703.00426

That group also has other published work related to the subject.

Regardless of their results they list several areas of logical systems that are highly suited to machine learning methods:

• Predicting whether a statement is useful in the proof of a given conjecture

• Predicting the dependencies of a proof statement (premise selection)

• Predicting whether a statement is an important one (human named)

• Predicting which conjecture a particular intermediate statement originates from

• Predicting the name given to a statement

• Generating intermediate statements useful in the proof of a given conjecture

• Generating the conjecture the current proof will lead to

It’s tough to know whether or not you can combine Higher Order Logic and Machine Learning in an effective way without needing to create a general AI. This is equivalent to wondering if an effective merging of the two areas is an AI-complete / AI-hard problem.

There are active attempts at general AI by researchers such as Ben Goertzel (many others as well but just to give a popular name for googling). Research into general AI would give you an idea of whether or not other pieces of the puzzle are needed in order to create something “highly intelligent”.


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.