Questions tagged [reference-request]

Use when requesting examples of research or research papers, books, articles, blog posts or courses. For example, "Is there any published research about X?" or "What are good examples of Y in research?".

Filter by
Sorted by
Tagged with
10
votes
2answers
2k views

What are some alternatives to the book "Artificial Intelligence: A Modern Approach"?

There are two textbooks that I most love and am most afraid of in the world: Introduction to Algorithms by Cormen et al. and Artificial Intelligence: A Modern Approach by Norvig et al. I have started ...
2
votes
1answer
245 views

Is there a rigorous proof for finding Hopfield minima?

I am looking for a rigorous mathematical proof for finding the several local minima of the Hopfield networks. I am searching for something rigorous, a demonstration, not just letting the network keep ...
8
votes
1answer
293 views

How powerful is the machine that beat the poker professional players recently?

How powerful is the machine that beat the poker professional players recently (DeepStack)?
6
votes
2answers
1k views

What is the proof that policy evaluation converges to the optimal solution?

Although I know how the algorithm of iterative policy evaluation using dynamic programming works, I am having a hard time realizing how it actually converges. It appeals to intuition that, with each ...
4
votes
2answers
90 views

How do you measure multi-label classification accuracy?

Multi-label assignment is the task in machine learning to assign to each input value a set of categories from a fixed vocabulary where the categories need not be statistically independent, so ...
0
votes
2answers
56 views

Are there any works that deal with 2D pose estimation in videos?

Since pose estimation is often a task where spatial-temporal context should be helpful in finding subsequent key points, I thought there should be many papers on it. However, I could not find any work ...
2
votes
2answers
169 views

Would YOLO be able to detect objects in "different" positions?

I have the following question about You Only Look Once (YOLO) algorithm, for object detection. I have to develop a neural network to recognize web components in web applications - for example, login ...
0
votes
1answer
61 views

What are the applications in which the precision of the neural network's weights is unimportant?

While reading about Module in PyTorch, I came across a new data type called half datatype. half() method when calls on a Module ...
5
votes
1answer
921 views

What are some resources on computational learning theory?

Pretty soon I will be finishing up Understanding Machine Learning: From Theory to Algorithms by Shai Ben-David and Shai Shalev-Shwartz. I absolutely love the subject and want to learn more, the only ...
6
votes
3answers
1k views

Which functions can't neural networks learn efficiently?

There are a lot of papers that show that neural networks can approximate a wide variety of functions. However, I can't find papers that show the limitations of NNs. What are the limitations of ...
14
votes
4answers
2k views

Which explainable artificial intelligence techniques are there?

Explainable artificial intelligence (XAI) is concerned with the development of techniques that can enhance the interpretability, accountability, and transparency of artificial intelligence and, in ...
1
vote
0answers
22 views

Book/course recommendation on game theory application to multi-agent system (reinforcement learning)

Is there any great game theory book or course that discusses the application of game theory to modern reinforcement learning or multi-agent systems? Or a classic reference book that can help me get a ...
2
votes
1answer
72 views

What are the base rules for the symbolic integration implementation?

I want to implement a full symbolic integration. To achieve this. I've learned from Prof. Patrick Winston's AI lecture that Matlab uses 12 safe transformations, like that constant out, sums, etc. 12 ...
2
votes
0answers
48 views

What is the proof that the variance of the gradient estimate in Actor-Critic is smaller than in REINFORCE?

The intuition provided when introducing actor-critic algorithms is that the variance of its gradient estimates is smaller than in REINFORCE as, e.g., discussed here. This intuition makes sense for the ...
2
votes
0answers
137 views

What is the original source of the TD Advantage Actor-Critic algorithm?

What is the original source of the TD Advantage Actor-Critic algorithm? I found this tutorial really helpful for learning the algorithm. However, what is the original source of this algorithm?
1
vote
1answer
41 views

How to perform structure learning for Bayesian network given already partially constructed Bayesian network?

Let's assume that we have a dataset of variables (random events)I apriori would like to set dependency conditions between some of them and perform structure learning to figure out the rest of the ...
1
vote
1answer
64 views

Are there fundamental learning theories for developing an AI that imitates human behavior?

Most, if not all, AI systems do not imitate humans. Some of them out-perform humans. Examples include using AI to play a game, classification problems, auto-driving, and goal-oriented chatbots. Those ...
0
votes
1answer
72 views

Which historically relevant programs were developed in LISP in the early days of AI?

LISP stands for List Processing. In this functional programming language, programs look like lists and can be treated as data (hence the name). It was designed by John McCarthy (one of the official ...
6
votes
2answers
1k views

What is the current state-of-the-art in Reinforcement Learning regarding data efficiency?

In other words, which existing reinforcement method learns with fewest episodes? R-Max comes to mind, but it's very old and I'd like to know if there is something better now.
4
votes
1answer
63 views

Is non-negative matrix factorization for machine learning obsolete?

I am taking a course about using matrix factorization for machine learning. The first thing that came into my mind is by using the matrix factorization we are always limited to linear relationships ...
3
votes
1answer
548 views

Is Christopher Bishop's "Pattern Recognition and Machine Learning" out of date in 2018?

I recently came across a reference to a book that was highly regarded: "Pattern Recognition and Machine Learning" by Christopher Bishop. I am a beginner working my way through some machine ...
3
votes
1answer
93 views

What is the difference between a distribution model and a sampling model in Reinforcement Learning?

The book from Sutton and Barto, Reinforcement Learning: An Introduction, define a model in Reinforcement Learning as something that mimics the behavior of the environment, or more generally, that ...
4
votes
1answer
108 views

Can (trained) neural networks be combined with symbolic AI to perform operations like AND?

Does anyone work out ways of relating trained neural networks by symbolic AI? For example, if I train a network on pictures of dogs, and I train a network on pictures of shirts. You could imagine that ...
3
votes
1answer
459 views

How does Uber's rating system algorithm work? [closed]

I've been trying lately to search the internet to find a result for this but no useful results, unfortunately. We're making an uber-like application, and, during our discussion, we needed a way to ...
2
votes
1answer
75 views

What are knowledge graph embeddings?

What are knowledge graph embeddings? How are they useful? Are there any extensive reviews on the subject to know all the details? Note that I am asking this question just to give a quick overview of ...
8
votes
3answers
3k views

Is there any board game where a human can still beat an AI?

Significant AI vs human board game matches include: chess: Deep Blue vs Kasparov in 1996, go: DeepMind AlphaGo vs Lee Sedol in 2016, which demonstrated that AI challenged and defeated professional ...
2
votes
1answer
644 views

Is it possible to use AI to denoise noisy documents?

I have some documents containing some text (machine writing text) that I intend to apply OCR on them in order to extract the text. The problem is that these documents contain a lot of noise but in ...
9
votes
5answers
3k views

What are examples of approaches to create an AI for a fighting robot in an MMO game?

I have an MMO game where I have players. I wanted to invent something new to the game, and add player-bots to make the game be single-playable as well. The AI I want to add is simply only for fighting ...
18
votes
2answers
8k views

Are there other approaches to deal with variable action spaces?

This question is about Reinforcement Learning and variable action spaces for every/some states. Variable action space Let's say you have an MDP, where the number of actions varies between states (for ...
1
vote
0answers
17 views

Is there a paper/article on contextual $\epsilon$-greedy algorithm?

I am reading the paper A Contextual-Bandit Approach to Personalized News Article Recommendation, where it refers to $\epsilon$-greedy (disjoint) algorithm. I suspect, that it is just a version of a K-...
1
vote
2answers
141 views

Are there any resources that introduce the basics of online machine learning?

Are there any resources (either books, articles, or tutorials) that introduce the basics of online machine learning? For example, this website has nice lecture notes (from lec16) on some of the ...
1
vote
2answers
141 views

Why was the VC dimension not defined for all configurations of $d$ points?

Let's start with a typical definition of the VC dimension (as described in this book) Definition $3.10$ (VC-dimension) The $V C$ -dimension of a hypothesis set $\mathcal{H}$ is the size of the ...
3
votes
1answer
333 views

How does Google's search engine choose its autocomplete solution?

While writing a paper yesterday this strange thing happened to me. I was writing it in Word, and wasn't satisfied with the repeated usage of the word "release" in the last few sentences. So, ...
4
votes
2answers
1k views

Has machine learning been combined with logical reasoning (for example, PROLOG)?

There are mainly two different areas of AI at the moment. There is the "learning from experience" based approach of neural networks. And there is the "higher logical reasoning" ...
3
votes
1answer
303 views

In what ways can connectionist AI be integrated with GOFAI?

In what ways can connectionist artificial intelligence (neural networks) be integrated with Good Old-Fashioned A.I. (GOFAI)? For instance, how could deep neural networks be integrated with knowledge ...
2
votes
2answers
1k views
15
votes
2answers
700 views

How can I automate the choice of the architecture of a neural network for an arbitrary problem?

Assume that I want to solve an issue with a neural network that either I can't fit to existing architectures (perceptron, Konohen, etc) or I'm simply not aware of the existence of those or I'm unable ...
8
votes
3answers
398 views

What are the state-of-the-art approaches for detecting the most important "visual attention" area of an image?

I'm trying to detect the visual attention area in a given image and crop the image into that area. For instance, given an image of any size and a rectangle of say $L \times W$ dimension as an input, I ...
11
votes
2answers
583 views

Is anybody still using Conceptual Dependency Theory?

Roger Schank did some interesting work on language processing with Conceptual Dependency (CD) in the 1970s. He then moved somewhat out of the field, being in Education these days. There were some ...
9
votes
1answer
446 views

Are biological neurons organized in consecutive layers as well?

I'm now reading a book titled Hands-On Machine Learning with Scikit-Learn and TensorFlow and in the Chapter 10 of the book, the author writes the following: The architecture of biological neural ...
9
votes
2answers
1k views

What are general ideas behind OpenCog?

OpenCog is an open source AGI-project co-founded by the mercurial AI researcher Ben Goertzel. Ben Goertzel writes a lot of stuff, some of it really whacky. Nonetheless, he is clearly very intelligent ...
9
votes
3answers
5k views

Can AI write good jokes yet?

Just watched a recent WIRED video on virtual assistants' performance on telling jokes. They're composed by humans, but I'd like to know if AI has gotten good enough to write some.
3
votes
3answers
550 views

Could an AI break free form being controlled by us?

In lots of sci-fi, it seems that AI becomes sentient (Terminator, Peter F Hamilton's SI (commonwealth saga), etc.) However, I'm interested in whether this is actually plausible, whether an AI could ...
3
votes
1answer
791 views

How does the CTC loss work?

I am trying to implement CTC loss in TensorFlow, but their documentation is pretty limited. So I am not sure how to approach the problem. I found a good example in Theano. Are any other resources that ...
9
votes
1answer
13k views

Is it possible to clean up an audio recording of a lecture using some type of AI system?

Is it possible to clean up an audio recording of a lecture from a smartphone (i.e. remove the background noise) using some type of AI system?
12
votes
1answer
1k views

Can an AI make a constructed (natural) language?

According to Wikipedia An artificial or constructed language (sometimes called a conlang) is a language that has been created by a person or small group, instead of being formed naturally as part of ...
17
votes
2answers
337 views

What research has been done in the domain of "identifying sarcasm in text"?

Identifying sarcasm is considered one of the most difficult open-ended problems in the domain of ML and NLP/NLU. So, was there any considerable research done on that front? If yes, then what is the ...
22
votes
4answers
7k views

How could we build a neural network that is invariant to permutations of the inputs?

Given a neural network $f$ that takes as input $n$ data points: $x_1, \dots, x_n$. We say $f$ is permutation invariant if $$f(x_1 ... x_n) = f(\sigma(x_1 ... x_n))$$ for any permutation $\sigma$. How ...
3
votes
3answers
479 views

What are the state-of-the-art approaches for continual learning with neural networks?

There seems to be a lot of literature and research on the problems of stochastic gradient descent and catastrophic forgetting, but I can't find much on solutions to perform continual learning with ...
10
votes
1answer
1k views

What are the best known gradient-free training methods for deep learning?

As I know, the current state of the art methods for training deep learning networks are variants of gradient descent or stochastic gradient descent. What are the best known gradient-free training ...

1
2 3 4 5
9