Questions tagged [reference-request]

Use when requesting examples of research or research papers, books, articles, blog posts or courses. For example, "Is there any published research about X?" or "What are good examples of Y in research?".

Filter by
Sorted by
Tagged with
19
votes
3answers
7k views

Where can I find the proof of the universal approximation theorem?

The Wikipedia article for the universal approximation theorem cites a version of the universal approximation theorem for Lebesgue-measurable functions from this conference paper. However, the paper ...
14
votes
4answers
2k views

Which explainable artificial intelligence techniques are there?

Explainable artificial intelligence (XAI) is concerned with the development of techniques that can enhance the interpretability, accountability, and transparency of artificial intelligence and, in ...
3
votes
3answers
5k views

How is the depth of a convolutional layer determined?

I am looking at a diagram of ZFNet below, in an attempt to understand how CNNs are designed. In the first layer, I understand the depth of 3 (224x224x3) is the number of color channels in the image. ...
5
votes
1answer
921 views

What are some resources on computational learning theory?

Pretty soon I will be finishing up Understanding Machine Learning: From Theory to Algorithms by Shai Ben-David and Shai Shalev-Shwartz. I absolutely love the subject and want to learn more, the only ...
4
votes
2answers
256 views

What introductory books to reinforcement learning do you know, and how do they approach this topic?

Currently, I'm only going through these two books Reinforcement Learning: An Introduction, by Sutton and Barto: RL explained on an engineering level (mathematical, but readable for a non-...
18
votes
2answers
8k views

Are there other approaches to deal with variable action spaces?

This question is about Reinforcement Learning and variable action spaces for every/some states. Variable action space Let's say you have an MDP, where the number of actions varies between states (for ...
9
votes
5answers
660 views

What's a good resource for getting familiar with reinforcement learning?

I am familiar with supervised and unsupervised learning. I did the SaaS course done by Andrew Ng on Coursera.org. I am looking for something similar for reinforcement learning. Can you recommend ...
12
votes
1answer
354 views

What are the state-of-the-art results on the generalization ability of deep learning methods?

I've read a few classic papers on different architectures of deep CNNs used to solve varied image-related problems. I'm aware there's some paradox in how deep networks generalize well despite ...
0
votes
1answer
131 views

Are there other mathematical frameworks of artificial general intelligence apart from AIXI?

AIXI is a mathematical framework for artificial general intelligence developed by Marcus Hutter since the year 2000. It's based on many concepts, such as reinforcement learning, Bayesian statistics, ...
1
vote
2answers
547 views

How can we estimate the transition model and reward function?

In reinforcement learning (RL), there are model-based and model-free algorithms. In short, model-based algorithms use a transition model (e.g. a probability distribution) and the reward function, even ...
57
votes
11answers
10k views

What are some well-known problems where neural networks don't do very well?

Background: It's well-known that neural networks offer great performance across a large number of tasks, and this is largely a consequence of their universal approximation capabilities. However, in ...
19
votes
3answers
2k views

What are the mathematical prerequisites for an AI researcher?

What are the mathematical prerequisites for understanding the core part of various algorithms involved in artificial intelligence and developing one's own algorithms? Please, refer to some specific ...
26
votes
8answers
4k views

Is there any research on the development of attacks against artificial intelligence systems?

Is there any research on the development of attacks against artificial intelligence systems? For example, is there a way to generate a letter "A", which every human being in this world can recognize ...
10
votes
2answers
2k views

What are some alternatives to the book "Artificial Intelligence: A Modern Approach"?

There are two textbooks that I most love and am most afraid of in the world: Introduction to Algorithms by Cormen et al. and Artificial Intelligence: A Modern Approach by Norvig et al. I have started ...
2
votes
1answer
348 views

What are some online courses on artificial general intelligence?

Although no artificial general intelligence (AGI) has yet been created, probably, there are already some courses on the topic. So, what are some online (preferably free) courses on AGI?
8
votes
2answers
4k views

When should I use 3D convolutions?

I am new to convolutional neural networks, and I am learning 3D convolution. What I could understand is that 2D convolution gives us relationships between low-level features in the X-Y dimension, ...
8
votes
3answers
2k views

How can you represent the state and action spaces for a card game in the case of a variable number of cards and actions?

I know how a machine can learn to play Atari games (Breakout): Playing Atari with Reinforcement Learning. With the same technique, it is even possible to play FPS games (Doom): Playing FPS Games with ...
6
votes
2answers
2k views

What are other examples of theoretical machine learning books?

I am looking for a book about machine learning that would suit my physics background. I am more or less familiar with classical and complex analysis, theory of probability, сcalculus of variations, ...
15
votes
2answers
700 views

How can I automate the choice of the architecture of a neural network for an arbitrary problem?

Assume that I want to solve an issue with a neural network that either I can't fit to existing architectures (perceptron, Konohen, etc) or I'm simply not aware of the existence of those or I'm unable ...
5
votes
3answers
294 views

How is neural architecture search performed?

I have come across something that IBM offers called neural architecture search. You feed it a data set and it outputs an initial neural architecture that you can train. How is neural architecture ...
6
votes
2answers
2k views

How to write a C decompiler using AI?

I would like to learn more about whether it is possible and how to write a program that decompiles executable binary (an object file) to the C source. I'm not asking exactly 'how', but rather how this ...
3
votes
1answer
303 views

In what ways can connectionist AI be integrated with GOFAI?

In what ways can connectionist artificial intelligence (neural networks) be integrated with Good Old-Fashioned A.I. (GOFAI)? For instance, how could deep neural networks be integrated with knowledge ...
2
votes
2answers
90 views

AI with conflicting objectives?

A recent question on AI and acting recalled me to the idea that in drama, there are not only conflicting motives between agents (characters), but a character may themselves have objectives that are in ...
1
vote
1answer
85 views

Should one use an "other" category in image classification?

In image classification, there are sometimes images that do not fit in any category. For example, if I build a CNN in Keras to classify Dogs and Cats, does it help (in terms of training time and ...
12
votes
3answers
20k views

Is it possible to train a neural network to estimate a vehicle's length?

I have a large dataset (over 100k samples) of vehicles with the ground truth of their lengths. Is it possible to train a deep network to measure/estimate vehicle length? I haven't seen any papers ...
13
votes
4answers
12k views

Where can I find the original paper that introduced RNNs?

I was able to find the original paper on LSTM, but I was not able to find the paper that introduced "vanilla" RNNs. Where can I find it?
13
votes
6answers
415 views

Are there any decentralized examples of AI systems with blockchain technology?

Has there been any attempts to deploy AI with blockchain technology? Are there any decentralized examples of AI networks with no central point of control with AI nodes acting independently (but ...
6
votes
3answers
1k views

Which functions can't neural networks learn efficiently?

There are a lot of papers that show that neural networks can approximate a wide variety of functions. However, I can't find papers that show the limitations of NNs. What are the limitations of ...
6
votes
2answers
1k views

What is the proof that policy evaluation converges to the optimal solution?

Although I know how the algorithm of iterative policy evaluation using dynamic programming works, I am having a hard time realizing how it actually converges. It appeals to intuition that, with each ...
3
votes
2answers
263 views

What are some books or state of the art papers about the development of a strong-AI?

I am looking for books or to state of the art papers about current the development trends for a strong-AI. Please, do not include opinions about the books, just refer the book with a brief ...
11
votes
1answer
10k views

Are the dialogs at Sophia's (the robot) appearings scripted?

I talk about the robot from: Hanson Robotics, which was granted the right to citizenship from Saudi Arabia. I have found the following articles: Your new friend is a humanoid robot Source: ...
7
votes
1answer
90 views

Medical diagnosis systems based on artificial neural networks

Are there any medical diagnosis systems that are already used somewhere that are based on artificial neural networks?
5
votes
1answer
509 views

Which Rosenblatt's paper describes Rosenblatt's perceptron training algorithm?

I struggle to find Rosenblatt's perceptron training algorithm in any of his publications from 1957 - 1961, namely: Principles of Neurodynamics: Perceptrons and the Theory of Brain Mechanisms The ...
3
votes
2answers
560 views

Apart from the state and state-action value functions, what are other examples of value functions used in RL?

In reinforcement learning, we often define two functions, the state-value function $$V^\pi(s) = \mathbb{E}_{\pi} \left[\sum_{k=0}^{\infty} \gamma^{k}R_{t+k+1} \Bigg| S_t=s \right]$$ and the state-...
5
votes
3answers
396 views

Does an AI exist that can write software based on a formal specification?

Does an AI exist that can automatically write software based on a formal specification of the software?
4
votes
0answers
84 views

Forcing a neural network to be close to a previous model - Regularization through given model

I'm wondering, has anyone seen any paper where one trains a network but biases it to produce similar outputs to a given model (such as one given from expert opinion or it being a previously trained ...
4
votes
1answer
375 views

What kind of algorithm is used by StackGAN to generate realistic images from text?

What kind of algorithm is used by StackGAN to generate realistic images from text? How does StackGAN work?
2
votes
1answer
961 views

Is there a simple proof of the convergence of TD(0)?

Does anybody know a simple proof of the convergence of the TD(0) value function prediction algorithm?
1
vote
0answers
28 views

Are there any good research papers on image identification with limited data?

I'm a newbie in machine learning and I am interested in neural networks. Are there any good research papers on image identification with limited data?
8
votes
3answers
949 views

Is there any research on the application of AI for drug design?

Is there any research on the application of AI for drug design? For example, you could train a deep learning model about current compounds, substances, structures, and their products and chemical ...
8
votes
3answers
3k views

Is there any board game where a human can still beat an AI?

Significant AI vs human board game matches include: chess: Deep Blue vs Kasparov in 1996, go: DeepMind AlphaGo vs Lee Sedol in 2016, which demonstrated that AI challenged and defeated professional ...
3
votes
1answer
113 views

How can I learn tensors for deep learning?

I've seen in most deep learning papers use tensors. I understood what tensors are, but I want to dive into them, because I think that might be beneficial for further studies in Artificial Intelligence....
3
votes
3answers
479 views

What are the state-of-the-art approaches for continual learning with neural networks?

There seems to be a lot of literature and research on the problems of stochastic gradient descent and catastrophic forgetting, but I can't find much on solutions to perform continual learning with ...
3
votes
0answers
80 views

Is there a good book or paper on word embeddings?

Is there a good and modern book that focuses on word embeddings and their applications? It would also be ok to provide the name of a paper that provides a good overview of word embeddings.
3
votes
1answer
157 views

Are there some notions of distance between two policies?

I want to determine some distance between two policies $\pi_1 (a \mid s)$ and $\pi_2 (a \mid s)$, i.e. something like $\vert \vert \pi_1 (a \mid s) - \pi_2(a \mid s) \vert \vert$, where $\pi_i (a\mid ...
2
votes
1answer
86 views

Is there a taxonomy of adversarial attacks?

I am a medical doctor working on methodological aspects of health-oriented ML. Reproducibility, replicability, generalisability are critical in this area. Among many questions, some are raised by ...
2
votes
1answer
2k views

What are some good alternatives to U-Net for biomedical image segmentation?

Soon I will be working on biomedical image segmentation (microscopy images). There will be a small amount of data (a few dozens at best). Is there a neural network, that can compete with U-Net, in ...
2
votes
0answers
65 views

Are there any new weight initialization techniques for DNN published after 2015?

Considering weights initialization in my personal projects, I always used some standard techniques such as: Glorot (also known as Xavier) initialization (2010). Mertens initialization (2010). He ...
2
votes
1answer
795 views

Are there any machine learning techniques to detect coding standard violations?

Are there any machine learning techniques (such as deep learning or evolutionary algorithms) to detect coding standard violations? Which one would be more suitable? I don't have any specific ...
2
votes
1answer
790 views

Which neural network architectures are there that perform 3D convolutions?

I am trying to do 3d image deconvolution using convolution neural network. But I cannot find many famous CNNs that perform a 3d convolution. Can anyone point out some for me? Background: I am using ...