Questions tagged [reference-request]

Use when requesting examples of research or research papers, books, articles, blog posts or courses. For example, "Is there any published research about X?" or "What are good examples of Y in research?".

Filter by
Sorted by
Tagged with
8
votes
1answer
280 views

What are some resources on continuous state and action spaces MDPs for reinforcement learning?

Most introductions to the field of MDPs and Reinforcement learning focus exclusively on domains where space and action variables are integers (and finite). This way we are introduced quickly to Value ...
1
vote
2answers
48 views

Are there any good tutorials about training RL agent from raw pixels using PyTorch?

Is there any good tutorials about training reinforcement learning agent from raw pixels using PyTorch? I don't understand the official PyTorch tutorial. I want to train the agent on the atari ...
2
votes
0answers
20 views

What are the applications of hierarchical softmax?

Apart from its use in word embeddings (e.g word2vec algorithm), are there any other applications of hierarchical softmax? If yes, can you please give me some reference papers?
3
votes
2answers
303 views

Is there any good reference for double deep Q-learning?

I am new in reinforcement learning, but I already know deep Q-learning and Q-learning. Now, I want to learn about double deep Q-learning. Do you know any good references for double deep Q-learning? ...
1
vote
2answers
114 views

Is there any good source for when the pole actually starts all the way at the bottom, in the cartpole problem?

There are a lot of examples of balancing a pole (see image below) using reinforcement learning, but I find that almost all examples start close to the upright position. Is there any good source (or ...
2
votes
1answer
44 views

Which humanoid robots have open-source software (or hardware)?

Apart from iCub, whose open-source software can be found at https://github.com/robotology/icub-main, what other humanoid robots have open-source and freely accessible software (or hardware)?
2
votes
1answer
105 views

Which AGI systems have already been implemented and tested?

I wish to compile a (somewhat) comprehensive list of AGI systems that have actually been created and tested (to whatever degrees of success) instead of those that simply advertise they are going to '...
0
votes
1answer
34 views

Are there other mathematical frameworks of artificial general intelligence apart from AIXI?

AIXI is a mathematical framework for artificial general intelligence developed by Marcus Hutter since the year 2000. It's based on many concepts, such as reinforcement learning, Bayesian statistics, ...
8
votes
2answers
998 views

What are some alternatives to the book “Artificial Intelligence: A Modern Approach”?

There are two textbooks that I most love and am most afraid of in the world: Introduction to Algorithms by Cormen et al. and Artificial Intelligence: A Modern Approach by Norvig et al. I have started ...
5
votes
1answer
225 views

What are some resources for coding some artificial intelligence techniques in the context of games?

I know the most basic rudimentary theory on AI, and I want to delve into actual practical coding with AI and machine learning. I already know a decent bit of coding in C++ and I'm learning Python ...
0
votes
1answer
78 views

What are some online courses on artificial general intelligence?

Although no artificial general intelligence (AGI) has yet been created, probably, there are already some courses on the topic. So, what are some online (preferably free) courses on AGI?
2
votes
0answers
44 views

Is there a good book or paper on word embeddings?

Is there a good and modern book that focuses on word embeddings and their applications? It would also be ok to provide the name of a paper that provides a good overview of word embeddings.
1
vote
1answer
22 views

What are the most common feedforward neural networks?

What are the most common feedforward neural networks? What kind of inputs do they receive? For example, do they receive binary numbers, real numbers, vectors, or matrics? Is there such a taxonomy?
2
votes
0answers
18 views

Is there any published research on the information-carrying capacity of the human face?

Is there any published research on the information-carrying capacity of the human face? Here I mean "how much information can be conveyed via facial expressions & micro-expressions". This is a ...
6
votes
2answers
58 views

Where to publish replications of machine learning papers?

If I replicated the results of a machine learning paper, is there a website that I can publish my code to that collects informal replication attempts? https://paperswithcode.com/ allows anyone to ...
1
vote
0answers
31 views

Is there an AI system that, given a patient's symptoms, produces a diagnosis and suggests a treatment?

Is there an AI system (preferably, one that interacts with the human, such as a chatbot like this one) that, given some input (e.g. entered into the system by writing text), such as a person's ...
3
votes
3answers
64 views

What are some use cases of few-shot learning?

Besides computer vision and image classification, what other use cases/applications are for few-shot learning?
3
votes
3answers
978 views

Is there a mathematical proof that shows that certain parameters work “better” than others for a certain task?

The machine learning community often only provides empirical results, but I am also interested in theoretical results and proofs. Specifically, is there a mathematical proof that shows that certain ...
4
votes
1answer
54 views

Are there examples of neural networks (used for control) implemented on a FPGA or on a neurochip?

Greetings to all respected colleagues! I want to consult on the use of FPGAs and neurochips. I plan to use it in my laboratory project for programming control systems on neural networks. In my work,...
3
votes
0answers
32 views

Which machine learning method can take a matrix as input?

I am pretty new to the machine learning field. I want to use an $n \times m$ matrix as the input of a model, in order to predict a vector $1 \times m$, both of real numbers. Input data are quite clean,...
2
votes
1answer
445 views

Which machine learning models are universal function approximators?

The universal approximation theorem states that a feed-forward neural network with a single hidden layer containing a finite number of neurons can approximate a wide variety of interesting (...
3
votes
2answers
476 views

Is there an AI system that automatically generates classes and methods by giving it voice commands?

I want to develop (in Java) a voice plugin for Eclipse on a Mac that helps me jot down high-level classes and stub methods. For example, I would like to command it to create a class that inherits from ...
3
votes
1answer
794 views

Are there papers about automatic punctuation of written text?

I am building a system that should take text without punctuation and automatically add punctuation. I found some papers about automatic punctuation, but they are mostly about spoken language ...
2
votes
0answers
20 views

Is there an online RL algorithm that receives as input a camera frame and produces an action as output?

I want to build a reinforcement learning model, which takes a camera picture as input, that learns online (in terms of machine learning). Based on the position of an object on the camera, I want the ...
17
votes
4answers
4k views

Permutation invariant neural networks

Given a neural network $f$ that takes as input $n$ data points: $x_1, \dots, x_n$. We say $f$ is permutation invariant if $$f(x_1 ... x_n) = f(\sigma(x_1 ... x_n))$$ for any permutation $\...
1
vote
1answer
28 views

Can I do state space quantization using a KMeans-like algorithm instead of range buckets?

Are there any reference papers where it is used a KMeans-like algorithm in state space quantization in Reinforcement Learning instead of range buckets?
1
vote
0answers
22 views

When to do quantization to decrease the state/action space in RL?

When to do quantization to decrease the state/action space in RL? Can you give me some references that such a technique is used?
1
vote
1answer
21 views

What are some conferences for publishing papers on graph convolutional networks?

What are some conferences for publishing papers on graph convolutional networks?
0
votes
0answers
21 views

What are some papers on face comparison in videos?

I have the following problem. Given two random frames in a video of some people, assume I can detect all faces in both frames. I would like to create a classifier that takes in pairs of faces out of ...
2
votes
2answers
86 views

Is AI already being used in the drug industry to combat the COVID-19?

We all have heard about how beneficial AI can be in health. There are plenty of papers and research about confronting against diseases, like cancer. However in 2020 with COVID-19 be one of the most ...
6
votes
3answers
108 views

What are some resources with exercises related to neural networks?

I am asking for a book (or any other online resource) where we can solve exercises related to neural networks, similar to the books or online resources dedicated to mathematics where we can solve ...
2
votes
1answer
27 views

When labelled data is not available, what are some common unsupervised learning algorithms for pattern recognition that can be used?

In pattern recognition systems, when no labeled data is available, what are some common unsupervised learning algorithms for pattern recognition, that can be used?
1
vote
0answers
13 views

Are there any board game appropriate to examine the performance of multiple agents that cooperate both inter-group and intra-group?

I want to find out scenarios that useful to examine the performance of intra-group and inter-group cooperation in MARL. Specifically, I prefer a board game (like sudoku) that is suitable for the ...
1
vote
2answers
46 views

What kinds of techniques do autopilots of autonomous cars use?

What kinds of techniques do autopilots of autonomous cars (e.g. the ones of Tesla) use? Do they use reinforcement learning? Which types of neural network architecture do they use?
3
votes
3answers
447 views

Which functions can't neural networks learn efficiently?

There are a lot of papers that show that neural networks can approximate a wide variety of functions. However, I can't find papers that show the limitations of NNs. What are the limitations of ...
4
votes
1answer
351 views

What are some resources on computational learning theory?

Pretty soon I will be finishing up Understanding Machine Learning: From Theory to Algorithms by Shai Ben-David and Shai Shalev-Shwartz. I absolutely love the subject and want to learn more, the only ...
0
votes
0answers
16 views

Are there any good research papers on image identification with limited data?

I'm a newbie in machine learning and I am interested in neural networks. Are there any good research papers on image identification with limited data?
1
vote
1answer
32 views

Is there a good and easy paper to code policy gradient algorithms (REINFORCE) from scratch?

I am interested in learning about policy gradient algorithms and REINFORCE. Can you suggest a good and easy paper that I can use to code them from scratch?
3
votes
2answers
76 views

What is the proof that policy evaluation converges to the optimal solution?

Although I know how the algorithm of iterative policy evaluation using dynamic programming works, I am having a hard time realizing how it actually converges. It appeals to intuition that, with each ...
1
vote
1answer
32 views

Which simulation platform is used by DeepMind (and others) to handle inverse kinematics musculoskeletal?

Which simulation platform is used by DeepMind and others to handle inverse kinematics musculoskeletal simulation, etc., for reinforcement learning simulations and agents? I thought they use Unity or ...
2
votes
1answer
189 views

What are the most common deep reinforcement learning algorithms and models apart from DQN?

Recently, I have completed Atari Breakout (https://arxiv.org/pdf/1312.5602.pdf) with DQN. Similar to DQN, what are the most common deep reinforcement learning algorithms and models in 2020? It seems ...
1
vote
0answers
18 views

Are there any training datasets using standard font text rather than hand written ones?

Are there any training datasets using standard font text rather than handwritten ones? I tried using the MNIST handwritten one on font based chars, but it didn't work well.
5
votes
1answer
95 views

Which Rosenblatt's paper describes Rosenblatt's perceptron training algorithm?

I struggle to find Rosenblatt's perceptron training algorithm in any of his publications from 1957 - 1961, namely: Principles of Neurodynamics: Perceptrons and the Theory of Brain Mechanisms The ...
3
votes
1answer
56 views

How can I use machine learning to predict properties (such as the area) of simple polygons?

Imagine a set of simple (non-self-intersecting) polygons given by the coordinate pairs of their vertices $[(x_1, y_1), (x_2, y_2), \dots,(x_n, y_n)]$. The polygons in the set have a different number ...
4
votes
1answer
55 views

Is there any literature on the design of dialogue systems for interviews and questionnaire administration?

For my master thesis I am working on a dialogue system that should be deployed in hospitals to administer simple questionnaires to patients. I already did literature research and I'm fine with what I ...
2
votes
1answer
43 views

Which work originally introduced gradient clipping?

The Deep Learning book mentions that it's been used for years but the oldest sources it mentions are from 2012: A simple type of solution has been in use by practitioners for many years: clipping ...
7
votes
3answers
398 views

What types of applications qualify as “compound intelligences”?

A question about swarm intelligence as a potential method of strong general AI came up recently, and yielded some useful answers and clarifications regarding the nature of swarm intelligence. But it ...
1
vote
0answers
15 views

Will structured knowledge bases continue to be used in question answering with the likes of BERT gaining popularity?

This may come across as an open and opinion-based question, I definitely want to hear expert opinions on the subject but I am also looking for references to materials that I can read deeply. One of ...
4
votes
1answer
89 views

Detailed resource for a naive example-based machine translation algorithm

I'm looking to develop a machine translation tool for a constructed language. I think that the example-based approach is the most suitable because the said language is very regular and I can have a ...
2
votes
0answers
20 views

Boston Housing Current Best Model

I'm currently looking for a standard data-set to test some new regression models I've been developing on, and the "Boston Housing Prices" data-set seemed to stand out, since it's very standard. ...