Questions tagged [reference-request]

Use when requesting examples of research or research papers, books, articles, blog posts or courses. For example, "Is there any published research about X?" or "What are good examples of Y in research?".

Filter by
Sorted by
Tagged with
1
vote
1answer
44 views

What are examples of good free books that cover the back-propagation algorithm?

What are examples of good free books that cover the back-propagation used to train multilayer perceptrons? I've just started to learn about artificial neural networks, so I'm looking for books that ...
0
votes
0answers
23 views

Control Strategy for Multi-Agent Systems

I am working on a smart grid system which can be modeled with multiple agents interacting with each other. The agents are physically coupled with non-linearities, the action of one agent has a direct ...
0
votes
0answers
20 views

Are there any good tutorials on using continuous normalizing flows (with PyTorch)?

I just have a very general question. Are there any good tutorials on using continuous normalizing flows? I'd say I have a decent understanding of normalizing flows, but not their continuous variant. I'...
6
votes
2answers
269 views

Is there an ideal range of learning rate which always gives a good result almost in all problems?

I once read somewhere that there is a range of learning rate within which learning is optimal in almost all the cases, but I can't find any literature about it. All I could get is the following graph ...
3
votes
1answer
43 views

Is there a document with a list of conjectures or research problems regarding reinforcement learning (like the Millennium Prize Problems)?

Is there a document with a list of conjectures or research problems regarding reinforcement learning like the Millennium Prize Problems?
0
votes
0answers
31 views

Is there any research work on known malware detection systems based on AI?

I'm working on writing an article about the possibilities of modern AI-based algorithms to produce invisible self-learning malware, that can distribute itself throughout the internet and create ...
4
votes
2answers
362 views

Can CNNs be made robust to tricks where small changes cause misclassification?

I while ago I read that you can make subtle changes to an image that will ensure a good CNN will horribly misclassify the image. I believe the changes must exploit details of the CNN that will be used ...
1
vote
1answer
60 views

Is there a graph neural network algorithm that can deal with a different number of input and output nodes?

I am new to graph neural networks and their applications. I have an input graph $G = \{V, E\}$ and an output graph $G' = \{V', E'\}$ where the number of nodes $V$ and $V'$ are different. I am trying ...
2
votes
0answers
33 views

What is the paper that states that humans incorrectly trust the incorrect explanations of the AI?

I was reading a paper on the subject of explainable AI and interpretability, in particular the tendency of people (even experts) to excessively trusting explanations given by AI. In the intro the ...
0
votes
0answers
21 views

Is there any research on the detection of the user's emotion and stress based on the mouse movement and keyboard?

I have to create a model that can detect the user's emotion and stress level based on their mouse movement and keyboard typing activity. I didn't found any research work based on this. Is there any ...
2
votes
1answer
214 views

Are there any active areas of research in machine learning that do not involve neural networks at all?

So far, I have not been able to find many papers that do not involve neural networks, so I was hoping I can gain some insight here. Any references would be greatly appreciated.
2
votes
0answers
36 views

What is the first short film completely made by AI?

I have created (not me exactly) a short film entirely made by AI. There many short films (like Sunspring) 'written' by AI but were acted out by humans. In my short film, the story is by the AI, the ...
0
votes
0answers
36 views

Can I use a CNN for template matching, so that there is robustness, as the background of the target image is not that good?

I have to extract part of a source image, then I have to check if it is similar or almost similar to any of the 10 target images, so that I can do further processing on that one specific target image, ...
1
vote
0answers
20 views

Gradual decrease in performance of a DDPG agent

I'm trying to solve the OpenAI's CarRacing-v0 environment with the DDPG algorithm. I've observed that after a period of learning, the agent's performance starts to deteriorate slowly. For some ...
4
votes
0answers
48 views

Why are most commonly used activation functions continuous?

I have come to notice that the most commonly used activation functions are continuous. Is there any specific reason behind this? Results such as this paper have worked on training networks with ...
2
votes
0answers
20 views

What are some of the main high level approaches to applying ML on kinematic sensor data?

I've just started a project which will involve having to detect certain events in a stream of kinematic sensor data. By searching through the literature, I've found a lot of highly specific papers, ...
1
vote
1answer
42 views

Can cryptocurrency charts be estimated using neural networks?

If I were to make a neural network that predicts the value of e.g. Bitcoin tomorrow based on the chart of the last month, would that work? Of course, 100% accuracy cannot be reached, but a success ...
3
votes
0answers
30 views

Is non-negative matrix factorization for machine learning obsolete?

I am taking a course about using matrix factorization for machine learning. The first thing that came into my mind is by using the matrix factorization we are always limited to linear relationships ...
1
vote
0answers
21 views

What is the best approach for sentiment analysis when the text is very brief?

I'm working on a project to do sentiment analysis but my data is not long and properly formatted text. It's more likely to be very short sentences, e.g. tweets (in full tweet lingo), quick reviews of ...
0
votes
0answers
16 views

Apart from grammatical evolution, what are other examples of grammar-guided genetic programming approaches?

Grammatical Evolution (GE) is a well-known grammar-guided genetic programming (GGGP) approach, where we have genotypes (aka genomes or chromosomes) that are arrays (or lists) of integers (or groups of ...
2
votes
0answers
40 views

Are there any new weight initialization techniques for DNN published after 2015?

Considering weights initialization in my personal projects, I always used some standard techniques such as: Glorot (also known as Xavier) initialization (2010). Mertens initialization (2010). He ...
2
votes
1answer
55 views

Current research on Gödel machines

Is there any current research on Gödel machines? It seems that the last article by Jürgen Schmidhuber on this topic was published in 2012: http://people.idsia.ch/~juergen/goedelmachine.html
0
votes
0answers
22 views

Which AI technique should I use for (key)point detection (in an image of a plantar pressure)?

I am relatively new to the field of AI. I have a problem that I would like to solve with AI, but I don't know which buzzwords I should use to search for solutions. I have a plantar pressure scan, like ...
0
votes
0answers
50 views

Is my reward function non-Markovian?

I am working on an RL problem where the time when the agent obtains the reward for taking action $a$ in time step $t$ is stochastic. In fact, there is no immediate reward for taking action $a$ in time ...
2
votes
0answers
17 views

Can DQN outperform DoubleDQN?

I found a similar post about this issue, but unfortunately I did not find a proper answer. Are there any references where DQN is better than DoubleDQN, that is DoubleDQN does not improve DQN ?
0
votes
0answers
23 views

Is there a reference that describes Recurrent Neural Networks for NLP tasks?

I would like some references of works that try to understand the functioning of any kind of RNN in natural language processing tasks. They can be any work that tries to explain the functioning of the ...
0
votes
0answers
25 views

Correct way to work with both categorical and continuous features together

I have a time series with both continuous and categorical features, and I want to do a prediction task. I will elaborate: The data is composed of 100Hz sampling of some voltages, kind of like an ecg ...
4
votes
1answer
103 views

Research into social behavior in Prisoner's Dilemma

I've been working on research into reproducing social behavior using multi-agent reinforcement learning. My focus has been on a GridWorld-style game, but I was thinking that maybe a simpler Prisoner's ...
1
vote
0answers
21 views

Is there any research work that shows that we should explicitly mark the word boundaries for 1D CNNs?

I'm doing character embedding for NLP tasks using one-dimensional convolutional neural networks (see Chiu and Nichols (2016) for the motivation). I haven't found any empirical evidence of whether or ...
1
vote
1answer
68 views

Model-based RL for time series data

I have time-series data. When I take an action, it impacts the next state, because my action directly determines the next state, but it is not known what the impact is. To be concrete: I have $X(t)$ ...
1
vote
1answer
53 views

How to derive matrix form of the Bellman operators?

Reading the Retrace paper (Safe and efficient off-policy reinforcement learning) I saw they often use a matrix form of the Bellman operators, for example as in the picture below. How do we derive ...
3
votes
1answer
41 views

How can I do video classification while taking into account the temporal dependencies of the frames?

I need to solve a video classification problem. While looking for solutions, I only found solutions that transform this problem into a series of simpler image classification tasks. However, this ...
1
vote
2answers
77 views

Recent deep learning textbook (i.e. covering at least GANs, LSTM and transformers and attention)

I am searching for an academic (i.e. with maths formulae) textbook which covers (at least) the following: GAN LSTM and transformers (e.g. seq2seq) Attention mechanism The closest match I got is Deep ...
1
vote
0answers
13 views

Is there a pre-trained network trained on RGB-D (4) channels? [closed]

The most used pre-trained networks for computer vision (e.g. ResNet50) are trained on 3 channels (RGB). At the same time, many cameras used in robotics return RGB-D outputs, that is including depth ...
0
votes
1answer
53 views

Are there any good alternatives to an LSTM language model for text generation?

I have a trained LSTM language model and want to use it to generate text. The standard approach for this seems to be: Apply softmax function Take a weighted random choice to determine the next word ...
3
votes
1answer
107 views

Are there some notions of distance between two policies?

I want to determine some distance between two policies $\pi_1 (a \mid s)$ and $\pi_2 (a \mid s)$, i.e. something like $\vert \vert \pi_1 (a \mid s) - \pi_2(a \mid s) \vert \vert$, where $\pi_i (a\mid ...
1
vote
0answers
47 views

What are the differences between Proximal Policy Optimization versions PPO1 and PPO2?

When Proximal Policy Optimization (PPO) was released, it was accompanied by a paper describing it. Later, the authors at OpenAI introduced a second version of PPO, called PPO2 (whereas the original ...
1
vote
0answers
19 views

Is there any known approach to generate sets of objects?

I am looking for some known approach, or some previous work, on the following problem: Let $\Sigma$ be an alphabet of symbols and $\Sigma^*$ be the set of all the strings that you can compose from ...
1
vote
1answer
82 views

Can we use transformers for audio classification tasks?

Since transformers are good at processing sequential data, can we also use them for audio classification problems (same as RNNs)?
2
votes
0answers
24 views

Literature on the advantages of using an auto-encoder for classification

Given a supervised problem with X, y input pairs, one can do two things for obtaining the function f that maps X with y with Neural Networks (and in general in machine learning): Deploy directly a ...
2
votes
2answers
171 views

How to calculate the distance between the camera and an object using Computer Vision?

I want to create a Deep Learning model that measures the distance between the camera and certain objects in an image. Is it possible? Please, let me know some resources related to this task.
2
votes
1answer
58 views

Is there a taxonomy of adversarial attacks?

I am a medical doctor working on methodological aspects of health-oriented ML. Reproducibility, replicability, generalisability are critical in this area. Among many questions, some are raised by ...
0
votes
1answer
39 views

What is the impact of the number of features on the prediction power of a neural network?

What is the impact of the number of features on the prediction power of an ANN model (in general)? Does an increase in the number of features mean a more powerful prediction model (for approximation ...
1
vote
0answers
39 views

How exactly is hindsight experience replay related to potential-based reward shaping?

One of the reviewers of the HER paper (which was accepted as a NIPS conference paper) wrote Overall, I'd say that it's not a huge/deep idea, but a very nice addition to the learning toolbox. When it ...
1
vote
1answer
33 views

Is there some known pattern for selecting a batch of candidates for the next generation?

I'm a beginner with a classic "racing car" sandbox and a homemade simple neural network. My pattern: Copy the "top car" (without mutation) to the next generation If there are ...
3
votes
1answer
57 views

What are the state-of-the-art results in OpenAI's gym environments?

What are the state-of-the-art results in OpenAI's gym environments? Is there a link to a paper/article that describes them and how these SOTA results were calculated?
0
votes
0answers
61 views

Are there any reinforcement learning benchmarks where the optimal policy is known for each environment?

There are multiple reinforcement learning (RL) benchmarks (i.e. a set of environments where we can test our RL algorithms), for example, the DeepMind Control Suite. However, given that I am currently ...
2
votes
1answer
42 views

How do you measure multi-label classification accuracy?

Multi-label assignment is the task in machine learning to assign to each input value a set of categories from a fixed vocabulary where the categories need not be statistically independent, so ...
3
votes
0answers
58 views

How can I generate artificial conversations between two AIs?

I am building an artificial town that has randomly generated people with different personalities. People in this artificial town have attributes that change their happiness, ego, rep, etc. I already ...
1
vote
1answer
40 views

Are there any known models/techniques to determine whether a person in a store is a customer or a store representative?

Are there any known models/techniques to determine whether a person in a store is a customer or a store representative? For example, customer representatives can wear uniforms and then one possible ...

1
2 3 4 5 6