Questions tagged [reference-request]

Use when requesting examples of research or research papers, books, articles, blog posts or courses. For example, "Is there any published research about X?" or "What are good examples of Y in research?".

Filter by
Sorted by
Tagged with
2
votes
0answers
10 views

Why are most commonly used activation functions continuous?

I have come to notice that the most commonly used activation functions are continuous. Is there any specific reason behind this? Results such as this paper have worked on training networks with ...
2
votes
0answers
18 views

What are some of the main high level approaches to applying ML on kinematic sensor data?

I've just started a project which will involve having to detect certain events in a stream of kinematic sensor data. By searching through the literature, I've found a lot of highly specific papers, ...
1
vote
1answer
29 views

Can cryptocurrency charts be estimated using neural networks?

If I were to make a neural network that predicts the value of e.g. Bitcoin tomorrow based on the chart of the last month, would that work? Of course, 100% accuracy cannot be reached, but a success ...
3
votes
0answers
25 views

Is non-negative matrix factorization for machine learning obsolete?

I am taking a course about using matrix factorization for machine learning. The first thing that came into my mind is by using the matrix factorization we are always limited to linear relationships ...
1
vote
0answers
18 views

What is the best approach for sentiment analysis when the text is very brief?

I'm working on a project to do sentiment analysis but my data is not long and properly formatted text. It's more likely to be very short sentences, e.g. tweets (in full tweet lingo), quick reviews of ...
0
votes
0answers
11 views

Apart from grammatical evolution, what are other examples of grammar-guided genetic programming approaches?

Grammatical Evolution (GE) is a well-known grammar-guided genetic programming (GGGP) approach, where we have genotypes (aka genomes or chromosomes) that are arrays (or lists) of integers (or groups of ...
2
votes
0answers
32 views

Are there any new weight initialization techniques for DNN published after 2015?

Considering weights initialization in my personal projects, I always used some standard techniques such as: Glorot (also known as Xavier) initialization (2010). Mertens initialization (2010). He ...
2
votes
1answer
33 views

Current research on Gödel machines

Is there any current research on Gödel machines? It seems that the last article by Jürgen Schmidhuber on this topic was published in 2012: http://people.idsia.ch/~juergen/goedelmachine.html
0
votes
0answers
20 views

Which AI technique should I use for (key)point detection (in an image of a plantar pressure)?

I am relatively new to the field of AI. I have a problem that I would like to solve with AI, but I don't know which buzzwords I should use to search for solutions. I have a plantar pressure scan, like ...
0
votes
0answers
48 views

Is my reward function non-Markovian?

I am working on an RL problem where the time when the agent obtains the reward for taking action $a$ in time step $t$ is stochastic. In fact, there is no immediate reward for taking action $a$ in time ...
2
votes
0answers
16 views

Can DQN outperform DoubleDQN?

I found a similar post about this issue, but unfortunately I did not find a proper answer. Are there any references where DQN is better than DoubleDQN, that is DoubleDQN does not improve DQN ?
0
votes
0answers
21 views

Is there a reference that describes Recurrent Neural Networks for NLP tasks?

I would like some references of works that try to understand the functioning of any kind of RNN in natural language processing tasks. They can be any work that tries to explain the functioning of the ...
0
votes
0answers
25 views

Correct way to work with both categorical and continuous features together

I have a time series with both continuous and categorical features, and I want to do a prediction task. I will elaborate: The data is composed of 100Hz sampling of some voltages, kind of like an ecg ...
4
votes
1answer
100 views

Research into social behavior in Prisoner's Dilemma

I've been working on research into reproducing social behavior using multi-agent reinforcement learning. My focus has been on a GridWorld-style game, but I was thinking that maybe a simpler Prisoner's ...
1
vote
0answers
20 views

Is there any research work that shows that we should explicitly mark the word boundaries for 1D CNNs?

I'm doing character embedding for NLP tasks using one-dimensional convolutional neural networks (see Chiu and Nichols (2016) for the motivation). I haven't found any empirical evidence of whether or ...
1
vote
1answer
62 views

Model-based RL for time series data

I have time-series data. When I take an action, it impacts the next state, because my action directly determines the next state, but it is not known what the impact is. To be concrete: I have $X(t)$ ...
1
vote
1answer
52 views

How to derive matrix form of the Bellman operators?

Reading the Retrace paper (Safe and efficient off-policy reinforcement learning) I saw they often use a matrix form of the Bellman operators, for example as in the picture below. How do we derive ...
3
votes
1answer
41 views

How can I do video classification while taking into account the temporal dependencies of the frames?

I need to solve a video classification problem. While looking for solutions, I only found solutions that transform this problem into a series of simpler image classification tasks. However, this ...
1
vote
2answers
74 views

Recent deep learning textbook (i.e. covering at least GANs, LSTM and transformers and attention)

I am searching for an academic (i.e. with maths formulae) textbook which covers (at least) the following: GAN LSTM and transformers (e.g. seq2seq) Attention mechanism The closest match I got is Deep ...
1
vote
0answers
13 views

Is there a pre-trained network trained on RGB-D (4) channels? [closed]

The most used pre-trained networks for computer vision (e.g. ResNet50) are trained on 3 channels (RGB). At the same time, many cameras used in robotics return RGB-D outputs, that is including depth ...
0
votes
1answer
50 views

Are there any good alternatives to an LSTM language model for text generation?

I have a trained LSTM language model and want to use it to generate text. The standard approach for this seems to be: Apply softmax function Take a weighted random choice to determine the next word ...
2
votes
1answer
96 views

Are there some notions of distance between two policies?

I want to determine some distance between two policies $\pi_1 (a \mid s)$ and $\pi_2 (a \mid s)$, i.e. something like $\vert \vert \pi_1 (a \mid s) - \pi_2(a \mid s) \vert \vert$, where $\pi_i (a\mid ...
1
vote
0answers
28 views

What are the differences between Proximal Policy Optimization versions PPO1 and PPO2?

When Proximal Policy Optimization (PPO) was released, it was accompanied by a paper describing it. Later, the authors at OpenAI introduced a second version of PPO, called PPO2 (whereas the original ...
1
vote
0answers
19 views

Is there any known approach to generate sets of objects?

I am looking for some known approach, or some previous work, on the following problem: Let $\Sigma$ be an alphabet of symbols and $\Sigma^*$ be the set of all the strings that you can compose from ...
1
vote
1answer
48 views

Can we use transformers for audio classification tasks?

Since transformers are good at processing sequential data, can we also use them for audio classification problems (same as RNNs)?
2
votes
0answers
22 views

Literature on the advantages of using an auto-encoder for classification

Given a supervised problem with X, y input pairs, one can do two things for obtaining the function f that maps X with y with Neural Networks (and in general in machine learning): Deploy directly a ...
2
votes
2answers
118 views

How to calculate the distance between the camera and an object using Computer Vision?

I want to create a Deep Learning model that measures the distance between the camera and certain objects in an image. Is it possible? Please, let me know some resources related to this task.
2
votes
1answer
52 views

Is there a taxonomy of adversarial attacks?

I am a medical doctor working on methodological aspects of health-oriented ML. Reproducibility, replicability, generalisability are critical in this area. Among many questions, some are raised by ...
0
votes
1answer
39 views

What is the impact of the number of features on the prediction power of a neural network?

What is the impact of the number of features on the prediction power of an ANN model (in general)? Does an increase in the number of features mean a more powerful prediction model (for approximation ...
1
vote
0answers
36 views

How exactly is hindsight experience replay related to potential-based reward shaping?

One of the reviewers of the HER paper (which was accepted as a NIPS conference paper) wrote Overall, I'd say that it's not a huge/deep idea, but a very nice addition to the learning toolbox. When it ...
1
vote
1answer
33 views

Is there some known pattern for selecting a batch of candidates for the next generation?

I'm a beginner with a classic "racing car" sandbox and a homemade simple neural network. My pattern: Copy the "top car" (without mutation) to the next generation If there are ...
3
votes
1answer
48 views

What are the state-of-the-art results in OpenAI's gym environments?

What are the state-of-the-art results in OpenAI's gym environments? Is there a link to a paper/article that describes them and how these SOTA results were calculated?
1
vote
0answers
61 views

Are there any reinforcement learning benchmarks where the optimal policy is known for each environment?

There are multiple reinforcement learning (RL) benchmarks (i.e. a set of environments where we can test our RL algorithms), for example, the DeepMind Control Suite. However, given that I am currently ...
2
votes
1answer
42 views

How do you measure multi-label classification accuracy?

Multi-label assignment is the task in machine learning to assign to each input value a set of categories from a fixed vocabulary where the categories need not be statistically independent, so ...
3
votes
0answers
54 views

How can I generate artificial conversations between two AIs?

I am building an artificial town that has randomly generated people with different personalities. People in this artificial town have attributes that change their happiness, ego, rep, etc. I already ...
1
vote
1answer
40 views

Are there any known models/techniques to determine whether a person in a store is a customer or a store representative?

Are there any known models/techniques to determine whether a person in a store is a customer or a store representative? For example, customer representatives can wear uniforms and then one possible ...
1
vote
0answers
43 views

Which reinforcement learning approach to use when there are 2 collaborative agents?

Suppose we are training an environment with 2 collaborative agents with Reinforcement Learning. We define the following example: There is a midfielder and a striker. The midfielder's reward depends on ...
2
votes
0answers
38 views

How efficient is SCAWI weight initialization method?

I'm currently in the middle of a project (for my thesis) constructing a deep neural network. Since I'm still in the research part, I'm trying to find various ways and techniques to initialize weights. ...
1
vote
2answers
73 views

Is it possible to have a variable-length latent vector in an autoencoder?

I'm trying to have a simple autoencoder but with variable latent length (the network can produce variable latent lengths with respect to the complexity of the input), but I've not seen any related ...
2
votes
0answers
55 views

Is there any research on developing AGI systems based on meta-programming?

Meta-programming is programming that can modify itself, which is an appealing concept to me, given that I associate the idea of modifying one's self with general intelligences (like humans). I think ...
0
votes
1answer
44 views

What is the best algorithm to solve the regression problem of predicting the number of languages a Wikipedia article can be translated to?

I'm doing a student project where I construct a model predicting the number of languages that a given Wikipedia article is translated into (for example, the article TOYOTA is translated into 93 ...
0
votes
0answers
21 views

Are there any examples of state-of-the-art NLP applications that are still n-gram based and use Naive Bayes?

As far as I can tell, most NLP tasks today use word embeddings and recurrent networks or transformers. Are there any examples of state-of-the-art NLP applications that are still n-gram based and use ...
1
vote
1answer
61 views

How many types of variational auto-encoders are there?

I have been studying about auto-encoders and variational auto-encoders. I would like to know how many variants of VAEs are there today. If there are many variants, can they be used for feature ...
1
vote
0answers
19 views

Literature on computational modelling involving neuronal ensemblies

Straying from the current trends in deep learning, there is an, arguably, interesting idea of neuronal ensembles possibly providing an alternative to the current "layered feature detectors" ...
4
votes
0answers
38 views

Are there transformer-based architectures that can produce fixed-length vector encodings given arbitrary-length text documents?

BERT encodes a piece of text such that each token (usually words) in the input text map to a vector in the encoding of the text. However, this makes the length of the encoding vary as a function of ...
4
votes
2answers
261 views

What are other examples of theoretical machine learning books?

I am looking for a book about machine learning that would suit my physics background. I am more or less familiar with classical and complex analysis, theory of probability, сcalculus of variations, ...
1
vote
1answer
76 views

How could facts be distinguished from opinions?

As a software engineer, I am searching for an existing solution or, if none exists, willing to create one that will be able to process texts (e.g. news from online media) to extract/paraphrase dry ...
0
votes
1answer
46 views

Are there neural networks with 3-dimensional topologies?

The topologies (or architectures) of the neural networks that I have seen so far are only 2-dimensional. So, are there neural networks whose topology is 3-dimensional (i.e. they have a width, height, ...
1
vote
0answers
33 views

Any AI software to help finding funding for AI projects?

Do you know of some paper mentioning a running AI system (preferably open source) that helps finding funding for AI software development? Obviously, be funded for working on AI is not easy, and could ...
0
votes
2answers
110 views

What are examples of problems where neural networks have achieved human-level or higher performance?

What are examples of problems where neural networks have been used and have achieved human-level or higher performance? Each answer can contain one or more examples. Please, provide links to research ...

1
2 3 4 5