Questions tagged [reference-request]

Use when requesting examples of research or research papers, books, articles, blog posts or courses. For example, "Is there any published research about X?" or "What are good examples of Y in research?".

Filter by
Sorted by
Tagged with
2
votes
2answers
116 views

Does regularization just mean using an augmented loss function?

We need to use a loss function for training the neural networks. In general, the loss function depends only on the desired output $y$ and actual output $\hat{y}$ and is represented as $L(y, \hat{y})$. ...
1
vote
0answers
19 views

Is there any existing mechanism that allows us to pass input from randomly selected layers of neural network per iteration?

Consider the following neural network with $\ell$ layers. $$i_0 \rightarrow h_1 \rightarrow h_2 \rightarrow h_3 \cdots \rightarrow h_{\ell-1} \rightarrow o_{\ell} ,$$ where $i, h, o$ stands for ...
1
vote
1answer
18 views

Are there any stats available on the usage of libraries by deep learning researchers?

I know three Python libraries that are popular in deep learning research community: Keras, PyTorch, Tensorflow. I don't know much about Theano. This question is not about the efficiency, flexibility ...
2
votes
0answers
36 views

How much research, approximately, is done in ANNs?

Does someone know where can I find information about how much research, nowadays, is done in ANNs? I've checked in this document Redes Neuronales: Conceptos básicos y aplicaciones, Universidad ...
1
vote
0answers
17 views

Is there a gentle introduction to reinforcement learning applied to MDPs with continuous state spaces?

I am looking for a gentle introduction (videos, lecture notes, tutorials, books) on reinforcement learning (MDPs) involving continuous states (or very large cardinality of state space). In particular, ...
2
votes
0answers
36 views

What algorithms are used in Artificial General Intelligence research?

I've read on wiki that already in 2017 there were over 40 institutions researching AGI, and I wonder what type of algorithms are being studied and developed in this field. For example, for comparison ...
0
votes
1answer
26 views

Where can I find the original conference paper that introduced Q-learning and Deep Q-Learning?

I tried searching a lot, but I could neither find the paper that introduced Q-Learning nor the paper that introduced Deep Q Learning. If anyone knows anything about it please do tell me.
1
vote
0answers
14 views

What is the sample complexity of Monte Carlo Exploring Starts in RL?

We can use a model-free Monte Carlo approach to solving an MDP $(S,A,R,P,\gamma)$ with transition dynamics $P$ unknown by estimating Q-values by rolling out trajectories starting from random states $...
0
votes
0answers
12 views

How many MAC operations are executed in one inference/training cycle of Google BERT?

I wonder if there is any information about the amount of MACs are executed for one training/inference cycle of Google BERT. I only found information about the number of layers and parameters here. ...
2
votes
1answer
38 views

How could Bayesian neural networks be used for transfer learning?

In transfer learning, we use big data from similar tasks to learn the parameters of a neural network, and then fine-tune the neural network on our own task that has little data available for it. Here, ...
0
votes
0answers
13 views

Object localisation and window size(can’t use learning methods). Share the resources to solve this problem

Given two images($I_1$, $I_2$) and both images contain a similar object. First, find the location of the windows which contains the object for each image. For example, let $I_{n \times n}$ is a 2-D ...
0
votes
3answers
54 views

Is there a recent book that covers the theoretical and philosophical aspects of artificial intelligence?

What are some recent books that introduce AI and neural networks while also discussing the related philosophical issues, like epistemology and whether AI is really thinking, etc.?
1
vote
0answers
21 views

Is there any work that applies the approach in “Finite-Sample Convergence Rates for Q-Learning and Indirect Algorithms” to standard Q-learning?

I am trying to mathematically characterize the finite sample convergence rates for Q-learning. To this end, I have read the following papers Learning rates for Q-learning, by Eyal Even-Dar et al.; ...
0
votes
0answers
19 views

What is “fill” algorithm used for image resizing and cropping?

I was going through this documentation directed by Codelab-Developer-Google. In order to resize an image, the notebook is using the "fill" algorithm. See the below code ...
0
votes
0answers
14 views

What is the state of the art in melody generation?

Generative Adversarial Networks can generate realistic photos of people, such as thispersondoesnotexist.com. I wonder whether one can train an artificial intelligence on a batch of plain solo melodies ...
1
vote
0answers
20 views

What is the best way to train neural network with imbalanced mixed data (images and structured data)?

I have structured data and image data to solve a regression problem. One sample of structured data can be related to N images. If I use only structured data, I get decent performance, but not enough ...
0
votes
0answers
9 views

Increased performance using monotonic constraints with neural networks

I see that with the xgboost library, we can tell the training process that some features are necessarily monotonic with the model's output - https://xgboost.readthedocs.io/en/latest/tutorials/...
0
votes
0answers
17 views

Are there any good references that describe the equations of the forward pass of Graph Neural Networks?

I am trying to program Graph Neural Network from scratch. Can the community please suggest a good reference/s to read about the equations of the forward pass in Graph Neural Networks, especially in ...
2
votes
1answer
44 views

Which AI techniques are there that combine multiple models to make sense of data at different stages?

I have been working to design a system that uses multiple machine learning models to make sense of data that is dynamically webscraped. Each AI would handle a specific task, for example: An AI model ...
1
vote
0answers
19 views

What are the most relevant resources that define the face detection problem formally?

I am new to AI, and I am a bit lost about finding the relevant materials that define the face detection problem formally/mathematically. Can anyone help me formally define face detection, or at least ...
0
votes
0answers
23 views

Positional encoding in convolutional layers

Positional encoding (PE) is an essential part of the self-attention layers in the transformer architectures since without adding it in some way (fixed of learnable) to the input embeddings model has ...
1
vote
1answer
40 views

Why did Distributional Q Learning go out of popularity?

I read some papers (for example, this) and blogs that spoke about the advantages of distributional Q learning. However, it no longer seems to come up in literature. Did it have any shortcomings that ...
3
votes
1answer
49 views

Can Reinforcement Learning be used to generate sequences?

Can we use reinforcement learning for sequence-to-sequence tasks? If yes, whether or not this is a good choice, how could this be done?
0
votes
0answers
9 views

How can I design a machine translation model that produces a mapping between the words in the source and target sentences?

I have a dataset of sentences of language X and Y X Y abc def lang xyz pqrt mno uages I want to have an output as a table with word-by-word translation (...
0
votes
2answers
78 views

Book(s) for text embedding

Text here refers to either character or word or sentence. Is there any recent textbook that encompasses from classical methods to the modern techniques for embedding texts? If a single textbook is ...
1
vote
0answers
16 views

Current extensions of the “Turing Test”?

In 2014 it was widely reported that the Turing Test had been passed, and that this was a major AI milestone. See: Computer AI passes Turing test in 'world first [BBC]; Turing Test Success Marks ...
0
votes
0answers
19 views

Which well known node embedding algorithms to use for weighted graphs?

I am looking for a node representation learning algorithm to generate node embeddings that supports weighted graphs. I modified GCN to support weighted graphs, but I want to know an algorithm that ...
0
votes
0answers
12 views

How to Approach a Conversation Detector?

I am currently looking for a way to detect if a conversation is occurring. The meaning of the conversation is not important for this case. One approach that seems viable is to try to detect a voice ...
0
votes
2answers
76 views

Why was the VC dimension not defined for all configurations of $d$ points?

Let's start with a typical definition of the VC dimension (as described in this book) Definition $3.10$ (VC-dimension) The $V C$ -dimension of a hypothesis set $\mathcal{H}$ is the size of the ...
4
votes
4answers
192 views

What are the typical sizes of practical/commercial artificial neural networks?

I'm interested in artificial neural networks (ANN) and I wonder how big ANNs in practical use are, for example, Tesla Autopilot, Google Translate, and others. The only thing I found about Tesla is ...
1
vote
0answers
27 views

Is there literature on Neural Network with activation functions of bounded domain?

I think to have found a somewhat interesting connection between neural networks and another area of mathematics. However, it requires the activation functions in the network to have a bounded - ...
0
votes
0answers
21 views

Is it possible to do object detection on an object classification dataset?

I'm new to computer vision, which I find fascinating. I wonder whether it is possible or if there has been any research into going from object recognition data to object detection. In other words, ...
0
votes
0answers
18 views

Is there a different approach, other than MAML combined with LSTM, for meta-regression of time-series data?

I am working on the calibration of low-cost air sensor data (a time series regression problem). My primary focus is to use some meta/ few-shot learning approach to solve this problem with fewer data. ...
1
vote
1answer
37 views

Machine Learning in relation to personality and behaviors predictions

I am tasked with making a machine learning model that predicts personality traits and behaviours of children based on simple and interactive quizzes. Currently I am lost and have no idea where to ...
2
votes
0answers
33 views

suitable reference for reinforcement learning for beginners [duplicate]

I am looking for a reference book on RL for first time learners, one that is a gentle introduction and not as wordy as Sutton/Barto. I am interested in something similar to Georgia Institute of ...
1
vote
0answers
20 views

Which methods for weight initialization in Neural Networks are currently common practice?

I am currently researching the topic of weight initialization methods for (deep) neural networks and I'm a little stuck. The result of my work should be an overview of methods that are currently in ...
0
votes
1answer
26 views

Creating a NLP driven chatbot [closed]

I would like to create a chat bot for an e-commerce website that sells a wide range of general merchandize items, from t-shirts, jumpers to calculators. Its primary objective is to develop a Q&A ...
0
votes
0answers
43 views

What are the math theorems regarding the Multilayer Perceptron?

I've come across a theorem "Convergence theorem Simple Perceptron" for the first time, here-> https://zaguan.unizar.es/record/69205/files/TAZ-TFG-2018-148.pdf, page 27, (is in Spanish) ...
1
vote
1answer
25 views

How to train an LSTM to classify based on rare historic event?

I want an LSTM to output one of two classes (Y, N), per frame, based on all the input so far. My original inputs are very long (~100000 samples long, far more than a standard LSTM training can handle ...
1
vote
0answers
18 views

Is there any research on the application of policy gradients to problems where the selection of an action requires the selection of another one?

I am working on a problem and want to explore if it can be solved with PPO (or other policy gradient methods). The problem is that the action space is a bit special, compared to classic RL ...
1
vote
1answer
46 views

Is there any comprehensive book that reviews topics in the area of brain-inspired computing?

I am looking to write my master's thesis next year about brain-inspired computing. Hence, I am looking to get a good overview of this domain. Do you know of any comprehensive book that reviews topics ...
0
votes
0answers
104 views

Huge dimensionality of input and output — any recommendations?

At work there is an idea of solving a problem with machine learning. I was assigned the task to have a look at this, since I'm quite good at both mathematics and programming. But I'm new to machine ...
0
votes
1answer
45 views

Are there relatively new research papers that describe how to make back-propagation more efficient?

I read Yann LeCun's paper Efficient BackProp, which was published in 2000. I looked for similar but more recent papers on Arxiv, but I have not yet found any. Are there relatively new research papers ...
2
votes
0answers
40 views

Are there heuristics that play Klondike Solitaire well?

Are there heuristics that play Klondike Solitaire well? I know there are some good exhaustive search solvers for Klondike Solitaire. The best one that I know of is Solvitaire (2019) which uses DFS, (...
2
votes
1answer
40 views

How would the performance of federated learning compare to the performance of centralized machine learning when the data is i.i.d.?

How would the performance of federated learning (FL) compare to the performance of centralized machine learning (ML), when the data is independent and identically distributed (i.i.d.)? Moreover, what ...
2
votes
0answers
53 views

What is the effect of K in K-NN on the VC dimension?

What is the effect of K in K-NN on the VC dimension? When K increases, is the VC dimension decreased or increased, or we can't say anything about this? Is there a reference book that discusses this?
0
votes
0answers
27 views

Resources for Computer Vision Algorithms and Applications

Are there any videos or other books/notes/slides that anyone has come across that follow Computer Vision Algorithms and Applications by Richard Szeliski? We are using this book in class but the ...
1
vote
1answer
387 views

How do I get started with multi-agent reinforcement learning?

Is there any tutorial that walks through a multi-agent reinforcement learning implementation (in Python) using libraries such as OpenAI's Gym (for the environment), TF-agents, and stable-baselines-3? ...
0
votes
2answers
83 views

One hot encoding vs dummy variables best practices for explainable AI (XAI)

When creating artificial columns for your categorical variables there are two mainstream methods you could use: Disclaimer: For this example, I use the following definitions of dummy variables and one-...
1
vote
1answer
51 views

Should one use an “other” category in image classification?

In image classification, there are sometimes images that do not fit in any category. For example, if I build a CNN in Keras to classify Dogs and Cats, does it help (in terms of training time and ...

1
2 3 4 5
7