Skip to main content

Questions tagged [reference-request]

Use when requesting examples of research or research papers, books, articles, blog posts or courses. For example, "Is there any published research about X?" or "What are good examples of Y in research?".

Filter by
Sorted by
Tagged with
1 vote
0 answers
27 views

Reference needed for neural networks finding solutions of PDE's

DL-PDE prescribes a way to feed a neural network data, which in turn comes up with a PDE of the form $$u_{t}(t,x,y) = F(x,y,u,u_{x},u_{y},u_{xx},u_{xy},u_{yy},...) \hspace{0.5cm} (x,y) \in \Omega \...
freebird's user avatar
0 votes
0 answers
63 views

2D models on 3D tasks (convolutions): simple replace?

2D tasks enjoy a vast backing of successful models that can be reused. For convolutions, can one simply replace 2D operations with 3D counterparts and inherit their benefits? Any 'extra steps' to ...
OverLordGoldDragon's user avatar
2 votes
0 answers
136 views

Does there exist functions for which the necessary number of nodes in a shallow neural network tends to infinity as approximation error tends to 0?

The Universal Approximation Theorem states (roughly) that any continuous function can be approximated to within an arbitrary precision $\varepsilon>0$ by a feedforward neural network with one ...
GraftCraft's user avatar
1 vote
1 answer
83 views

Is there any paper that shows that multi-channel neural networks are universal approximators?

Lately, I have been reading a lot about the universal approximation theorem. I was surprised to find only theorems about "single-channel" standard networks (multi-layer perceptrons), where ...
Niclas's user avatar
  • 13
1 vote
0 answers
74 views

Apart from ontologies, which other methods for knowledge representation are there in Artificial Intelligence?

From what I have been reading, I see statements like Ontology is a common method used for knowledge representation in artificial intelligence. But there is never really a discussion around what ...
ofithch79's user avatar
  • 139
2 votes
1 answer
358 views

CNN Architectures for local features vs global context

Kaparthy in his blog post said [this] hints at the kinds of architectures we’ll eventually explore. As an example - are very local features enough or do we need global context? I'd like to gain ...
Tom Huntington's user avatar
1 vote
1 answer
378 views

Is there a tutorial for understanding the proof of convergence for TD learning?

I'm reading the article An Analysis of Temporal-Difference Learning with Function Approximation (1997), but the mathematics inside seems overly complicated for me. Answers to some similar questions ...
heiyezhu6324's user avatar
1 vote
1 answer
449 views

What sort of out-of-the-box technology could be used to create work similar to artist Refik Anadol? [closed]

Refik Anadol has machines view actual pictures and then has the machine create its own images. This video shows some of the stuff he does. What kind of out-of-the-box tools (e.g. a Python package) or ...
confused's user avatar
  • 143
2 votes
2 answers
828 views

How does $\alpha$ affect the convergence of the TD algorithm?

In Temporal-Difference Learning, we update our value function by $V\left(S_{t}\right) \leftarrow V\left(S_{t}\right)+\alpha\left(R_{t+1}+\gamma V\left(S_{t+1}\right)-V\left(S_{t}\right)\right)$ If we ...
XXX's user avatar
  • 143
2 votes
0 answers
293 views

Why does TD (0) converge to the MLE solution of the Markov model?

Why does TD (0) converge to the MLE solution of the Markov model? Let's take the Example 6.4 in Sutton and Barto's book as an example. Example 6.4: You are the Predictor Place yourself now in the ...
XXX's user avatar
  • 143
1 vote
1 answer
176 views

Is there a benchmark for multi-objective evolutionary algorithms?

I'm working on a project for an evolutionary algorithms course, and the problem we're trying to solve is multi-objective. We'll use NSGA-II but we also wanted to compare with some other MOEAs, however,...
Matías Santurio's user avatar
1 vote
0 answers
12 views

References for the convergence of gradient-based algorithms for training neural networks

I'm looking for some good references that give convergence results of training neural networks. I'm decently familiar with works that analyze the convergence of SGD, and, in particular, I really like ...
Taw's user avatar
  • 1,281
1 vote
1 answer
57 views

What is the name of the method for the smart extend of image surroundings?

I'm looking for the name of the method (or algorithms family, or research body) used for the smart extend of image surroundings. For example, the method I'm looking for would take this image: And ...
OfirD's user avatar
  • 113
2 votes
0 answers
568 views

Did the unsolved XOR problem in "Perceptrons: An Introduction to Computational Geometry" 1969 book really cause the winter of the AI in 1974?

Winter of AI definition: periods of reduced funding and interest in artificial intelligence research, due to unmet expectations after a period of hype. There have been at least two major AI winters ...
rubengavidia0x's user avatar
2 votes
0 answers
137 views

How should I choose a reinforcement learning algorithm? [closed]

I'm starting a new RL project. I'm familiar with Deep Q-Learning because of an old project where I used it, but I'm not sure I chose correctly back then. Why should or shouldn't I choose DQN, or any ...
Lucas Pelizzari's user avatar
1 vote
0 answers
71 views

Book/course recommendation on game theory application to multi-agent system (reinforcement learning)

Is there any great game theory book or course that discusses the application of game theory to modern reinforcement learning or multi-agent systems? Or a classic reference book that can help me get a ...
Maybe's user avatar
  • 471
1 vote
0 answers
44 views

AI for games which involve social intelligence. Games like warewolf where players must persuade, charm, threaten etc

I'm looking for any introductory/accessible reading on AI that can play games which involve social intelligence. Games like poker, where you might bait someone into overcommiting their hand or ...
Shiny_and_Chrome's user avatar
1 vote
0 answers
124 views

Is Speech to Speech with changing the voice to a given other voice possible?

Background: I am working on a research project to use (demonstrate) the possibilities of Machine Learning and AI in artistic projects. One thing we are exploring is demonstrating deep fakes on stage. ...
Nathan's user avatar
  • 143
2 votes
1 answer
932 views

Where can I read about upsampling methods in detail?

In deep learning, we encounter the upsample blocks several times, especially when we deal with images. Consider the following statements from description regarding UPSAMPLE in PyTorch The algorithms ...
hanugm's user avatar
  • 3,890
0 votes
0 answers
37 views

Cost functions for reducing Tensors to 1-dimensional arrays?

I'm interested in the IT side, here, specifically how I most efficiently store a tensor in a one dimensional data structure. My assumption is that certain approaches will be more expensive than others,...
DukeZhou's user avatar
  • 6,237
0 votes
1 answer
940 views

What are the Calculus books recommended for beginner to advanced researchers in artificial intelligence?

Calculus is a branch of mathematics that primarily deals with the rate of change of outputs of a function w.r.t the inputs. It contains several concepts including limits, first-order derivatives, ...
hanugm's user avatar
  • 3,890
0 votes
0 answers
21 views

Is there a survey that describes the most effective approaches for an answer retrieval problem?

I have a dataset that contains pairs of a question and an answer. My problem is to train a model that can search for the right answer from the pool of my answers given the newly input question, so ...
Việt Nguyễn's user avatar
2 votes
0 answers
109 views

Has the idea of using different learning rates for different layers been explored in the literature?

I wonder whether there are heuristic rules for the optimal selection of learning rates for different layers. I expect that there is no general recipe, but probably there are some choices that may be ...
spiridon_the_sun_rotator's user avatar
3 votes
1 answer
434 views

Is there any way to train a neural network without using gradients?

The only algorithm I know for updation of weights of a neural network is based on gradients. The update equation can be roughly written as $$w \leftarrow w - \nabla_{w}L$$ where $\nabla_{w}L$ is the ...
hanugm's user avatar
  • 3,890
1 vote
1 answer
71 views

Is there any significance for higher order gradients in artificial intelligence?

Although I don't know in detail, I am aware of the following facts regarding the use of gradients in some domains of artificial intelligence, especially in minimizing the training of neural networks. ...
hanugm's user avatar
  • 3,890
1 vote
0 answers
162 views

Couldn't the self-attention mechanism be replaced with a global depth-wise convolution?

The main advantages of the self-attention mechanism are: Ability to capture long-range dependencies Ease to parallelize on GPU or TPU However, I wonder why the same goals cannot be achieved by ...
spiridon_the_sun_rotator's user avatar
1 vote
1 answer
148 views

Is there an entry level textbook on Bayesian Inference that is a nice blend of theory and applications?

I am looking for a textbook that is a nice entry level to Bayesian Inference. I was hoping that there is a nice blend of theory and applications (data sets) on how concepts are applied. Programming ...
cgo's user avatar
  • 185
2 votes
2 answers
523 views

Does regularization just mean using an augmented loss function?

We need to use a loss function for training the neural networks. In general, the loss function depends only on the desired output $y$ and actual output $\hat{y}$ and is represented as $L(y, \hat{y})$. ...
hanugm's user avatar
  • 3,890
1 vote
0 answers
23 views

Is there any existing mechanism that allows us to pass input from randomly selected layers of neural network per iteration?

Consider the following neural network with $\ell$ layers. $$i_0 \rightarrow h_1 \rightarrow h_2 \rightarrow h_3 \cdots \rightarrow h_{\ell-1} \rightarrow o_{\ell} ,$$ where $i, h, o$ stands for ...
hanugm's user avatar
  • 3,890
1 vote
1 answer
45 views

Are there any stats available on the usage of libraries by deep learning researchers?

I know three Python libraries that are popular in deep learning research community: Keras, PyTorch, Tensorflow. I don't know much about Theano. This question is not about the efficiency, flexibility ...
hanugm's user avatar
  • 3,890
2 votes
0 answers
43 views

How much research, approximately, is done in ANNs?

Does someone know where can I find information about how much research, nowadays, is done in ANNs? I've checked in this document Redes Neuronales: Conceptos básicos y aplicaciones, Universidad ...
Verónica Rmz.'s user avatar
0 votes
2 answers
93 views

What are the applications in which the precision of the neural network's weights is unimportant?

While reading about Module in PyTorch, I came across a new data type called half datatype. half() method when calls on a Module ...
hanugm's user avatar
  • 3,890
1 vote
0 answers
27 views

Is there a gentle introduction to reinforcement learning applied to MDPs with continuous state spaces?

I am looking for a gentle introduction (videos, lecture notes, tutorials, books) on reinforcement learning (MDPs) involving continuous states (or very large cardinality of state space). In particular, ...
cgo's user avatar
  • 185
4 votes
2 answers
770 views

What algorithms are used in Artificial General Intelligence research?

I've read on wiki that already in 2017 there were over 40 institutions researching AGI, and I wonder what type of algorithms are being studied and developed in this field. For example, for comparison ...
GKozinski's user avatar
  • 1,270
0 votes
1 answer
2k views

Where can I find the original conference paper that introduced Q-learning and Deep Q-Learning?

I tried searching a lot, but I could neither find the paper that introduced Q-Learning nor the paper that introduced Deep Q Learning. If anyone knows anything about it please do tell me.
Serena Raju's user avatar
1 vote
0 answers
82 views

What is the sample complexity of Monte Carlo Exploring Starts in RL?

We can use a model-free Monte Carlo approach to solving an MDP $(S,A,R,P,\gamma)$ with transition dynamics $P$ unknown by estimating Q-values by rolling out trajectories starting from random states $...
Snowball's user avatar
  • 225
1 vote
1 answer
67 views

Has someone correctly predicted one of the variants of SARS-CoV-2 (like the Delta variant)?

Without any evidence, I have wondered it might be possible to predict the upcoming mutations of the COVID-19 virus. I am further assuming people did so. So, has someone correctly predicted the ...
Gary 2's user avatar
  • 111
2 votes
1 answer
408 views

How could Bayesian neural networks be used for transfer learning?

In transfer learning, we use big data from similar tasks to learn the parameters of a neural network, and then fine-tune the neural network on our own task that has little data available for it. Here, ...
samsambakster's user avatar
2 votes
3 answers
186 views

Is there a recent book that covers the theoretical and philosophical aspects of artificial intelligence?

What are some recent books that introduce AI and neural networks while also discussing the related philosophical issues, like epistemology and whether AI is really thinking, etc.?
Geremia's user avatar
  • 205
1 vote
0 answers
46 views

Is there any work that applies the approach in "Finite-Sample Convergence Rates for Q-Learning and Indirect Algorithms" to standard Q-learning?

I am trying to mathematically characterize the finite sample convergence rates for Q-learning. To this end, I have read the following papers Learning rates for Q-learning, by Eyal Even-Dar et al.; ...
Jose Maria Gutierrez's user avatar
2 votes
1 answer
122 views

What is the state of the art in melody generation?

Generative Adversarial Networks can generate realistic photos of people, such as thispersondoesnotexist.com. I wonder whether one can train an artificial intelligence on a batch of plain solo melodies ...
emonigma's user avatar
1 vote
0 answers
104 views

What is the best way to train neural network with imbalanced mixed data (images and structured data)?

I have structured data and image data to solve a regression problem. One sample of structured data can be related to N images. If I use only structured data, I get decent performance, but not enough ...
thereiter's user avatar
2 votes
1 answer
415 views

Which AI techniques are there that combine multiple models to make sense of data at different stages?

I have been working to design a system that uses multiple machine learning models to make sense of data that is dynamically webscraped. Each AI would handle a specific task, for example: An AI model ...
Bipbupbop's user avatar
1 vote
0 answers
22 views

What are the most relevant resources that define the face detection problem formally?

I am new to AI, and I am a bit lost about finding the relevant materials that define the face detection problem formally/mathematically. Can anyone help me formally define face detection, or at least ...
JoJolyne's user avatar
0 votes
0 answers
377 views

Has positional encoding been used in convolutional layers?

Positional encoding (PE) is an essential part of the self-attention layers in the transformer architectures since without adding it in some way (fixed of learnable) to the input embeddings model has ...
spiridon_the_sun_rotator's user avatar
1 vote
1 answer
49 views

Why did Distributional Q Learning go out of popularity?

I read some papers (for example, this) and blogs that spoke about the advantages of distributional Q learning. However, it no longer seems to come up in literature. Did it have any shortcomings that ...
desert_ranger's user avatar
4 votes
1 answer
156 views

Can Reinforcement Learning be used to generate sequences?

Can we use reinforcement learning for sequence-to-sequence tasks? If yes, whether or not this is a good choice, how could this be done?
penguin_smasher's user avatar
0 votes
2 answers
435 views

Book(s) for text embedding

Text here refers to either character or word or sentence. Is there any recent textbook that encompasses from classical methods to the modern techniques for embedding texts? If a single textbook is ...
hanugm's user avatar
  • 3,890
1 vote
0 answers
89 views

Current extensions of the "Turing Test"?

In 2014 it was widely reported that the Turing Test had been passed, and that this was a major AI milestone. See: Computer AI passes Turing test in 'world first [BBC]; Turing Test Success Marks ...
DukeZhou's user avatar
  • 6,237
2 votes
2 answers
1k views

What is the minimum video resolution I need to identify anyone with facial recognition?

I am currently working on a small project where I am trying to automate some stuff at home. I am building a model capable of identifying my face with OpenCV. This will be a live feed. I am making the ...
Graphs Rodriguez's user avatar

1 2
3
4 5
10