Skip to main content
Share Your Experience: Take the 2024 Developer Survey

Questions tagged [reference-request]

Use when requesting examples of research or research papers, books, articles, blog posts or courses. For example, "Is there any published research about X?" or "What are good examples of Y in research?".

Filter by
Sorted by
Tagged with
0 votes
0 answers
4 views

How would I approach finding the source code for the paper that is being discussed in this article?

I have read a news article relating to recent research into graph theory-based fraud detection using machine learning, but cannot find the source code for the paper discussed. The paper can be found ...
Rasai Stewart's user avatar
0 votes
1 answer
17 views

Using additional parameters in PDDL precondition and effects of actions

Consider the following example: ...
Karl 17302's user avatar
2 votes
0 answers
47 views

Should intelligent machines have a body? (Reference request)

I was studying AI when a question came to my mind. I have to write a 6-pages essay on a chosen topic in AI, and I think it can be interesting to reflect on the measure in which machines should have a ...
Amanda Wealth's user avatar
0 votes
0 answers
32 views

Is there research on the effect of typos in LLM prompts?

A simple typo can split a single token for a common word into several tokens, not only making the prompt longer, but also creating a combination of tokens that was rare in the training set. I wonder ...
allo's user avatar
  • 310
1 vote
0 answers
38 views

History of Neural Networks and Deep Learning

I'm interested in learning about the history of neural networks and deep learning. I've been reading about the field and am familiar with many of the developments since the 1950s. Is there a textbook,...
neuralode's user avatar
0 votes
2 answers
68 views

Textbooks (or other sources) on deep reinforcement learning which explain theory along with good examples

I am looking for a textbook/other sources on deep reinforcement learning which explain theory along with good examples. I will be happy for suggestions.
DSPinfinity's user avatar
0 votes
0 answers
19 views

Are there leaderboards/tables/stats that compare inference times between close-sourced LLMs such as GPT 3.5/4 and Claude?

https://huggingface.co/spaces/optimum/llm-perf-leaderboard is great to compare inference times between LLMs but it misses close-sourced LLMs such as GPT 3.5/4 and Claude.
Franck Dernoncourt's user avatar
0 votes
1 answer
44 views

Equivalent of symbolic regression but for code instead of math expression

I'm already well versed with Genetic/Memetic algorithms and similar algorithms. I know about Symbolic regression, where some dataset is fitted through a math expression evolution, but I'm wondering, ...
Nordine Lotfi's user avatar
0 votes
0 answers
37 views

Is there a way to design neural networks with symmetric Jacobians?

Is there a way to design neural networks with symmetric Jacobians-the Jacobian of the output with respect to the input? Could you point me to any relevant literature in this area?
Roni's user avatar
  • 1
0 votes
0 answers
30 views

Where I can find SOTA models of information retrieval?

Can someone tell me where I can find SOTA models of information retrieval? My task is to rank documents by given query by semantic search of embedding. I know that models like ColBERT, SPLADE solve ...
prostak's user avatar
  • 113
1 vote
0 answers
18 views

Control algorithms when system dynamics are stochastic and/or unknown

I'm working on a traffic signal control problem, which I am currently approaching with Reinforcement Learning, but I want to try some other control algorithms. This is hard for me because we don't ...
Federico Taschin's user avatar
0 votes
1 answer
44 views

Where can I find good sources (textbook, lecture notes, etc) on multi-armed bandits?

I am looking for good sources (textbook, lecture notes, etc) on multi-armed bandits where both theory and practical examples are given. I will be happy for suggestion of such material.
DSPinfinity's user avatar
0 votes
1 answer
74 views

Overcoming the quadratic scaling in transformer architecture

Do you know any papers that try to overcome quadratic scaling problems by attending lower dimensional representations in the dimension of tokens? For example, let's say that the input to the ...
Andy Yermakov's user avatar
0 votes
0 answers
222 views

What is the loss function used when pre-training BERT on MLM & NSP tasks?

I'm new to NLP and was reading through the 2019 BERT paper and am confused about the loss function used during pre-training. As I understand it, the model is trained on the MLM and NSP tasks. The MLM ...
Karla's user avatar
  • 1
-1 votes
2 answers
54 views

Paper to cite about normalizing the inputs to a neural network [closed]

We can read that the normalization of the data that is input to a neural network is important and is considered as a best practice, for example SO #1, SO #2 and many other places. It looks to me that ...
ha7ilm's user avatar
  • 109
1 vote
1 answer
58 views

What is the name of the reward function that utilizes the rewards of the next n steps?

I have a problem with continuous time, observation and action space. I am discretizing the time to be able to apply the usual Reinforcement Learning algorithms (I chose PPO). The problem consists of a ...
Georg Schneeberger's user avatar
1 vote
1 answer
84 views

Which type of Machine Learning is used in robots? [closed]

Which type of Machine Learning is used in robots? Is it supervised learning or unsupervised learning or Reinforcement learning? Especially the robots that were sent in space?
ATJ's user avatar
  • 11
0 votes
3 answers
136 views

What are the techniques used to initialize weights for neural networks?

When creating a neural network to predict the impact of risks on the project cost, what techniques are used to initialize the weights provided to the hidden layers and the output layer?
maya sy's user avatar
  • 11
3 votes
0 answers
43 views

What is the current state of AI regarding features of Moravec's paradox, such as sensorimotor & perception skills?

Moravec's paradox is the observation in artificial intelligence and robotics that, contrary to traditional assumptions, reasoning requires very little computation, but sensorimotor and perception ...
Qwokker's user avatar
  • 131
0 votes
0 answers
21 views

Book suggestion about deploying real deep learning models in real world

Can you suggest books about deploying machine learning algorithms on robots, especially on real time stream? I don't know how to deal with latency and other challenges that real time inference/stream ...
dato nefaridze's user avatar
0 votes
0 answers
44 views

How can Knowledge Graphs be Integrated with Language Models for Semantic Search?

I am exploring the incorporate knowledge graphs (KGs) with language models. I understand that KGs can provide structured understanding of entities and their relationships which can be crucial for ...
Exploring's user avatar
  • 343
1 vote
0 answers
19 views

The “of-a-has” system: Is “has” a logical operator?

Given that Mary is the wife OF John, it follows that Mary is A wife and that John HAS a wife. The same “of-a-has” pattern appears in most of-phrases, files, sets, networks and formalized natural ...
Don Going's user avatar
1 vote
0 answers
26 views

Is there any well-established work that allows robots to communicate their decision-making using natural language?

I am searching for a well-established work that allows robots to communicate their decision-making using natural language. For example, a robot's explanation could be "I did [task1] because [...
jigz's user avatar
  • 21
0 votes
0 answers
24 views

Algorithms for community discovery in multigraphs

In order to group unstructured or sem-structured texts for a timeline construction approach, I consider several types of correlations among such texts. These different correlations induce a weighted ...
Max Muller's user avatar
1 vote
1 answer
328 views

Modern graduate-level machine learning books with focus on generative models

I'm looking for a modern machine learning book with graduate-level treatment of more recent topics such as diffusion and generative models, transformers etc. I have a hard copy of Deep Learning by ...
user74376's user avatar
  • 111
0 votes
0 answers
15 views

Does anyone know about a reference where someone has aggregated the cost optimization strategies for deploying LLMs?

I am looking for a source where someone has mentioned the most commonly used strategies and optimisations to deploy LLMs on consumer hardware. I have read about layer offloading, quantisation methods ...
Sudhanshu Mishra's user avatar
0 votes
0 answers
8 views

Filter distribution of Latent variable models

In this paper https://arxiv.org/pdf/1907.00953.pdf, about stochastic latent variable models, the paper says "We use the reparameterization trick to sample from the filtering distribution". I ...
chadmc's user avatar
  • 15
3 votes
0 answers
244 views

Let's Verify Step by Step: Old wine in new bottles?

In their paper "Let's Verify Step by Step" OpenAI proudly presents a new way of reward learning which shall foster LLMs' capabilities of mathematical and logical reasoning: We've trained a ...
Hans-Peter Stricker's user avatar
1 vote
1 answer
258 views

Is there any reference about backpropagation of the Transformer's multi-head layer?

Is there any reference about backpropagation of the Transformer's multi-head layer or multi-head attention (MHA)? I have searched various journals but have not found one yet.
poglhar's user avatar
  • 23
1 vote
2 answers
45 views

Is there a resource that offers a detailed overview of the gradient flow?

Understanding the concept of "Gradient Flow" can be quite difficult as there is a lack of widely recognized and clearly defined resources that provide a comprehensive explanation. Although ...
v1998199904's user avatar
0 votes
1 answer
101 views

Is there a recommended resource that can provide a detailed overview of the gradient norm?

When it comes to the concept of "Gradient Norm," it can be challenging to find a widely recognized and clearly defined resource that offers a comprehensive explanation. While many search ...
StudentV's user avatar
1 vote
0 answers
80 views

Where can I find the solutions to the problems in the book "An Introduction to Computational Learning Theory"?

I have been going through "An Introduction to Computational Learning Theory" (Kearns-Vazirani). I don't know if my solutions to the problems are correct and have no other way of checking my ...
aome's user avatar
  • 111
1 vote
1 answer
339 views

Model-based RL algorithms for continuous state space and finite action space

At the beginning, if I have a complete model $p(s' \mid s, a)$ (an assumed true model that describes the environment well enough) and the reward function $r(s,a,s')$. How can I exploit the model and ...
k2pctdn's user avatar
  • 55
0 votes
1 answer
84 views

References for synthetic images generation from small datasets (~10-50 images)

I'm looking a references (papers / works) for synthetic image generation from small datasets. By small dataset, I mean 10-50 images. I assume, that the best approaches should be based GAN (cGAN ?) or ...
Michael D's user avatar
  • 101
-1 votes
1 answer
76 views

Are there public examples of AI models that predicted short-term price well?

This question is inspired by Is there any AI model that predicts short-term stock price well?. As answered, game theoretically either nobody would reveal such a model or it would have been alread ...
Rexcirus's user avatar
  • 1,174
2 votes
0 answers
72 views

Reference request: AI panel discussion 2012

I have seen (probably on youtube) the recording of a panel discussion at an AI conference around 2012 (year could be wrong, but close) where the audience was polled for the question of when will AI ...
Ziofil's user avatar
  • 128
0 votes
0 answers
45 views

References for the theory of pretraining and unsupervised learning to improve subsequent supervised learning

I am not sure if the title of this post uses the correct terminology, so suggestions are welcome. I have been following a lot of the ideas of using Pre-training methods on neural networks, to improve ...
krishnab's user avatar
  • 207
0 votes
1 answer
73 views

Resources for NLP [closed]

I am an undergraduate student in mathematics. I have a fair bit of experience with deep learning in computer vision research and am willing to dabble into NLP. I hope that things won't be very ...
The Limit Does Not Exist's user avatar
5 votes
3 answers
461 views

Machine learning applied to space-time diagrams of cellular automata

I wonder if machine learning has ever been applied to space-time diagrams of cellular automata. What comprises a training set seems clear: a number of space-time diagrams of one or several (elementary)...
Hans-Peter Stricker's user avatar
1 vote
0 answers
31 views

Is there some neural network that implements Least Squares?

I would like to build supervised NN that gets a matrix $A$ and vector $b$ as inputs and returns $x$ as a close result of the Least Squares algorithm for $Ax=b$. I looked for so works in the field and ...
ChaosPredictor's user avatar
1 vote
1 answer
45 views

Could one still learn a good policy by doing a backprop every fixed number of steps within an episode?

Waiting an entire episode before doing a backprop can build up a very large computational graph, which is a burden on memory. Could one still learn a good policy by doing a backprop every fixed number ...
Archie Gertsman's user avatar
1 vote
0 answers
49 views

What is the depth reached by chess-AI agents on a regular computer?

I'm looking for some reference for the number of lookahead steps typically used by chess agents (Stockfish / Leela Chess Zero / others?) From a quick search, I found that the answer depends on: ...
Cohensius's user avatar
  • 413
10 votes
2 answers
2k views

How can I encode angle data to train neural networks?

I am training a neural network where the target data is a vector of angles in radians (between $0$ and $2\pi$). I am looking for study material on how to encode this data. Can you supply me with a ...
user366312's user avatar
0 votes
1 answer
132 views

Machine Learning Methods commonly used when data are scarse

It is well-known that deep neural networks require lots of data to perform reliably and well. A commonly-cited statistic is that you need at least 10,000 examples per class for a classification ...
postnubilaphoebus's user avatar
2 votes
0 answers
29 views

What are some non-RL-based approaches to solving a typical bin assignment problem?

What are some non-RL-based approaches to solving a typical bin assignment problem, i.e., given a set of items (can be multidimensional), find the bin/knapsack/target which best packs (with minimum ...
helloworld's user avatar
1 vote
0 answers
18 views

How to integrate program synthesis into program maintenance and evolution (if it is possible at all) - possible reference request?

Program synthesis is one of the most active research fields today, e.g. works by Microsoft Research https://arxiv.org/abs/2208.05950 and SalesForce Research https://arxiv.org/abs/2203.13474. I ...
TomR's user avatar
  • 853
2 votes
1 answer
956 views

Are there free and open-source audio versions of Generative AI programs like Stable Diffusion?

Generative AI is being used to create amazing art; first through paid services like Midjourney and now also with free, open source alternatives like Stable Diffusion. Now you can even generate art in ...
kanamekun's user avatar
  • 121
1 vote
1 answer
116 views

machine learning for a budgeting application

I am interested in finding references and previous applications where prior year budgets are analyzed to provide guidance for a current year budget. Specifically, each year some two thousand items ...
rbmales's user avatar
  • 11
1 vote
2 answers
100 views

References on Theoretical Bandit Problem

I am going to start learning the bandit problem and algorithm, especially how to bound the regret. I found the book ``Bandit Algorithms'' but it is not easy to follow. It is based on advanced ...
Amin's user avatar
  • 481
0 votes
1 answer
964 views

How can we approximate infinite horizon MDP with finite horizon MDP in the context of reinforcement learning?

For a given value of "discount factor" (and reward values' range) in fixed finite horizon markov decision process (MDP), upto how many episodes we have to extend this MDP so that we can ...
Engr. Moiz Ahmad's user avatar

1
2 3 4 5
10