# Questions tagged [algorithm-request]

Use this tag when you're looking for an algorithm (in the context of artificial intelligence) to solve your specific problem.

113 questions
Filter by
Sorted by
Tagged with
56 views

### Is there an algorithm capable of telling knots and links apart?

I'd like to create some algorithm that can tell apart knots from links. A knot is made up of one line, a link with multiple. As input, we expect images as above. Is there an algorithm capable of ...
813 views

### Is there an algorithm that produces a uniform distribution over the set of trajectories with maximum reward sum?

I am not an expert in reinforcement learning. I am applying it to my field of study. I am training a model such that given a state, it predicts the probability of taking an action for every action ...
• 133
42 views

### Machine Learning Algorithm for identifying the factors contributing to academic performance of students

I have a dataset with several qualitative and quantitative attributes, including age, location (longitude, latitude), city, parent occupation, family size, GPA etc. My task is to find the attributes/...
21 views

### Implement tensor operation with mini batches instead of Matrix multiplication in forward pass

The forward pass in neural network can be written as g(Wx+b). W is the weights Matrix, x is the input vector and b is bias, and g the non linearity, the activation function. However x can have more ...
24 views

### Symmetrical AI (same inputs as outputs) for Modelling and Prediction

I was wondering if there is an algorithm that helps create 'symmetrical' AIs (an AI that has the same inputs as it has outputs) that could be used for 'simulating' a system. The idea would be that ...
37 views

### Algorithms for average reward reinforcement learning in continuous/general state-action space

I see that discounted reward reinforcement learning has been extensively studied in the literature. However, the average reward metric receives less attention, and it looks like algorithms for this ...
• 55
419 views

### Match two paragraphs of text

I'm building a friend finder app and I need to match people based on a paragraph of text. Here is an example of what I mean: Person A: I love walking and going to the beach, I also love reading and ...
• 31
45 views

### What are the most effective methods and tools for summarizing long-form content like articles, editorials, and discussion threads for an app?

With users expecting instantaneous information and no compromise on in-depth details, app developers are challenged to condense long-form content such as articles, editorials, and discussion threads ...
43 views

### How to tokenize compound sentences based on the conjunctions?

I am trying to tokenize sentences of a document for aspect-based sentiment analysis. There are some sentences that consist of more than one topic. For example, The touch screen is good but the ...
• 1
61 views

### Is there any interpretation method suitable for CNNs which do regression tasks?

I mainly tackle regression problems by CNNs, and want to find a reliable method to calculate the heatmaps for NN's results. However, I find almost all interpretation methods including CAM is used for ...
1 vote
33 views

### What models/algorithms besides variational autoencoders can I use to transform a discrete input into a differentiable latent space?

Let's say I have a discrete input and want to transform it into a differentiable latent space. What models/algorithms besides variational autoencoders can I use?
1 vote
82 views

### What strategies are there to reduce the variance of the policy gradient estimator of the REINFORCE algorithm?

What strategies are there to reduce the variance of the policy gradient estimator of the REINFORCE algorithm? I know one possibility is to subtract a baseline as a running average of rewards from past ...
139 views

### Machine Learning Methods commonly used when data are scarse

It is well-known that deep neural networks require lots of data to perform reliably and well. A commonly-cited statistic is that you need at least 10,000 examples per class for a classification ...
30 views

### What are some non-RL-based approaches to solving a typical bin assignment problem?

What are some non-RL-based approaches to solving a typical bin assignment problem, i.e., given a set of items (can be multidimensional), find the bin/knapsack/target which best packs (with minimum ...
128 views

### Are there Reinforcement Learning algorithms specialized for the case $\gamma=0$?

I have a Reinforcement Learning problem where the optimal policy does not depend on the next state (ie gamma equals 0). I think this means that I only need an efficient exploration algorithm coupled ...
• 31
44 views

### Image classifier model which predicts objects and it's relevant areas with a combination of words

I have experience with image classification models such as CNN and Vision Transformers but this time I want to try a new thing (For me). First please check the below image to understand what I want ...
1 vote
42 views

### What is the best approach/model for classifying document images with over 70+ classes of documents?

What is the best approach/model for classifying document images with over 70+ classes of documents? I have tried LayoutLM which is a model that incorporated both NLP and Computer vision to classify ...
48 views

### How is it possible to detect anomalies in batches of 2 minutes of web access logs?

I have data coming from web access logs in the following form: ...
• 161
354 views

### Is there a standardized method to train a reinforcement learning NN by demonstration?

I'm less familiar with reinforcement learning compared to other neural network learning approaches, so I'm unaware of anything exactly like what I want for an approach. I'm wondering if there are any ...
148 views

### What object detection algorithm is the best for my particular problem?

I am trying to write a program to put a bounding box around dead fish, and not the live ones, in a video. I have minimal data (~5k frames and ~7k objects in total ) and it is VERY low quality (poor ...
1 vote
55 views

### Determining a policy to play a game of chance

I'm trying to optimize the expected return from a game of chance, but have quickly realized the problem outclasses the introductory AI course I took in college years ago. I would appreciate any ...
1 vote
203 views

### Which RL algorithm should I use to learn an optimal weight vector?

What is the best practice in order to learn the optimal weight vector $W^*$? By optimal I mean the weights that will produce the agent with the highest win-rate. I have an agent that plays a ...
• 413
256 views

### How to solve a reinforcement learning problem with a stochastic reward function?

In a discrete time system, an environment has an unknown reward probability $p(r|s,a)$. However, the transition probability $p(s'\mid s,a)$ is deterministic. In my case, the reward for the same action ...
265 views

### Is there any variant of perceptron convergence algorithm that ensures uniqueness?

The perceptron convergence algorithm given below ensures the convergence of weights of the perceptron provided enough data points and iterations. Although it ensures convergence by finally getting a ...
• 3,950
65 views

### What clustering algorithms work best for datasets with only binary categorical features?

I have a dataset with a lot of binary categorical features and a single continuous target value. I would like to cluster them, but I am not quite sure what to use. In the past, I have used DBSCAN for ...
• 125
1 vote
65 views

### Given a set of trajectories produced by a fixed policy, what is the the standard approach to estimate Q?

Let's say that I have a set of trajectories $\mathcal{D} = \{\tau_1, \dots, \tau_n\}$ produced by an agent acting in a (episodic) MDP with a fixed policy $\pi$. I would like to estimate the $Q$ ...
• 183
1 vote
235 views

### ML model to predict timeouts

I am new to ML and am trying to build a model to predict timeouts for a website. The website is being monitored once a minute and the data consists of a timestamp and the response time in seconds. E.g....
• 11
1 vote
135 views

### Reinforcement learning algorithms for large problems that are not based on a neural network

I have a large control problem with multidimensional continuous inputs (13) and outputs (3). I tried several Reinforcement learning algorithms like Deep-Q-Networks (DQN), Proximal Policy Optimization (...
• 256
81 views

### Is there way to segment an image without labeling/classification, as well as supervised learning?

Is there way to segment an image without labeling/classification, as well as supervised learning? For an illustrative example, if one considers an image with a dog and a cup (we don't particularly ...
• 23
436 views

### Which algorithm can find the best combination of players to maximize the chance of getting a high score?

I am looking for the right terminology for this problem, so I know what to learn about. Imagine a population of 100 people in a town. The town has a sport team with 10 positions that play in ...
122 views

### Avoid unintentional "merging" in cluttered object detection

I have a problem that has bothered me quite some time. With modern methods object detectors can often be accurately trained, even with small to medium sized datasets. However, there is one thing where ...
26 views

### How to group multi-dimensional audio, video, and numerical data based on relatedness?

I have a data set that includes image arrays, point clouds, audio waveforms, and plain numerical data. I want to use unsupervised learning to group the data based on relatedness. So, if the audio and ...
2k views

### Compare Strings composed from 2-3 words using NLP/ML(Python)

I have a database of books. Each book have a list of categories that describe the genre/topics of the book (I use Python models). Most of the time, the categories in the list are composed from 1-3 ...
• 101
89 views

### Is there an approach where the output of one neural network is used to choose the next neural network?

I'd like to design a deep learning architecture in which the output of a primary neural network $M_{\theta}$ determines which neural network $N^i_{\alpha}$ in a set of secondary networks $\mathcal{N}$ ...
182 views

### Is it effective to use deep learning method to produce a 1D signal as output from a 2D image as input?

I have a 1D signal that will produce a 2D image after some image processing algorithm. Would it be possible and effective to use deep learning method to reproduce the 1D signal if I have the 2D image ...
182 views

### Are there any algorithms (even backtracking variations) that solve the sudoku in a way more similar to this approach?

I looked a bit online for Sudoku solvers and it seems like all the answers I found involve a backtracking algorithm. However, this is not how humans (at least not me) solve Sudoku. We don't place in ...
• 149
116 views

### What is the best machine learning algorithm for clustering dots based on coordinates $(x,y)$ with consideration of weight of the points?

I'm looking for a machine learning algorithm for clustering points based on their coordinates. Furthermore, I want to take into consideration the weights of each point. Suppose there is a weight in ...
1 vote
972 views

### How to train an ML model to convert the given lyrics into a song by a particular singer?

I am interested in training a machine algorithm to convert the lyrics I give into a song by a particular singer. My language is non-English (south Indian) The songs are mostly monophonic (very few ...
• 15
107 views

### What would be a reasonable option for clustering for unknown number of clusters and a lot of outliers?

I am implementing the CV detection pipeline with the use of SIFT and KNN Matcher. Image keypoints matched to the query keypoints produce the following image: The matched objects have a lot of key ...
412 views

### How do I use machine learning to create an optimization algorithm?

Let's say that I want to create an optimization algorithm, which is supposed to find an optimum value for a given objective function. Creating an optimization algorithm to explore through the search ...
174 views

### Which algorithms are used to locate objects in a 3d space?

I can see mobile apps that can locate a 3D object on a surface with a mobile camera and you can turn around that object. What is the name of the algorithm(s) that is used for that purpose? Or, is ...
• 257
162 views

### Can AI be used for grading code copy exercises and adjust difficulty based on these scores?

I'm a senior in a bachelor Multimedia and Creative Technology. My experience is mostly full-stack web app development. For my bachelor's thesis, I need to do research in a subject I have no experience ...
143 views

### Which multi-agent reinforcement learning algorithm can I use when there are two types of agents with different action spaces?

Most of the papers on multi-agent RL (MARL) that I have encountered have multiple agents who have a common action space. In my work, my scenario involves $m$ numbers of a particular agent (say type A) ...
• 185
66 views

### What AI algorithm could I use to trap an agent in a game?

Imagine a game with grid size 10x10, there is a good guy and a bad guy and obstacles in the grid, i.e. essentially a maze. The goal of the bad guy is to find the good guy and trap him by erecting ...
136 views

### Non-face "deepfakes" in videos

Instead of changing faces (like James Bond to Putin) what if, given sufficient training data, I wanted to: Remove or add some windows from a brick house? Convert a glass of red wine to a glass of ...
• 129
1 vote
521 views

### How can I use a ResNet as a function approximator for pixel based reinforcement learning?

I'd like to use a residual network to improve learning in image-based reinforcement learning, specifically on Atari Games. My main question is divided into 3 parts. Would it be wise to integrate a ...
1 vote
58 views

### How to detect the sine wave signal with different frequency using neural networks?

I'm wondering if there is a way to use a neural network that can detect the noisy sine wave, where the frequency is not constant. In other words, I'm not looking for a solution that would detect the ...
• 11
1 vote
458 views

### What sort of out-of-the-box technology could be used to create work similar to artist Refik Anadol? [closed]

Refik Anadol has machines view actual pictures and then has the machine create its own images. This video shows some of the stuff he does. What kind of out-of-the-box tools (e.g. a Python package) or ...
• 143
1 vote
246 views

### What kind of algorithm or approach can I use to find a specific type of object in an image?

What kind of algorithm or approach can I use to find a specific type of object in an image? In particular, I am interested in finding an object like a windmill in an image taken, for example, from ...
• 111