People who code: we want your input. Take the Survey

Questions tagged [neural-networks]

For questions about a artificial networks, such as MLPs, CNNs, RNNs, LSTM, and GRU networks, their variants or any other AI system components that qualify as a neural networks in that they are, in part, inspired by biological neural networks.

751 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
0
votes
0answers
12 views

How to predict when a number will occur again, give an array of integers?

I am new to machine learning and AI. I'm trying to create a program that adds a random number (1-5) to an array every 1 second and at a random point stops doing that. If that's the case, then it shall ...
0
votes
0answers
8 views

To find the accuracy between two patterns by comparing the similarity socre

I have faced problem with finding the similarity scores between two patterns. For example, I have normal ECG pattern and abnormal ECG pattern . Then I want to get find the accuracy of normal pattern ...
0
votes
0answers
34 views

What are the best optimizations I can add to my neural network?

I am making an artificial neural network from scratch (without nn libraries) in python. So, as you can guess, its extremely unoptimized and slow. For this neural ...
0
votes
0answers
11 views

How to update all the weights in case only one data out of n signals is observable

If we have cost function as $$E_i = (D_i -Y_i)^T Q (D_i -Y_i)$$, where $$Q=\begin{bmatrix} 1 & 0 & 0\\ 0 & 0 & 0\\ 0 & 0 & 0 \end{bmatrix}$$( in case only one data signal can ...
0
votes
0answers
20 views

Should an increased learning rate for an adaptive linear neuron (ADALINE) reduce the square error at every epoch?

I am completely new to neural networks and therefore, my query may have some basic conceptual problem. I am following Fundamentals of Neural Networks by Laurene Fusett. In this book, the author ...
0
votes
0answers
22 views

Should I use the Siamese or the matching network to find the closest match between one image and other images?

I have to find the closest match between my image and a bunch of already collected images of different classes in the folder. Which of the meta-learning approach should I select? I am thinking about ...
0
votes
0answers
68 views

Genetic Algorithm Tetris Python not improving

I'm trying to create an AI using a Neural Network a Genetic Algorithm to learn how to play tetris, but it looks like something is wrong because, even after 20 generations, i can't see any improvement. ...
0
votes
0answers
41 views

Why would my neural network have either an accuracy of 90% or 10% on the validation data, given a random initialization?

I'm making a custom neural network framework (in C++, if that is of any help). When I train the model on MNIST, depending on how happy the network is feeling, it'll give me either 90%+ accuracy, or ...
0
votes
0answers
15 views

Can an Autoencoder be used to create a simple text-completion plugin (code-completion for programming)?

Can an Autoencoder neural network be used to create a simple code completion plugin for a developer using a certain programming language ? The idea is that the training data will be generated from ...
0
votes
0answers
36 views

Is there any research work on known malware detection systems based on AI?

I'm working on writing an article about the possibilities of modern AI-based algorithms to produce invisible self-learning malware, that can distribute itself throughout the internet and create ...
0
votes
0answers
55 views

Is it possible to transform audio with neural networks to make it sound like 3d sound

so the idea is to feed neural network data like input: mono audio(extracted from existing 3d audio) output: 3d audio after training it should convert mono audio to 3d sound do you think it is possible?...
0
votes
0answers
11 views

How to check if labels are multimodal for continuous data distribution

For example, If we have an object pointcloud which maps to two labels: -90 deg rotation and +90 deg rotation In general, if we have a non-functional mapping in the data (e.g. one input has two ...
0
votes
0answers
27 views

Understanding policies in helicopter control in the paper by Andrew Ng et al

I was going through this paper on helicopter flight control using reinforcement learning by Andrew Ng et al. It defines two policy classes to learn two policies, one for hovering the helicopter and ...
0
votes
0answers
30 views

Paillier scheme : Encoding floats into integers impact on accuracy in neural networks

In Privacy Preserving Processing Over Encrypted Images, I could understand that appropriate encoding of floats into integers (required in Paillier) only incur negligible error in computations. Can we ...
0
votes
1answer
56 views

classification of unseen classes of image in open set classification

I have a scanned image, and they need to be classified in one of the pre-defined image classes, so that it can be sorted. However, the problem is the open nature of the classes. At testing time, new ...
0
votes
0answers
35 views

Data Augmentation of store images using handwritten labels

I am new to AI and NN. I've started learning using Geron's book on Tensorflow. My first project ("Smart Shelf") is to determine which items in a store have been purchased and need refilled. ...
0
votes
0answers
24 views

How to change the number of input neurons in embedding layer?

I was building a recommender system using Tensorflow recommenders (TFRS) library . I was following the official tutorial for ranking model , where they have used two-tower model. The part where I have ...
0
votes
0answers
28 views

What is the purpose of “alignment” in the self-attention mechanism of transformers?

I've been reading about transformers & have been having some difficulty understanding the concept of alignment. Based on this article Alignment means matching segments of original text with their ...
0
votes
1answer
61 views

Reasoning behind performance improvement with hopfield networks

In the paper Hopfield networks is all you need, the authors mention that their modern Hopfield network layers are a good replacement for pooling, GRU, LSTM, and attention layers, and tend to ...
0
votes
0answers
23 views

Is the dimensionality of the query and key tensors in this implementation of the transformer's self-attention correct?

Looking at this tutorial matmul_qk = tf.matmul(q, k, transpose_b=True) # (..., seq_len_q, seq_len_k) is the output of two tensors multiplied of shape: ...
0
votes
0answers
15 views

Is there any neural network model that can perform multiple NLP steps at once?

I realize most NLP algorithms have multiple steps. (e.g. OCR/speech rec > syntax > semantics > response logic > semantic output > natural language output) Is there any NN model that can ...
0
votes
1answer
41 views

How to make input variable as trainable parameter in a neural network?

I am working on an optimization problem. First, I have done forward training to work the network as a surrogate model, then I freeze the output and I want to find an optimal value of input for a given ...
0
votes
0answers
19 views

Architecture for Logistic Regression with Arbitrary Number of Options

Suppose I want to design a neural network to choose one of several mutually exclusive options. This may normally be done via logistic regression, where the input of the network would be a [batch x ...
0
votes
1answer
64 views

Why won't my model train with CTC loss?

I am trying to train an LSTM using CTC loss, but the loss does not decrease when I train it. I have created a minimal example of my issue by creating training data where the network simply has to copy ...
0
votes
0answers
20 views

How to improve de-noise algorithm on low signal-to-noise ratio features?

In the following plot, I have features that all have a very small predictive power on y, there is a low signal-to-noise ratio. In order to de-noise them, I tried ...
0
votes
0answers
15 views

Low Signal-To-Noise Ratio Data Processing and Model Choices

Attached is a plot showing that y regresses on individual features: Scatter Plot And as shown, each feature has minuscule predictive power on y. I have 130 features like this, all of them are more or ...
0
votes
0answers
11 views

Deriving an ANFIS based controller

I have a Fuzzy controller with a desirable response, and I'm wanting to use the input and output data to derive an ANFIS based controller. ANFIS requires data for 2 inputs and 1 output, I have the ...
0
votes
0answers
18 views

Neural Network trains towards 1 despite target

So I'm trying to make my first neural network and have just finished my back propagation functions. I got the algebra from brilliant and thought I'd understood it, but my bug proves otherwise. The bug ...
0
votes
0answers
24 views

Which AI technique should I use for (key)point detection (in an image of a plantar pressure)?

I am relatively new to the field of AI. I have a problem that I would like to solve with AI, but I don't know which buzzwords I should use to search for solutions. I have a plantar pressure scan, like ...
0
votes
0answers
19 views

What's the best machine learning algorithm / neural network architecture to use for a task that maps between images and textual descriptions of them?

Title says it all really. I want to train a network to take images of diagrams and produce a standard textual definition of them. What ML architecture is best for this?
0
votes
0answers
32 views

Multivariate time-series classification with many variables

I am attempting to use time-series classification algorithms for fraud detection applications. I have came across several works in the literature that propose novel techniques for multivariate time-...
0
votes
0answers
31 views

How to draw a 3-dimensonal shape's neural network

I am reading an exam question about NN (that I cannot publish, for copyright reasons). The question says: 'Construct a rectangle in 2D space. Define the lines, and then define the weights and ...
0
votes
0answers
12 views

How to update the error on hidden nodes using back-propogation, given the error on the output nodes and weights

I'm trying to solve question 30 of this paper. The short version of the question is if someone could show me how to do this, I would appreciate it (the answer should be A; -0.0660). The long version ...
0
votes
0answers
15 views

Is there any solution to the problem of detecting whether a user is having trouble finding something while surfing a webpage?

While a user is navigating through a website, we need to detect whether the user is having trouble finding something in realtime. The output is used to trigger an event that should pop up a FAQ page ...
0
votes
0answers
15 views

Drawing verticle lines on video frames in vehicle detection

I am working on an application of vehicle detection, the purpose is to check if road is congested or not. The solution that came to my mind is to detect the vehicles moving in each direction ...
0
votes
0answers
25 views

Python: Recognize actions / keywords in natural text?

This is for a personal project, and I am no very skilled programmer, language is Python, needs to work offline. That said: I have a list of 200 key actions, eg. 'Building sandcastles', 'Paintball' or '...
0
votes
0answers
14 views

Generating numerical output based on multiple inputs

I have been trying to use a linear regression with Turicreate to predict the a certain number based on a variety of input numbers. My process is pretty simple: I have four columns in my training ...
0
votes
0answers
10 views

Is the information in the hiddenstate of a RNN worth processing further after the input passes the RNN?

I hope the question is understandable. I just wanted to ask if the hidden state, which is passed through the timesteps/cells of an RNN/LSTM/GRU to deliver information from $\text{cell}_{i-1}$ to the $\...
0
votes
0answers
28 views

Papers on using symbolic methods as constraint on neural network?

Given a set of constraints on the input data, I am looking for papers that discuss using symbolic methods (decision trees, rule based, etc.) as a separate source of certainty in a classification task. ...
0
votes
0answers
42 views

Can I solve the below functional equation using neural networks?

I recently watched this video, in which he solves the equation $$f(x)+f\left(\frac{1}{1-x}\right) = x$$ The answer is $$f(x) = \frac{x^3-x+1}{2x(x-1)}$$ I tried to solve this functional equation using ...
0
votes
0answers
15 views

Chatbot with Context Management and Awareness

I am currently implementing a closed-domain FAQ chatbot using https://www.sbert.net/index.html as my main model for answering questions from the users. I wish to extend the functionality of the ...
0
votes
0answers
14 views

Can we encode categories binarily in a classification task using neurons outputs as consecutive bits?

Let's say, that we have a simple neural network as the one depicted below: The goal of this NN is to classify inputs into two separate categories. Usualy, each neuron would correspond to one category,...
0
votes
0answers
43 views

How to deal with predictions for data outside the range of the training dataset in neural networks?

I’ve set up a neural network model to experiment with predicting foreign exchange rates based on various economic data. The model learned fine and the test data is OK ($R^2 = 0.88$). But I can't ...
0
votes
0answers
26 views

How should I use deep learning to find the rotation of an object from its 2D image?

I have 6600 images and I am supposed to know the rotation of the object in each image. So, given an image, I want to regress to a single value. My attempt: I use Resnet-18 to extract a feature vector ...
0
votes
1answer
35 views

Training a model to identify certain differences between images?

Newbie to CV here so sorry of this is basic. Here's the deal, I have a program that I run many times. and each run I produce a screenshot. I need to compare screenshots from N-1 and N runs and make ...
0
votes
0answers
28 views

Why using Aux() to implement VAE_1?

I have a bit of difficulties working on the article :https://arxiv.org/pdf/2009.07047v1.pdf. I want to implement the VAE_1, but it used VAE-GAN. I am familiar with ...
0
votes
0answers
15 views

Why does 0.8:0.2 divided dataset have a much greater AUROC than its 5-fold cross validated counterpart's mean AUROC?

I trained a dataset with a 5-fold cross validation to search for hyper-parameters by an AUROC metric. For splitting I used ...
0
votes
0answers
15 views

Add Additional Positional Information to Image Classification Neural Network

I am trying to find the best way to provide a neural network with both an image and some annotations about the image. Specifically, I'm creating a network to calculate an approximate 'cost' to go from ...
0
votes
0answers
36 views
0
votes
0answers
21 views

What would be the best criteria for determining the best generation on a maze training by mutation?

I'm training a neural network to solve a maze. My process is the following: Randomly generate a small maze Spawn hundreds of cars at the start, that will go through the same one maze Assign the same ...