Questions tagged [neural-networks]

For questions about a artificial networks, such as MLPs, CNNs, RNNs, LSTM, and GRU networks, their variants or any other AI system components that qualify as a neural networks in that they are, in part, inspired by biological neural networks.

698 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
0
votes
0answers
10 views

Low Signal-To-Noise Ratio Data Processing and Model Choices

Attached is a plot showing that y regresses on individual features: Scatter Plot And as shown, each feature has minuscule predictive power on y. I have 130 features like this, all of them are more or ...
0
votes
0answers
10 views

Deriving an ANFIS based controller

I have a Fuzzy controller with a desirable response, and I'm wanting to use the input and output data to derive an ANFIS based controller. ANFIS requires data for 2 inputs and 1 output, I have the ...
0
votes
0answers
35 views

How to extract parameters from a text using AI/NLP

lets say I have three texts: "make a heading that says hello word" "make a heading of hello world" "create heading consist of hello world" How can I fetch those groups ...
0
votes
0answers
17 views

Neural Network trains towards 1 despite target

So I'm trying to make my first neural network and have just finished my back propagation functions. I got the algebra from brilliant and thought I'd understood it, but my bug proves otherwise. The bug ...
0
votes
0answers
19 views

Which AI technique should I use for (key)point detection (in an image of a plantar pressure)?

I am relatively new to the field of AI. I have a problem that I would like to solve with AI, but I don't know which buzzwords I should use to search for solutions. I have a plantar pressure scan, like ...
0
votes
0answers
8 views

Is parameter sharing in AlBERT akin to repeated application of same function on input?

I read the AlBERT and saw that its architecture used "Parameter Sharing" among layers of the encoder. They mentioned that this was done to save model space, make fewer training parameters ...
0
votes
0answers
18 views

What's the best machine learning algorithm / neural network architecture to use for a task that maps between images and textual descriptions of them?

Title says it all really. I want to train a network to take images of diagrams and produce a standard textual definition of them. What ML architecture is best for this?
0
votes
0answers
26 views

Multivariate time-series classification with many variables

I am attempting to use time-series classification algorithms for fraud detection applications. I have came across several works in the literature that propose novel techniques for multivariate time-...
0
votes
0answers
27 views

How can I perform the forward pass in a neural network evolved with NEAT, given that some connections may not exist or there may be loopy connections?

I have a problem that arose as part of a NEAT (Neuro Evolution Through Augmenting Topologies) implementation that I am writing. I am wanting it to produce topologies or graphs that describe neural ...
0
votes
0answers
30 views

How to draw a 3-dimensonal shape's neural network

I am reading an exam question about NN (that I cannot publish, for copyright reasons). The question says: 'Construct a rectangle in 2D space. Define the lines, and then define the weights and ...
0
votes
0answers
11 views

How to update the error on hidden nodes using back-propogation, given the error on the output nodes and weights

I'm trying to solve question 30 of this paper. The short version of the question is if someone could show me how to do this, I would appreciate it (the answer should be A; -0.0660). The long version ...
0
votes
0answers
15 views

Is there any solution to the problem of detecting whether a user is having trouble finding something while surfing a webpage?

While a user is navigating through a website, we need to detect whether the user is having trouble finding something in realtime. The output is used to trigger an event that should pop up a FAQ page ...
0
votes
0answers
24 views

Python: Recognize actions / keywords in natural text?

This is for a personal project, and I am no very skilled programmer, language is Python, needs to work offline. That said: I have a list of 200 key actions, eg. 'Building sandcastles', 'Paintball' or '...
0
votes
0answers
14 views

Generating numerical output based on multiple inputs

I have been trying to use a linear regression with Turicreate to predict the a certain number based on a variety of input numbers. My process is pretty simple: I have four columns in my training ...
0
votes
0answers
9 views

Is the information in the hiddenstate of a RNN worth processing further after the input passes the RNN?

I hope the question is understandable. I just wanted to ask if the hidden state, which is passed through the timesteps/cells of an RNN/LSTM/GRU to deliver information from $\text{cell}_{i-1}$ to the $\...
0
votes
0answers
36 views

Can I solve the below functional equation using neural networks?

I recently watched this video, in which he solves the equation $$f(x)+f\left(\frac{1}{1-x}\right) = x$$ The answer is $$f(x) = \frac{x^3-x+1}{2x(x-1)}$$ I tried to solve this functional equation using ...
0
votes
0answers
11 views

Chatbot with Context Management and Awareness

I am currently implementing a closed-domain FAQ chatbot using https://www.sbert.net/index.html as my main model for answering questions from the users. I wish to extend the functionality of the ...
0
votes
0answers
14 views

Can we encode categories binarily in a classification task using neurons outputs as consecutive bits?

Let's say, that we have a simple neural network as the one depicted below: The goal of this NN is to classify inputs into two separate categories. Usualy, each neuron would correspond to one category,...
0
votes
0answers
20 views

How to deal with predictions for data outside the range of the training dataset in neural networks?

I’ve set up a neural network model to experiment with predicting foreign exchange rates based on various economic data. The model learned fine and the test data is OK ($R^2 = 0.88$). But I can't ...
0
votes
0answers
17 views

How should I use deep learning to find the rotation of an object from its 2D image?

I have 6600 images and I am supposed to know the rotation of the object in each image. So, given an image, I want to regress to a single value. My attempt: I use Resnet-18 to extract a feature vector ...
0
votes
1answer
23 views

Training a model to identify certain differences between images?

Newbie to CV here so sorry of this is basic. Here's the deal, I have a program that I run many times. and each run I produce a screenshot. I need to compare screenshots from N-1 and N runs and make ...
0
votes
0answers
28 views

Why using Aux() to implement VAE_1?

I have a bit of difficulties working on the article :https://arxiv.org/pdf/2009.07047v1.pdf. I want to implement the VAE_1, but it used VAE-GAN. I am familiar with ...
0
votes
0answers
14 views

Why does 0.8:0.2 divided dataset have a much greater AUROC than its 5-fold cross validated counterpart's mean AUROC?

I trained a dataset with a 5-fold cross validation to search for hyper-parameters by an AUROC metric. For splitting I used ...
0
votes
0answers
14 views

Add Additional Positional Information to Image Classification Neural Network

I am trying to find the best way to provide a neural network with both an image and some annotations about the image. Specifically, I'm creating a network to calculate an approximate 'cost' to go from ...
0
votes
0answers
32 views
0
votes
0answers
21 views

What would be the best criteria for determining the best generation on a maze training by mutation?

I'm training a neural network to solve a maze. My process is the following: Randomly generate a small maze Spawn hundreds of cars at the start, that will go through the same one maze Assign the same ...
0
votes
0answers
5 views

How to find rotation x/y/z of chessboard diagram with what network architecture?

I want to recognize pieces of chessboard diagram (not real 3d pieces but just diagram). I split this task in some operation like rotation/cutting/segmentation. First of all I want to detect chessboard ...
0
votes
0answers
45 views

What is the purpose of soft orthogonal regularization in training deep neural network?

I'm reading papers regarding soft orthogonal regularization, $\frac \lambda 4||WW^\intercal - I||_F^2$, over a deep neural network whose activation function is ReLU and weight matrix $W$ is ...
0
votes
0answers
35 views

Which models can I use for supervised learning with images?

I have to do a project that detects fabric surface errors and I will use machine learning methods to deal with it. I have a dataset that includes around six thousand fabric surface images with the ...
0
votes
1answer
22 views

Which machine learning technique can I use to match one set of data points to another?

I have two measuring devices. Both measure the same thing. One is accurate, the other is not, but does correlate with a non-fixed offset, some outliers, and some noise. I won't always be using the ...
0
votes
0answers
8 views

Best strategy for Classification of Science Subjects. Phy, Chem , Maths and Bio? BERT, Transformers, Attention+SLTM, Self-Attention+LSTM?

I am working on a project where I have to first classify the Subjects of the given question and then the respective Chapter and then the sub-topic. In a nutshell, I have to predict the Subject, Grade ...
0
votes
0answers
24 views

Am I using transfer learning when I use SSD ResNet 50 model architecture?

Using Label-img, I have successfully labeled my images (dimensions 1100 x 1100 pixels), and am currently training the SSD ResNet50 model (from the TensorFlow 2 Detection Model Zoo). I downloaded the ...
0
votes
0answers
13 views

Does a Siamese Network need other trainable layers after the distance layer?

I'm approaching at Siamese Networks in order to use them for Image Similarity. I found that many people use famous models like VGG or ResNet to build the vectors that will go on the distance layer in ...
0
votes
0answers
9 views

Cyclic network's output converges to a constant

I have a problem. i have designed a network that takes in as input a segment of the output vector. The problem is, depending on the eigenvectors of the weight matrix, the series converges to a ...
0
votes
0answers
18 views

Need suggestion for Reinforcement Learning based visual landing system for quadcopters (UAVs)

I have deep interest in quadcopters. I need ideas for designing of an experiment. I have a programmable quadcopter. I can autonomously land it on a staitonary landing pad with a vision algorithm. ...
0
votes
0answers
9 views

Is there a framework or method that would help visualise inner workings of a feedforward neural network?

I wonder if there is some framework or method to help visualising inner workings of a feedforward deep neural network? What I mean by this is something similar to what is being done with CNNs where we ...
0
votes
0answers
37 views

Is the “mlpconv” layer in the “Network in Network” paper computing $1 \times 1$ convolutions or not?

I am reading the Network in Network paper. This is the equation they introduce for their mlpconv layer (equation 2 in the paper, page 3): $$ \begin{aligned} f_{i, j,...
0
votes
0answers
29 views

Transforming neural network target values before training

Consider the scenario in which I am measuring certain $f(a,x)$, which i want to be the target value for some related input $g(a,x)$. In other words, I am trying to map $$g(a,x)\Rightarrow f(a,x)$$ I ...
0
votes
0answers
19 views

What is the best neural network model to classify an x(t) signal according two classes?

I am a beginner in AI methods. I have a collection of x(t) data, where x are some signal amplitudes and t is a time. My testing data are divided into two classes, say those from good and bad ...
0
votes
0answers
25 views

XOR problem with bipolar representation

I am taking a course in Machine Learning and the Professor introduced us to the XOR problem. I understand the XOR problem is not linearly separable and we need to employ Neural Network for this ...
0
votes
0answers
29 views

How did they use their dataset with VAEs?

Old Photo Restoration via Deep Latent Space Translation (https://paperswithcode.com/paper/old-photo-restoration-via-deep-latent-space) In the article, it says : "We propose to restore old photos ...
0
votes
0answers
26 views

Wasserstein GAN with gradient penality - Loss values

I have trained a WAN with gradient penalty and the loss values ​​seem to me much higher than the examples I have seen on the net. The generator receives 2 images as input and must generate a ...
0
votes
0answers
22 views

Random Initializations with ReLU gives puzzling results

this may sound naive, but I’m getting a really puzzling result. I was experimenting with MNIST on vanilla MLP (784, 256, 128, 10) with ...
0
votes
1answer
54 views

Is it possible to know the distance objects are from camera based on only knowing one object's height?

I am doing a project where I have to know distance a particular object is from camera. In the photo I only know one of the object's height, but I don't know how far away that object is and I don't ...
0
votes
0answers
13 views

Cocatenate feature extractor layers with different channels

I have a network architecture for feature extraction and I wanted to concatenate layers of the same dimensions but with different feature channels. ...
0
votes
0answers
26 views

Choice of loss function for semantic segmentation

I am training a U-Net for semantic segmentation of large medical images (4096x4096px). The two classes are "too" unbalanced. The white pixels are just about 0.1% (or less) of the whole image....
0
votes
0answers
31 views

How to convert a certain file format into another using neural network?

I am an amateur with codes but still interested by ML and NN applications. How would I go to convert one file format to another by using neural network. e.g: mp3 to wav, fbx to obj, wav to png, ...
0
votes
0answers
17 views

Why is sine activation function not used frequently since we know from fourier transforms that sine functions can combine to fit any function?

Pretty much the title. I'm no expert but from what I know, if you add up enough sine functions with proper amplitudes and frequencies you can get any function you want as a result. With that knowledge,...
0
votes
0answers
21 views

What are some good models to use for spelling corrections?

I used OCR to extract text from an image, but there are some spelling mistakes in it : The text is as follows : ...
0
votes
0answers
43 views

How to input a given sequence to a transformer (or an RNN) with probability of occurrence?

I'm experimenting with music and transformers, and I have sequences $S$ of shape: $(B,L,N)$ where $B$ is the batch size, $L$ is the sequence length, and $N=12$ are the number of musical notes with ...