Questions tagged [deep-learning]

For questions related to deep learning, which refers to a subset of machine learning methods based on artificial neural networks (ANNs) with multiple hidden layers. The adjective deep thus refers to the number of layers of the ANNs. The expression deep learning was apparently introduced (although not in the context of machine learning or ANNs) in 1986 by Rina Dechter in the paper "Learning while searching in constraint-satisfaction-problems".

647 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
0
votes
0answers
19 views

How does BERT answer questions?

I have been trying to understand how the BERT model works. Specifically, I am trying to understand how it picks up answers to questions on a given passage. I have tried following this blog post and, ...
0
votes
0answers
11 views

Handling multi scale data input to neural networks

This is a theoretical question. Let's assume the simplest setup of binary classification of a time series. The input every frame is a multi channel sample of many sensors. Each sensor is completely ...
0
votes
0answers
27 views

Is it possible to use GPT-3 with voice cloning to have GPT-3 respond in a custom voice?

I'm curious about three things here. Is it possible to use GPT-3 along with voice cloning to have GPT-3 either respond in a custom voice or possibly create an app that can do the same sort of thing? ...
0
votes
0answers
12 views

Why do the inception score and the Fréchet inception distance use the inception network and not another network?

So I was researching about the evaluation of GANs and found these two metrics which seem to be the most popular. I understand that the main ideia is to apply the data to a pre-trained network in order ...
0
votes
0answers
17 views

How to augment 2.5D keypoints?

I am currently working on 3D hand pose estimation. The idea is to first detect the 2.5D pose representation and then obtain 3D pose with the help of camera parameters. For some reason, I was trying to ...
0
votes
0answers
27 views

Understanding policies in helicopter control in the paper by Andrew Ng et al

I was going through this paper on helicopter flight control using reinforcement learning by Andrew Ng et al. It defines two policy classes to learn two policies, one for hovering the helicopter and ...
0
votes
0answers
24 views

How to change the number of input neurons in embedding layer?

I was building a recommender system using Tensorflow recommenders (TFRS) library . I was following the official tutorial for ranking model , where they have used two-tower model. The part where I have ...
0
votes
0answers
21 views

How is the marginal likelihood of wide valleys higher than that of narrow valleys when optimizing a cost function?

I am reading the paper Entropy-sgd: Biasing gradient descent into wide valleys by Chaudhari et al. From what I understand, wide valleys tend to generalize better than sharp ones because they are ...
0
votes
0answers
17 views

How to chose a specific contextual embedding?

I am learning deep learning using a plethora of online resources. I have been using mostly word2vec and gloVe for my NMT model. I recently came across the concept of contextual-embedding, and I see ...
0
votes
0answers
32 views

Accuracy goes straight for about 200 epochs then start increasing

Can anyone explain the following observation? Why did the accuracies keep to be a straight line with a very smooth decrease of loss? Is this because of the learning rate or other reasons? Some info: ...
0
votes
0answers
46 views

Is using a LSTM, CNN or any other neural network model on top of a Transformer(using hidden states) overkill?

I have recently come across transformers, I am new to Deep Learning. I have seen a paper using CNN and BiLSTM on top of a transformer, the paper uses a transformer(XLM-R) for sentiment analysis in ...
0
votes
0answers
18 views

How to deal with dynamically changing input tensor in neural networks without padding?

I have a dataset about the monitored health/growth of a community of people. The dataset has tensor shaped (batch_size, features, person, window), where: person==...
0
votes
0answers
46 views

Alpha Zero does not converge for Connect 6, a game with huge branching factor - why?

I have a problem with applying alpha zero self-play to a game (Connect 6) with a huge branching factor (30,000 on average). I have implemented the MCTS as described but I found that during the MCTS ...
0
votes
0answers
14 views

Nonrealtime tracking for object detection (with or without deep features)

I've been doing a search for tracking systems based on bounding box for several days (like Sort, DeepSort, Motpy, ...). But neither is nonrealtime. My problem is based on the tracking of multiple ...
0
votes
1answer
49 views

Why won't my model train with CTC loss?

I am trying to train an LSTM using CTC loss, but the loss does not decrease when I train it. I have created a minimal example of my issue by creating training data where the network simply has to copy ...
0
votes
0answers
23 views

Which AI technique should I use for (key)point detection (in an image of a plantar pressure)?

I am relatively new to the field of AI. I have a problem that I would like to solve with AI, but I don't know which buzzwords I should use to search for solutions. I have a plantar pressure scan, like ...
0
votes
0answers
16 views

Is parameter sharing in AlBERT akin to repeated application of same function on input?

I read the AlBERT and saw that its architecture used "Parameter Sharing" among layers of the encoder. They mentioned that this was done to save model space, make fewer training parameters ...
0
votes
0answers
23 views

Is there a reference that describes Recurrent Neural Networks for NLP tasks?

I would like some references of works that try to understand the functioning of any kind of RNN in natural language processing tasks. They can be any work that tries to explain the functioning of the ...
0
votes
0answers
16 views

Interpreting coordinates of the function from the image using Grid Lines

I have a very different kind of problem at hand. I have a function plotted on the grid lines as shown below Now, I need to get the x and y coordinates for this particular function at regular ...
0
votes
0answers
30 views

Backpropagation implementation not applicable for other cases

I saw this implementation of backpropagation in MATLAB, where the loss function used is MSE, and the last layer's activation function was sigmoid. I denoted the portions of the formula for what I ...
0
votes
0answers
25 views

Correct way to work with both categorical and continuous features together

I have a time series with both continuous and categorical features, and I want to do a prediction task. I will elaborate: The data is composed of 100Hz sampling of some voltages, kind of like an ecg ...
0
votes
1answer
70 views

A way to leverage machine learning to reduce DFS/BFS search time on a tree graph?

I'm not very knowledgeable in this field but I'm wondering if any research or information already exists for the following situation: I have some data that may or may not look similar to each other. ...
0
votes
0answers
49 views

Training speed in GPU vs CPU for LSTM

I was experimenting seq2seq model which was the bi-LSTM encoder/decoder with attention. When I compared the training times on GPU vs CPU while varying the batch size, I got CPU on the small batch ...
0
votes
0answers
15 views

Is there any solution to the problem of detecting whether a user is having trouble finding something while surfing a webpage?

While a user is navigating through a website, we need to detect whether the user is having trouble finding something in realtime. The output is used to trigger an event that should pop up a FAQ page ...
0
votes
0answers
23 views

How to build a commercial Image-Image search engine using LSH / Near Duplicate or some other algo on more than 20M images

TL;DR: HOW DO I APPLY LSH WITH A DEEP LEARNING MODEL TO BUILD A IMAGE-IMAGE SEARCH ENGINE ON >20M IMAGES? I want to build a system where I am helping my ...
0
votes
0answers
27 views

Papers on using symbolic methods as constraint on neural network?

Given a set of constraints on the input data, I am looking for papers that discuss using symbolic methods (decision trees, rule based, etc.) as a separate source of certainty in a classification task. ...
0
votes
1answer
35 views

Can the attention mechanism improve the performance in the case of short sequences?

I am aware that the attention mechanism can be used to deal with long sequences, where problems related to gradient vanishing and, more generally, representing effectively the whole sequence arise. ...
0
votes
1answer
41 views

RMSprop equation - dividing by a matrix?

I've been trying to understand RMSprop for a long time, but there's something that keeps eluding me. $dW$ and $db$ are matrices (that's what I understand from the element-wise comment), so that must ...
0
votes
0answers
37 views

Is there any rule of thumb to determine the amount of data needed to train a CNN

I am training an AlexNet Convolutional Neural Network to classify images in a dataset. I want to know if there is any general rule for using data augmentation in training a neural network. How can I ...
0
votes
0answers
12 views

What are the best metrics for Multi-Object Tracking (MOT) evaluation and why?

I want to compare multiple computer vision Multi-Object Tracking (MOT) methods on my own dataset, so first I want to choose the best metrics for this task. I have carried out some research in ...
0
votes
0answers
9 views

Given a system state, generate a sequence of state changes that lead to it

These systems are discrete and their state changes are rule based. Example: Given a chess position, generate a series of moves that will lead to it (there may be many, one, or none, but I only need ...
0
votes
0answers
14 views

Are there any good self annotating methods in machine learning

Currently I want to train a deep learning model on finger detection (drawing bounding boxes around fingers), so I haven't found an annotated dataset, so I decided to make it myself. but the number of ...
0
votes
0answers
11 views

Deep Unsupervised clustering on big data with no prior knowledge

I have around 3M BW images and I would like to organize them in as few clusters as possible in way which is meaningful for the dataset without any prior knowledge for this data, as they come from ...
0
votes
0answers
59 views

Time series prediction using LSTM and CNN-LSTM: which is better?

I am working on LSTM and CNN to solve the time series prediction problem. I have seen some tutorial examples of time series prediction using CNN-LSTM. But I don't know if it is better than what I ...
0
votes
0answers
22 views

How should I use deep learning to find the rotation of an object from its 2D image?

I have 6600 images and I am supposed to know the rotation of the object in each image. So, given an image, I want to regress to a single value. My attempt: I use Resnet-18 to extract a feature vector ...
0
votes
0answers
36 views

CNN for a DQN agent with a 2D matrix state and action as a 2D matrix

I have a custom environment, where the state is a 2D matrix of 11 rows (equals to number of users to satisfy) and 3 columns. Each column can take the value of either 0 or 1, and in each row, there can ...
0
votes
0answers
37 views

How to edit a photo using deep learning?

I just took a course on deep learning where one part of the syllabus was image classification and object recognition using CNNs, but I wonder how deep learning can be applied to apply certain filters ...
0
votes
0answers
18 views

How to perform data augmentation on multiple input classification task?

I would like to add some more samples to my dataset which consists of two parts: 1. image and 2. numerical data. For each image in the dataset there is its corresponding numerical data as well. If it ...
0
votes
0answers
17 views

Estimating depth/perspective of image

I'd like to find a method in which the depth or perspective of an image is estimated. I imagine this could perhaps be done based on how quickly classified objects, such as cars or humans, grow or ...
0
votes
0answers
49 views

What could be a good $\mathcal{R}$ dataset in the article “Old Photo Restoration via Deep Latent Space Translation”?

There are three domains in this article: Old Photo Restoration via Deep Latent Space Translation. The real old pictures noted by $\mathcal{R}$, the artificial old pictures noted by $\mathcal{X}$, and ...
0
votes
0answers
126 views

How should I build this DQN agent?

I have a set of users that can be one of 3 types. They will randomly request a service from the UAV which is a drone used as a Base Station. The UAV (the agent) is tasked with allocating subchannels (...
0
votes
0answers
29 views

How to generate a matrix out of sparse data?

I have a system that takes 32 inputs (all of which are 1 or 0) and generates 32 outputs (all of which are complex numbers that lie roughly in the range of (0,2)). The response of this system to its ...
0
votes
1answer
34 views

Semantic segmentation failing in small instance detection

I performed semantic segmentation with U-net. My dataset consists of grayscale images of defects. After training the dataset for I got an metric accuracy of only 0.3 - 0.4 IOU. Eventhough it is merely ...
0
votes
0answers
24 views

Find the distance between two objects from a 45 degree tilted camera images taken from a drone with a specific elevation from the ground

I have a project where i'm supposed to find the distance and the height of a specific object in an image taken by a drone using one camera. I have looked into perspective transformation/correction but ...
0
votes
0answers
12 views

What Deep Learning Applications Might Require Super-Computers or “SuperPODs”

With the release of NVIDIA's DGX SuperPOD of A100 GPUs, supercomputers will/are becoming more and more common-place. What potential deep learning tasks/applications might become more accessible with ...
0
votes
1answer
16 views

In a face database containing multiple images per subject, how do we determine the face image which is most suited for face recognition?

Let us imagine a face database with several subjects, each subject having multiple face images. How do we determine which is the best face suitable for face recognition purposes?
0
votes
0answers
10 views

Best strategy for Classification of Science Subjects. Phy, Chem , Maths and Bio? BERT, Transformers, Attention+SLTM, Self-Attention+LSTM?

I am working on a project where I have to first classify the Subjects of the given question and then the respective Chapter and then the sub-topic. In a nutshell, I have to predict the Subject, Grade ...
0
votes
0answers
50 views

Reference for Yoshua Bengio quote

I believe that Bengio is on record as describing Deep Learning as "A collection of methods for delivering intelligence" (or something very similar). Does anyone have an actual reference for ...
0
votes
0answers
86 views

Am I using transfer learning when I use SSD ResNet 50 model architecture?

Using Label-img, I have successfully labeled my images (dimensions 1100 x 1100 pixels), and am currently training the SSD ResNet50 model (from the TensorFlow 2 Detection Model Zoo). I downloaded the ...
0
votes
0answers
14 views

Does a Siamese Network need other trainable layers after the distance layer?

I'm approaching at Siamese Networks in order to use them for Image Similarity. I found that many people use famous models like VGG or ResNet to build the vectors that will go on the distance layer in ...

1
9 10
11
12 13