Questions tagged [deep-learning]

For questions related to deep learning, which refers to a subset of machine learning methods based on artificial neural networks (ANNs) with multiple hidden layers. The adjective deep thus refers to the number of layers of the ANNs. The expression deep learning was apparently introduced (although not in the context of machine learning or ANNs) in 1986 by Rina Dechter in the paper "Learning while searching in constraint-satisfaction-problems".

Filter by
Sorted by
Tagged with
0 votes
0 answers
29 views

Relating two small datasets with Poisson in a neural network or random network

I'm looking for a way to "relate" two small datasets, in Python, for predictive purposes. The two datasets are both independent and have no correlation (the numbers are randomly positioned). ...
Horiatiki's user avatar
  • 101
0 votes
0 answers
18 views

cause and effect

I watched a tutorial video on AI. The author stated these: 1: "Any device that can perceive its environment and take action accordingly has AI." 2: "AI understands the cause and ...
EmilyJ's user avatar
  • 101
0 votes
0 answers
13 views

How to let the AI trained on MNIST recognize my own hand-written number?

I have already trained a simple model without using any frameworks to recognize the hand-written numbers from the MNIST dataset. Actually it's just a copy of the example on the book Grokking ...
Jason Jia's user avatar
2 votes
1 answer
411 views

Which epoch is the best for me to choose?

I have trained my deep learning model. I also saved the validation loss to a file and plotted on a graph I have $2$ questions for this: Does the validation loss look normal? Is there any issue with ...
user's user avatar
  • 23
0 votes
0 answers
12 views

i need dataset for human activity and diseases from smartphone accelerometer sensor?

project aims to develop a health monitoring system utilizing smartphone accelerometer sensors and machine learning techniques. The primary focus is on detecting specific health conditions through the ...
Bashar Lo's user avatar
0 votes
0 answers
22 views

Prefix tuning in LLM uses learnable vectors to fine tune the model

I would like to implement a new architecture for Transformer. Below description is my thought. Prefix tuning in LLM uses learnable vectors to fine tune the model. Is there a way to use the output ...
jackson's user avatar
1 vote
1 answer
52 views

Do GANs have constant running time?

After the model is trained, you just need to input random noise and the generator will output an image, does this mean GANs have constant running time ? I'm asking about both naïve GAN and variants of ...
David's user avatar
  • 51
3 votes
0 answers
81 views

What are the advantages of GANs over Diffusion Models in image generation?

Diffusion Models have recently gained popularity in the field of image generation, with widely used products such as Stable Diffusion employing this approach and yielding impressive results. While ...
David's user avatar
  • 51
1 vote
0 answers
101 views

Question about the Conditioning Augmentation technique?

In the paper StackGAN: Text to Photo-realistic Image Synthesis with Stacked Generative Adversarial Networks, the goal is to convert text descriptions into images. The text encoder encodes the ...
David's user avatar
  • 51
0 votes
0 answers
57 views

How to detect negative (absence of) an object?

I want to detect the people that are NOT wearing PPE vests using a pre-trained object detection model like YOLO or Grounding Dino. The models are able to detect people and vests separately, but I am ...
Krithik Roshan's user avatar
0 votes
2 answers
43 views

how to determine the number of units for dense layer for transfer learning?

I'm using MobileNetV2 for classification, and I want to add dense layers(i remove the last layer of the MobileNetV2 model). How do I choose the number of units for the dense layer after obtaining the ...
Cy Rine's user avatar
0 votes
0 answers
17 views

Can't get a correct accuracy on tabular data using deep learning

This is my first message here, and I would like to seek some assistance ! I have a technical test for a job that I really want, and I have 10 days to complete it. I've attempted to work on it, but I'm ...
Enzo Durand's user avatar
1 vote
2 answers
150 views

The training process of a conditional GAN

For example, consider a dataset like MNIST. I give the conditional vector to produce only the number $7$ for both the generator and discriminator. In the following scenarios, what will the ...
abcd's user avatar
  • 15
-1 votes
0 answers
28 views

Diffusion model for image to image translation

I am interested in using the diffusion model for image-to-image translation (pair images). I used this repository for semantic image synthesis via diffusion models Code. How can I use it for image-to-...
yun dan's user avatar
2 votes
2 answers
174 views

Can mini-batches for stochastic gradient be balanced but not representative of the training data?

When we construct mini-batches for stochastic gradient, it is important to ensure that the different mini-batches are balanced (for example, in case of classification they contain the same ratio for ...
DSPinfinity's user avatar
0 votes
3 answers
59 views

My model is only improving when learning rate is 1. Should I be worried?

As the title says my GNN with three layers of GAT (Graph attention layers) is only moving the metrics when the learning rate is 1. As generally the learning rate is (0,1) should I be worried? Also ...
DataDoge's user avatar
-2 votes
1 answer
52 views

the best choice to reduce a features vector

i have 1200 features highly correlated , and i want to reduce those number of features so the best choice is use feature selection or dimensionality reduction? and which method is the best in this ...
myriamkach's user avatar
0 votes
1 answer
52 views

Are foundation models something fundamentally new? Is there a proper definition?

Currently, one can hear more and more about "foundation models" but details of this are not always clear. Also, I even have the impression, that sometimes people don't talk about exactly ...
BanDoP's user avatar
  • 156
0 votes
1 answer
44 views

What is the potential issue of nested neural networks

everyone. I am working on a nested neural network architecture. For the sake of better understanding my question, simply assume the loss is $L = G(k’) - H(k'')$ where $G$ and $H$ are two functions we ...
Zuba Tupaki's user avatar
0 votes
0 answers
14 views

Keeping the grad of the tensor when using inverse_transform

To train a network, I scaled both the input and outputs of my data like the following: ...
jasw's user avatar
  • 1
0 votes
0 answers
10 views

Why my deep learning model (FCNN/ 1DCNN) fails to learn when training on medical dataset?

I am working on a project to predict the severity of the disease, Hemophilia using a deep learning model(FCNN or 1DCNN). I am working based on the information provided in this article: https://www....
54rnd's user avatar
  • 1
0 votes
1 answer
111 views

In the conditional GAN (cGAN) architecture, why does the discriminator need conditional variable?

I'm reading about conditional GAN (cGAN) architecture, what I know is that the generator creates images combining both noise vector and conditional variable, the noise vector brings in random elements ...
abcd's user avatar
  • 15
3 votes
1 answer
51 views

Regression loss conditioned by the ground-truth values

I'm working on a regression problem with a CNN in which the input is a single image, and the output is an angle in degrees (which determines a specific measure related to the image). Sometimes, the ...
Cezoz08's user avatar
  • 43
0 votes
0 answers
16 views

Book suggestion about deploying real deep learning models in real world

Can you suggest books about deploying machine learning algorithms on robots, especially on real time stream? I don't know how to deal with latency and other challenges that real time inference/stream ...
dato nefaridze's user avatar
0 votes
0 answers
22 views

Encoding categorical data with "many" unique values in neural network

I am new to machine learning, in fact, I am implementing my first deep neural network from scratch without any framework. The dataset has 3500 rows, and 4 categorial columns of which two have about ...
M a m a D's user avatar
  • 113
0 votes
0 answers
22 views

how to know to define asuitable posterior for bayesian deep learning

I work with model its purpose for classification task in medical image, i want also to estimate uncertainty , so i work with Bayesian technique , i use a pre-trained model for feature extraction and ...
a-eng's user avatar
  • 1
0 votes
0 answers
9 views

I'm trying to build image search like Google Photo-Image with face is given to model & it'll get all the images in database in which he/she is present

When a user upload a selfie, the model search same person in dataset of images of multiple persons and get back all the images in which that person is present. Step 1: From dataset of images I detect ...
BKP's user avatar
  • 1
0 votes
0 answers
10 views

Classes definition for detecting impervious surfaces on aerial photographies

My project is to use deep learning, essentially a UNET segmentation model, to detect impervious surfaces on high resolution aerial photographies. I wonder if it's better to train the model with many ...
Below the Radar's user avatar
1 vote
1 answer
73 views

Inquiry on Combining Two Neural Networks for unsupervised training: Has This Been Researched?

Hello AI Stack Exchange Community, I am exploring an idea related to neural networks, and I'm curious to know if this method has been previously researched or if there is a specific term for it. I am ...
Deadbeef Development's user avatar
0 votes
0 answers
28 views

Has There Been Research on Using a Neural Network as a Loss Function for Another Neural Network?

I'm intrigued by the idea of employing a separate neural network (which I'll refer to as the "loss network") to compute the loss for a primary network based on its inputs and outputs. The ...
Deadbeef Development's user avatar
0 votes
0 answers
69 views

Why is a linear and not a non-linear transformation used in self-attention to calculate queries, keys and values?

In self-attention, one vector undergoes three different transformations to create the query, keys and values. These are always a simple linear transformations. Why is it considered sufficient? Shouldn'...
Kasia's user avatar
  • 193
0 votes
0 answers
26 views

Watermark removal without inpainting

Suppose I have a bunch of images that have been watermarked with a transparent logo with some unknown blending function g as ...
Michael's user avatar
  • 159
1 vote
0 answers
39 views

Are there neural networks that compute weights dynamically based on geometric attributes of neurons?

I am interested in exploring neural network architectures where the weights are not stored but are computed dynamically based on certain attributes or "dimensions" of the connected neurons. ...
Deadbeef Development's user avatar
0 votes
0 answers
7 views

I have n-dimensional latent representational data, with a y logit label: How do I find peaks in the data using the label?

I essentially need a "find peaks" algorithm for when the input data is n-dimensional. Specifically, in the latent space of my neural network I have have collected all the training data ...
Eoin Ó Coinnigh's user avatar
0 votes
0 answers
23 views

What algorithms could I use if I want to increase the accuracy of matched keypoints in an image pair?

Let's say that I used a keypoint detector like SIFT or SuperPoint to detect keypoints in image 1 and 2. Afterwards, I used a keypoint matcher to match corresponding keypoints in this image pair. The ...
user402016's user avatar
1 vote
0 answers
57 views

In the figure of Stable Diffusion, when does the switch part change?

In the illustration of Stable Diffusion, there is a concatenation part through Cross-Attention. Why is there a switch in the concatenation part?
diffusion stable's user avatar
0 votes
1 answer
23 views

Multiple Loss Functions For Proper Parameter Updates [closed]

I am working on a model on PyTorch where it has two loss functions each fed from two separate input datasets. I want to update the model parameters based on these loss functions, ic_loss, res_loss, ...
Burak Karaosmanoğlu's user avatar
0 votes
0 answers
21 views

Building an algorithm that detects an area delimited by a quadrat

I want to build an algorithm that takes an image and outputs the same image, but cropped so that it focuses only on a particular area delimited by a quadrat, like so: This is not my image as I am not ...
Droidux's user avatar
0 votes
1 answer
28 views

Data out of scale

Imagine that you want to train a deep learning model for forecasting/transforming data and have a training dataset with endpoints 0 and 1000. Now, Imagine receiving a new dataset with endpoints 0 and ...
Nathaldien's user avatar
0 votes
0 answers
18 views

Exploring the Similarity of Sibling’s Voices Using Automatic Speaker Recognition

I want to start project on Exploring the Similarity of Sibling’s Voices Using Automatic Speaker Recognition Everyone has a unique voice, because of the different structure of their articulatory ...
Alan Turing's user avatar
0 votes
0 answers
12 views

Possible Reasons for the Discrepancy in Trainable Parameters of the Extended DeepConvLSTM Model

I have implemented DeepConvLSTM baseline Model input are 60×d frames each representing 60 samples with d features. Frames are fed into four consecutive convolution layers with standard rectified ...
Nafees Ahmed's user avatar
1 vote
1 answer
98 views

Reinforcement Learning vs Supervised Learning [duplicate]

I have never tried reinforcement learning in my life. I'm planning to apply it in robotics. I have some experiences using supervised learning mainly deep learning. So, that's mean I will use neural ...
Muhammad Ikhwan Perwira's user avatar
1 vote
0 answers
24 views

Choosing a Deep Learning model to analyse microscope images

I have lots of simulated training data of microscope images and I want to train a network to count the number of points in the image. These points are distributed in concentric oblate shells. The ...
James's user avatar
  • 111
1 vote
0 answers
26 views

Is it possible to have a good validation accuracy with random labels?

I'm currently trying to train a siamese network to determine if two inputs are similar or not. The inputs are power consumption traces and I'm basically using the siamese network as some sort of ...
WINTERSDORFF Raphael's user avatar
1 vote
0 answers
23 views

Siamese network, cosine similarity unexpected result?

I was reading more about siamese network and it's use for similarity problems and I've stumbled upon this https://keras.io/examples/vision/siamese_network/ I was surprised to see both similarities in ...
recimo's user avatar
  • 11
0 votes
1 answer
70 views

How to force Transformer to give more weight to certain tokens

I'm developing an encoder-decoder based transformer model and I would like to ask if there are ways to incentivize or penalize certain tokens during training. I'm working on a translation task where ...
jasperagrante's user avatar
0 votes
0 answers
32 views

How does a zero-order hold kernel in a Convolutional Neural Network look like?

Several papers co-authored by Hitoshi Kiya propose to use a fixed convolutional layer with a zero-order hold kernel to avoid checkerboard artifacts in CNNs. [1, 2, 3] While there is plenty of ...
Domderon's user avatar
  • 101
1 vote
1 answer
23 views

LSTM with multiple data streams

I am working on the following problem: I have ~10 weather stations in somewhat approximate areas, at some points during the day (different for each station), I get readings of various data points (...
PenguinHook's user avatar
1 vote
2 answers
136 views

Why does Stable Diffusion use VAE instead of AE?

I am currently studying the Latent Diffusion Models (LDMs) and am interested in training my own model using a unique dataset. In my research, I came across Stable Diffusion (SD). Some sources suggest ...
P0TAT0's user avatar
  • 11
1 vote
1 answer
61 views

Which process is better to understand images?

What is the difference between this process of recognizing objects in a image: (The correlation function calculate the correlation coefficient between the input and a image containing the object we ...
Cerise's user avatar
  • 121

1
2 3 4 5
40