Questions tagged [machine-learning]

For questions related to machine learning (ML), which is a set of methods that can automatically detect patterns in data, and then use the uncovered patterns to predict future data, or to perform other kinds of decision making under uncertainty (such as planning how to collect more data). ML is usually divided into supervised, unsupervised and reinforcement learning. Deep learning is a subfield of ML that uses deep artificial neural networks.

Filter by
Sorted by
Tagged with
0 votes
2 answers
28 views

What is a "multinomial model" in machine learning?

What is the mathematical definition of "multinomial model" in machine learning? I will be happy for a good definition plus an example.
DSPinfinity's user avatar
0 votes
0 answers
13 views

How to decide on how to define the output function for a neural network?

What I want my simple ML model to do is for a certain case file, to take the type of crime and the amount of damage(converted into dollars), and to make a judgment (in dollars incorporating price for ...
Aliquis's user avatar
1 vote
0 answers
18 views

Prefix tuning in LLM uses learnable vectors to fine tune the model

I would like to implement a new architecture for Transformer. Below description is my thought. Prefix tuning in LLM uses learnable vectors to fine tune the model. Is there a way to use the output ...
jackson's user avatar
  • 11
0 votes
0 answers
8 views

Could an analysis of GPT4's WAIS score be published?

Similar to this: https://www.scientificamerican.com/article/i-gave-chatgpt-an-iq-test-heres-what-i-discovered/ But more detailed and in depth (subtest breakdown, including image analysis, etc.), WAIS-...
BigMistake's user avatar
1 vote
1 answer
46 views

Do GANs have constant running time?

After the model is trained, you just need to input random noise and the generator will output an image, does this mean GANs have constant running time ? I'm asking about both naïve GAN and variants of ...
David's user avatar
  • 51
4 votes
4 answers
433 views

Is it possible that Precision and Recall increase together?

Usually, it is said in ML that there is a trade-off between Precision and Recall. I wonder if it is possible that Precision and Recall can increase together?
DSPinfinity's user avatar
3 votes
0 answers
75 views

What are the advantages of GANs over Diffusion Models in image generation?

Diffusion Models have recently gained popularity in the field of image generation, with widely used products such as Stable Diffusion employing this approach and yielding impressive results. While ...
David's user avatar
  • 51
0 votes
2 answers
82 views

is there a mathematical explanation of precision and recall tradeoff?

Is there a mathematical explanation of precision and recall tradeoff? Ie, is it possible mathematically to see that as you increase one, the other decreases? $\text{Precision}=\frac{TP}{P^*}=\frac{TP}{...
DSPinfinity's user avatar
1 vote
0 answers
97 views

Question about the Conditioning Augmentation technique?

In the paper StackGAN: Text to Photo-realistic Image Synthesis with Stacked Generative Adversarial Networks, the goal is to convert text descriptions into images. The text encoder encodes the ...
David's user avatar
  • 51
1 vote
1 answer
61 views

What kind of ML/AI approach might work well for "edge" detection in a function?

I have a function that looks something like this (in blue): I'm curious to hear what kind of ML/AI algorithm might be useful to detect the approximate x0 value at which the function y(x) ...
Tomislav Nakic-Alfirevic's user avatar
0 votes
0 answers
57 views

How to detect negative (absence of) an object?

I want to detect the people that are NOT wearing PPE vests using a pre-trained object detection model like YOLO or Grounding Dino. The models are able to detect people and vests separately, but I am ...
Krithik Roshan's user avatar
4 votes
3 answers
862 views

What is a pipeline in machine learning?

I have heard the term "pipeline" used in many different contexts. Now I'm trying to bring some clarity to the terminology: What exactly is a "pipeline" in machine learning?
user946822's user avatar
0 votes
2 answers
41 views

how to determine the number of units for dense layer for transfer learning?

I'm using MobileNetV2 for classification, and I want to add dense layers(i remove the last layer of the MobileNetV2 model). How do I choose the number of units for the dense layer after obtaining the ...
Cy Rine's user avatar
0 votes
1 answer
65 views

In k-NN, how does the condition $k(N)/N \to 0$ ensure that all the k nearest neighbors are close to a given test point $\mathbf{x}$?

Consider the k-NN algorithm and let $k(N)$ be the choice of k as a function of N (data points). For $N \to \infty$, if $k(N) \to \infty$ and $k(N)/N \to 0$, then k-NN converges to optimal classifier. ...
DSPinfinity's user avatar
0 votes
0 answers
17 views

Can't get a correct accuracy on tabular data using deep learning

This is my first message here, and I would like to seek some assistance ! I have a technical test for a job that I really want, and I have 10 days to complete it. I've attempted to work on it, but I'm ...
Enzo Durand's user avatar
1 vote
1 answer
90 views

Meaning of "error on the test point x" in optimal classifier for binary classification

Let f(x) be optimal classifier for binary classification where output is modelled noisy. What does it mean "f(x) makes a mistake only if there is an error on the test point x"? Basically, ...
DSPinfinity's user avatar
1 vote
1 answer
70 views

Is it possible to do machine learning on encrypted images?

I wuold like to know if it is possible to train a CNN to classify images (like nsfw detection) without receiving any intelligible information about it ? By applying some kind of one-way mask before ...
max-lt's user avatar
  • 111
1 vote
2 answers
148 views

The training process of a conditional GAN

For example, consider a dataset like MNIST. I give the conditional vector to produce only the number $7$ for both the generator and discriminator. In the following scenarios, what will the ...
abcd's user avatar
  • 15
2 votes
2 answers
173 views

Can mini-batches for stochastic gradient be balanced but not representative of the training data?

When we construct mini-batches for stochastic gradient, it is important to ensure that the different mini-batches are balanced (for example, in case of classification they contain the same ratio for ...
DSPinfinity's user avatar
1 vote
0 answers
35 views

Neural network learns to mimic distribution of classes in dataset instead of using signal from input

I'm trying to implement example from a classic AI paper named "Learning representations by back-propagating errors" by Hinton et al. Example aims at training network able to predict third ...
Jan Grzybek's user avatar
1 vote
1 answer
45 views

NLP "small" model to improve "big" model

When training the model for NLP is it important to get rid of data which has "bad semantic" for learning process? My plan is to create a "small model" which can decide whether data ...
Milkmaid's user avatar
  • 125
-2 votes
1 answer
50 views

the best choice to reduce a features vector

i have 1200 features highly correlated , and i want to reduce those number of features so the best choice is use feature selection or dimensionality reduction? and which method is the best in this ...
myriamkach's user avatar
1 vote
1 answer
27 views

How can we construct a skewed noise distribution using the maximum likelihood approach?

When the probability of observing a large positive error is larger than the probability of observing a large negative error in binary classification, how can this be modelled by a skewed noise ...
DSPinfinity's user avatar
1 vote
1 answer
68 views

Why is laplace distribution less sensitive to outliers than normal distribution?

Why is laplace distribution less sensitive to outliers than normal distribution?. The following is the content. (See page 103 of http://smlbook.org/book/sml-book-draft-latest.pdf) "Also, in the ...
DSPinfinity's user avatar
0 votes
1 answer
43 views

What is the potential issue of nested neural networks

everyone. I am working on a nested neural network architecture. For the sake of better understanding my question, simply assume the loss is $L = G(k’) - H(k'')$ where $G$ and $H$ are two functions we ...
Zuba Tupaki's user avatar
0 votes
0 answers
20 views

When to know if I am "on the right track" for a CNN architecture

Context Very new to CNNs and ML in general. I am building a simple binary image segmentation network for generating black and white image masks (white pixels = desired object; black pixels = all else)....
gladshire's user avatar
0 votes
0 answers
16 views

kerascv retinanet for gender identification

I am using KerasCV Retinanet to detect people and their genders in images. I would like to detect "man", "woman", "boy", "girl" and "baby" in images. ...
Doug's user avatar
  • 3
1 vote
1 answer
49 views

Unclear steps in derivation of normal equations in linear regression using linear algebra approach

How are eqs.(3.55) and (3.56) obtained? Especially, it is unclear how triangle inequality implies eq.(3.56) because we have squared norms.
DSPinfinity's user avatar
0 votes
0 answers
7 views

Using Variable Text Features in Machine Learning Model

I am building a classification model using deidentified patient data with ICD-10 codes as inputs. Each code is a string and represents a diagnosis, and these follow the pattern of 1 letter, followed ...
Omnitragedy's user avatar
0 votes
1 answer
108 views

In the conditional GAN (cGAN) architecture, why does the discriminator need conditional variable?

I'm reading about conditional GAN (cGAN) architecture, what I know is that the generator creates images combining both noise vector and conditional variable, the noise vector brings in random elements ...
abcd's user avatar
  • 15
3 votes
2 answers
501 views

Why can we have misclassifications for a perfect model in logistic regression?

I am reading the book: MACHINE LEARNING- A First Course for Engineers and Scientists, by Lindholm et.al. Chapter 3, page 50. Link: http://smlbook.org/book/sml-book-draft-latest.pdf Consider the ...
DSPinfinity's user avatar
0 votes
1 answer
21 views

Why is my agent stuck on the same action in my Twin Delayed Deep Deterministic Policy Gradient (TD3) program?

I've been tirelessly converting a reinforcement learning program from Python to JavaScript using TensorFlow.js that is running Twin Delayed Deep Deterministic Policy Gradient (TD3). I'm just trying to ...
CloudZero's user avatar
3 votes
1 answer
51 views

Regression loss conditioned by the ground-truth values

I'm working on a regression problem with a CNN in which the input is a single image, and the output is an angle in degrees (which determines a specific measure related to the image). Sometimes, the ...
Cezoz08's user avatar
  • 43
2 votes
1 answer
1k views

Neural network for game

There is a game for two, which is an NxN field (always the same size). Players take turns. The first player's goal is to connect the two points (not necessarily at the corners) given on this field. ...
user3576767's user avatar
0 votes
1 answer
33 views

If the unigram precision is (N-1)/N, then the bigram precision is :

Consider the following machine translation scenario. The reference translation has N words (do not consider sentence beginner ‘hat’ and sentence finisher ‘dot’). The machine output also has N words. ...
Geeklovenerds's user avatar
1 vote
1 answer
35 views

What is the concept of pruning a tree in Machine Learning regression problems?

What is the concept of pruning a tree in Machine Learning regression problems? I am confused and a simple explanation would be great.
Shekhar's user avatar
  • 11
0 votes
1 answer
22 views

Generator loss not decreasing while training GAN

I’ve been attempting to create a basic GAN to generate images using this database of flowers (https://www.robots.ox.ac.uk/~vgg/data/flowers/102/). I’ve spent a few days on this, and largely based my ...
Hozaifa Bhutta's user avatar
0 votes
0 answers
9 views

I'm trying to build image search like Google Photo-Image with face is given to model & it'll get all the images in database in which he/she is present

When a user upload a selfie, the model search same person in dataset of images of multiple persons and get back all the images in which that person is present. Step 1: From dataset of images I detect ...
BKP's user avatar
  • 1
0 votes
0 answers
10 views

Classes definition for detecting impervious surfaces on aerial photographies

My project is to use deep learning, essentially a UNET segmentation model, to detect impervious surfaces on high resolution aerial photographies. I wonder if it's better to train the model with many ...
Below the Radar's user avatar
1 vote
1 answer
40 views

What number classes makes a classification problem continuous

I am working on a classification problem, where I have sequences of images and I want to train a model to predict the index of the image with some wanted property. The target classes would obviously ...
mavex857's user avatar
1 vote
1 answer
37 views

Feature vector representation of probability distribution

I have a series of multiple probability distribution like this: [ [0.2, 0.3, 0.5], [0.1, 0.2, 0.7], ... ] Do you have any suggestions how I can represent this ...
mavex857's user avatar
1 vote
1 answer
76 views

Why can't one get extremely high accuracy with an machine learning algorithm?

Suppose we have a classical machine learning problem. Say $m$ training examples and $n$ features with $m >> n$. Suppose I find a great algorithm using automl or otherwise that gives 95% accuracy ...
wander95's user avatar
  • 113
0 votes
0 answers
18 views

Can manual feature extraction be considered a part of a learning algorithm?

A learning algorithm is a tuple $(\mathcal{H}, \mathcal{O}, \mathcal{L})$ where $\mathcal{H}$, $\mathcal{O}$ and $\mathcal{L}$ are the hypothesis class, optimizer and loss function respectively. We ...
ado sar's user avatar
  • 150
0 votes
0 answers
13 views

How can a RNN with 256 cells accept a input of any size?

I built a 3 layered RNN model with 256 cells each using torch. Input feature size is set to 40. Below give a basic Idea on the model. ...
D Star Let's Explore's user avatar
1 vote
1 answer
23 views

ML predicting output based on single feature

I am a beginner in ML, I came across the below scenario. I wonder if I could use ML (and which kind) and what would be the the steps needed for the pre-processing of a time-series. So first (1)how to ...
jet's user avatar
  • 21
0 votes
0 answers
7 views

I have n-dimensional latent representational data, with a y logit label: How do I find peaks in the data using the label?

I essentially need a "find peaks" algorithm for when the input data is n-dimensional. Specifically, in the latent space of my neural network I have have collected all the training data ...
Eoin Ó Coinnigh's user avatar
0 votes
0 answers
15 views

How (or can) you formulate the Fisher information matrix in terms of a loss function, specifically cross-entropy loss?

I recently saw the following formulation of the Fisher information matrix in a paper on Transformer pruning: $$ \mathcal{I} := \frac{1}{|D|} \sum_{(x,y) \in D} \left( \frac{\partial \mathcal{L}(x,y;1)}...
premed's user avatar
  • 1
1 vote
0 answers
55 views

In the figure of Stable Diffusion, when does the switch part change?

In the illustration of Stable Diffusion, there is a concatenation part through Cross-Attention. Why is there a switch in the concatenation part?
diffusion stable's user avatar
0 votes
1 answer
45 views

How to interpret Tom Mitchell's definition of machine learning?

I quote the well known definition: A computer program is said to learn from experience E with respect to some class of tasks T and some performance measure P, if its performance on T, as measured by ...
ado sar's user avatar
  • 150
-2 votes
2 answers
35 views

Can the multiclass classification be modified to binary classification for better accuracy [closed]

I've achieved good accuracy in binary classification problems, but I'm facing challenges when it comes to multi-class classification tasks. While tackling a natural language processing challenge ...
Raghul Azhagaiah's user avatar

1
2 3 4 5
46