Questions tagged [machine-learning]

For questions related to machine learning (ML), which is a set of methods that can automatically detect patterns in data, and then use the uncovered patterns to predict future data, or to perform other kinds of decision making under uncertainty (such as planning how to collect more data). ML is usually divided into supervised, unsupervised and reinforcement learning. Deep learning is a subfield of ML that uses deep artificial neural networks.

Filter by
Sorted by
Tagged with
2
votes
1answer
27 views

Is there a way of deriving a loss function given the neural network and training data?

There is some sort of art to using the right loss function. However, I was wondering if there is a way to derive the loss function if I gave you a neural network model (the weights) as well as the ...
0
votes
0answers
15 views

VAE generates bad images. due to unbalanced loss functions? [closed]

I'm training a variational autoencoder on CelebA dataset using TensorFlow.keras The problem I'm facing is that the generated images are not diverse enough and look kinda bad. example: What I think:...
1
vote
0answers
8 views

Training Conditional DCGAN with GAN-CLS loss

I am trying to implement conditional GAN using GAN-CLS loss as described in paper: https://arxiv.org/abs/1605.05396 So, while training discriminator, I should I have three batches of data: [...
1
vote
1answer
19 views

How could a NN be trained to output a cyclic (e.g. hue) number?

I was thinking about training a neural network to colourize images. The input would be the luminosity/value for each pixel, and the output would be a hue and/or saturation. Training data would be ...
1
vote
0answers
24 views

Why do we use a delay when feeding our input data to the echo state network?

I'm new to working with neural networks and have recently began implementing neural networks for time series forecasting in some of my work. I've been particularly using Echo State Networks and have ...
1
vote
0answers
31 views

Is it possible to create a fair machine learning system?

Started thinking about fairness of machine learning models recently. Wiki page for Fairness_(machine_learning) defines fairness as: In machine learning, a given algorithm is said to be fair, or to ...
0
votes
0answers
19 views

Regularization to enforce feature learning

Is there any research into ways to enforce feature selection across classes by network structure? Given the number of parameters in NN, even convnets are prone to over fitting. I'm curious if there ...
0
votes
0answers
19 views

Why is the accuracy of my model very low on a separate dataset from the training and test datasets?

I am working on stock price prediction project, I am using the support vector regression (SVR) model for it. As I am splitting my data into train and test, I am getting high accuracy while predicting ...
0
votes
0answers
10 views

How to make a multivariate forecasting if one of features becomes known for the future with some confidence level, e.g. weather forecast data

Let's assume that we make forecasting of another metric partially based on forecasts of the weather forecast, e.g. of temperature, pressure, then we can potentially obtain those forecasts from one of ...
0
votes
0answers
7 views

Training a model for text document transformation?

I have a bunch of text documents, split into source documents and transformed documents. These text documents have multiple lines and are edited at specific locations, in a specific way. I make use ...
0
votes
0answers
6 views

VAE generates blue images [migrated]

I'm trying to train a VAE to generates celebA faces. the problem I'm facing is that the model only generates blue faces and I'm not sure why and how to fix it. The encoder: ...
1
vote
1answer
60 views

Can deep reinforcement learning algorithms be deterministic in their reproducibility in results?

I ran a deep q learning algorithm (DQN) for $x$ number of epochs and got policy $\pi_1$. I reran the same script for the same $x$ number of epochs and got policy $\pi_2$. I expected $\pi_1 $ and $\...
1
vote
0answers
44 views

How do I set up rewards to account for unmanned aerial vehicle crashes?

I am working on a project to implement a collision avoidance algorithm on a real unmanned aerial vehicle (UAV). I'm interested in understanding the process to set up a negative reward to account for ...
2
votes
0answers
8 views

How can Cat Swarm Algorithm (CSO) used for feature selection?

Cat swarm optimization (CSO) is a novel metaheuristic for evolutionary optimization algorithms based on swarm intelligence which proposed in 2006. See Feature Selection of Support Vector Machine Based ...
1
vote
0answers
22 views

If the output of a model is a ridge function, what should the activation functions at all the nodes be?

I have the following assignment. I can't understand the b part of this question in my assignment. I have completed the 1st part and understand the maths behind it, but the 2nd part has me stumped. I ...
1
vote
0answers
24 views

Applications of polar decomposition in Machine Learning

Assume there exists a new and very efficient algorithm for calculating the polar decomposition of a matrix $A=UP$, where $U$ is a unitary matrix and $P$ is a positive-semidefinite Hermitian matrix. ...
1
vote
0answers
23 views

How estimate the minimum size of an autoencoder to overfit the training data?

Given e.g. $1$M vectors of $1000$ floating points each, where every point in vectors is sampled from a uniform distribution between $-1$ to $1$, how to estimate the minimum network size required ...
1
vote
1answer
31 views

Is it possible to have the latent vector of an auto-encoder with size 1?

Given e.g. 1M vectors of $1000$ floating points each, where every point in vectors is sampled from a uniform distribution between $-1$ to $1$: Is it possible to have the bottleneck of the AE network ...
3
votes
1answer
31 views

If agent chooses an action that the environment can't operate, how should I handle this situation?

I'm building a really simple experiment, letting an agent move from the bottom-left corner to the upper-right corner on a 3x3 squared paper. I plan to use DQN to do this. I'm having trouble handling ...
1
vote
0answers
41 views

What are the differences and advantages of TensorFlow and Octave for machine learning? [migrated]

I have been exploring the different libraries and languages you can use in order to implement machine learning. During this, I have stumbled upon a library TensorFlow and Octave(a high-level ...
1
vote
1answer
39 views

Why does this multiplication of $Q$ and $K$ have a variance of $d_k$, in scaled dot product attention?

In scaled dot product attention, we scale our outputs by dividing the dot product by the square root of the dimensionality of the matrix: The reason why is stated that this constrains the ...
2
votes
0answers
14 views

How to feed key-value features (aggregated data) to LSTM?

I have the following time-series aggregated input for an LSTM-based model: ...
3
votes
1answer
83 views

What is the difference between deep learning and shallow learning?

What is the difference between deep learning and shallow learning? What I am interested in knowing is not the definition of deep learning & shallow learning, but understanding the actual ...
3
votes
3answers
62 views

What are some use cases of few-shot learning?

Besides computer vision and image classification, what other use cases/applications are for few-shot learning?
3
votes
0answers
32 views

Which machine learning method can take a matrix as input?

I am pretty new to the machine learning field. I want to use an $n \times m$ matrix as the input of a model, in order to predict a vector $1 \times m$, both of real numbers. Input data are quite clean,...
0
votes
1answer
72 views

Is my understanding of how AI works correct?

In my discussion over my question on Math SE, I explained to a user, how I think AI works, I wrote that with the sigmoid(logistic) function, features of a data set are identified, many such iterations ...
3
votes
1answer
83 views

How to fill missing values in a dataset where some properties can be inputs and outputs?

I have a dataset with missing values, I would like to use machine learning methods to fill. In more detail, there are $n$ individuals, for which up to 10 properties are provided, all numerical. The ...
6
votes
2answers
58 views

Where to publish replications of machine learning papers?

If I replicated the results of a machine learning paper, is there a website that I can publish my code to that collects informal replication attempts? https://paperswithcode.com/ allows anyone to ...
2
votes
0answers
20 views

Is there an online RL algorithm that receives as input a camera frame and produces an action as output?

I want to build a reinforcement learning model, which takes a camera picture as input, that learns online (in terms of machine learning). Based on the position of an object on the camera, I want the ...
2
votes
0answers
9 views

Why is ANFIS important in general?

I am actually working with the iris dataset from sklearn and try to understand the ANFIS-Package for python. But that does not really matter! I have a more general question. During thinking about ...
2
votes
0answers
9 views

What is the difference between fuzzy neural networks and adaptive neuro fuzzy inference systems?

I have, like you see, just a general question about the combination of fuzziness and neural networks. I understood it as follows Fuzzy neural networks as a hybrid system: the neural network helps me ...
1
vote
1answer
32 views

Are my steps correct for a proper classification of a sick brain?

I have a dataset with MRI of patients with a specific disease that affects the brain and another dataset with MRI of healthy patients. I want to create a classifier (using neural networks) to ...
2
votes
1answer
30 views

Is the test time the phase when the model's accuracy is calculated with test data set?

When papers talk about the "test time", does this mean the phase when the model is passed with new data instances to derive the accuracy of the test data set? Or is "test time" the phase when the ...
3
votes
1answer
23 views

What should the dimension of the input be for text summarization?

I am trying to build a model for extractive text summarization using keras sequential layers. I am having a hard time trying to understand how to input my x data. Should it be an array of documents ...
2
votes
0answers
34 views

How to calculate the data noise variance for a prediction interval?

I have a neural network that connects $N$ input variables to $M$ output variables (qoi). By default, neural networks just give out point estimations. Now, I want to plot some of the quantity of ...
0
votes
0answers
18 views

Do we scale our target feature in regression problems?

I know this is a basic problem, but still could not find answer, I feel like most books/tutorials avoid talking about scaling the output feature instead they just mention scaling input features. So ...
0
votes
1answer
13 views

What are non-held-out data or non-held-out classes?

I'm Spanish and I don't understand the meaning of "non-held-out". I have tried Google Translator and online dictionaries like Longman but I can't find a suitable translation for this term. You can ...
1
vote
1answer
22 views

Random value generator using a single neuron or DNN

AI is supposed to do anything human or traditional computer can do, that is what we expect AI to be. So 'generating random value' is also a task included in the scope that AI should be able to do I'...
1
vote
0answers
25 views

What's the meaning of the Jaccard decay and the Jaccard recall? [closed]

I know the meaning of the Jaccard index, but when it comes to Jaccard decay and Jaccard recall I cannot see the difference or the meaning of it.
2
votes
0answers
28 views

Which activation functions should I use for polynomial regression?

I am a beginner in machine learning and neural networks. I have only used neural networks for classification problems. My aim is to modify it so that it can work for polynomial regression as well. In ...
2
votes
1answer
53 views

Should Monte Carlo tree search be able to consistently beat me in the connect four game?

I've implemented the Monte Carlo tree search (MCTS) algorithm for a connect four game I've built. The MCTS agent beats a random choice agent 90-100% of the time, but I’m still able to beat it pretty ...
3
votes
1answer
77 views

What are the differences between artificial neural networks and other function approximators?

Modern artificial neural networks use a lot more functions than just the classic sigmoid, to the point I'm having a hard time really seeing what classifies something as a "neural network" over other ...
1
vote
0answers
15 views

3d representation of a regression with two independent variables one of them is categorical and another is continuous

I have hopefully a fundamental question of Do I understand things right. (Thank you in advance and sorry for my English which might be not so good) 1-Preambula 1: I know that if we have 2 independent ...
0
votes
0answers
16 views

Are there any general guidelines for dealing with imbalanced data through upsampling or downsampling?

Are there any general guidelines for dealing with imbalanced data through upsampling/downsampling? This Google developer guide suggests performing downsampling with upweighting, but for the most ...
2
votes
1answer
32 views

Is there any research on models that provide uncertainty estimation?

Is there any research on machine learning models that provide uncertainty estimation? If I train a denoising autoencoder on words and put through a noised word, I'd like it to return a certainty that ...
2
votes
0answers
21 views

Can operations like convolution and pooling be discovered with a neural architecture search approach?

From Neural Architecture Search: A Survey, first published in 2018: Moreover, common search spaces are also based on predefined building blocks, such as different kinds of convolutions and ...
1
vote
0answers
43 views

MNIST Classification code performing with 88%-90% whereas other codes online perform 95% on first epoch

I have been trying to write code to implement plain neural net without convolution from scratch. I took some help online here and added my code to my github account. I don't understand why the ...
1
vote
0answers
16 views

What if the rewards induced by an environment are related to the policy too?

Assume we have a policy $\pi_{\theta}$ in a classic reinforcement learning setting, and a reward function $R^{\pi}(s,a)$ that changes as long as $\pi$ changes i.e. not only is it predefined by the ...
0
votes
0answers
10 views

Why do code implementations average the loss over a batch instead of finding the expected sample of that batch (using sampling probabilities)

Usually, our training objective over a batch is written in terms of the expected value of a sample in that batch such as $objective = E_{x \sim data} * log(P(x))$ But in the code implementations, ...
2
votes
1answer
28 views

Should I compute the gradients with respect to the flatten layer in a convolutional neural network?

I'm trying to create a convolutional neural network without frameworks (such as PyTorch, TensorFlow, Keras, and so on) with Python. Here's a description of CNN taken from the Wikipedia article In ...

1
2 3 4 5
30