Questions tagged [data-science]

Use for questions related to Data Science aspects of AI. Generally speaking, only basic Data Science questions should be asked on this Stack, ideally involving the fundamental concepts. For more advanced questions related to Data Science, please use the Data Science stack: https://datascience.stackexchange.com/

20 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
3 votes
0 answers
130 views

Speaker Identification / Recognition for less size audio files

I am working on speaker identification problem using GMM (Gaussian Mixture Model). I have to just identify one user present in the given audio, so for second class noise or silent audio may use or not ...
user avatar
  • 328
3 votes
1 answer
74 views

How to make a distinction between item feature and environment feature?

My data is stock data with features such as stocks' closing prices.I am curious to know if I can put the economy feature such as 'national interest rate' or 'unemployment rate' besides each stocks' ...
user avatar
2 votes
0 answers
99 views

Taking a machine learning model to production\deployment

I've designed a machine learning model for the predictive maintenance of machines. The data used for training and testing the ML model is the data from various sensors connected to various parts of ...
user avatar
2 votes
0 answers
70 views

Why do I get higher average dice accuracy for less data

I am working on image segmentation of MRI thigh images with deep learning (Unet). I noticed that I get a higher average dice accuracy over my predicted masks if I have less samples in the test data ...
user avatar
2 votes
0 answers
34 views

Possible approaches to dealing with unbalanced dataset and highly biased deep learning algorithm

I have an extremely unbalanced video dataset for a two class video classification problem.All my videos in my current video dataset is $40$ second long with $900p$ resolution.However the dataset is ...
user avatar
2 votes
0 answers
383 views

How do to mitigate or design out hidden feedback loops when designing ML systems?

Two months ago, I've found myself working on a churn detection problem which can be briefly described as follows: Assume the current date is N Use customer behavior for N-1,..N-x dates to develop ...
user avatar
  • 63
2 votes
0 answers
352 views

Deep NN architecture for predicting a matrix from two matrices

Recently my friend asked me a question: having two input matrices X and Y (each size NxD) where D >> N, and ground truth matrix Z of size DxD, what deep architecture shall I use to learn a deep model ...
user avatar
1 vote
0 answers
11 views

how to manage the impact of Covid on building a machine learning model

I need your suggestions for using historical data to build a machine learning model for analyzing the market and build an AI model(tree based model/random forest or regression analysis) for setting ...
user avatar
  • 111
1 vote
1 answer
29 views

LSTM exploding? - multiple parallel time series with multiple variables

I have the following situation: Stock Time_Stamps Feature_1 Feature_2 Feature_n Price Stock_1 2019 0.5 1.0 1.0 100 Stock_1 2020 0.7 1.3 0.9 90 Stock_2 2019 0.3 0.9 1.1 110 Stock_2 2020 0.2 0.8 1....
user avatar
1 vote
0 answers
68 views

Does the order of data augmentation and normalization matter?

What is the preferred order of data augmentation and normalization? Is it the former followed by the latter?
user avatar
1 vote
0 answers
45 views

Why is the accuracy of my model very low on a separate dataset from the training and test datasets?

I am working on stock price prediction project, I am using the support vector regression (SVR) model for it. As I am splitting my data into train and test, I am getting high accuracy while predicting ...
user avatar
1 vote
0 answers
60 views

Are there any general guidelines for dealing with imbalanced data through upsampling or downsampling?

Are there any general guidelines for dealing with imbalanced data through upsampling/downsampling? This Google developer guide suggests performing downsampling with upweighting, but for the most ...
user avatar
1 vote
0 answers
17 views

What are the best datasets available for music information retrieval?

I am interested in doing some work in classification problems in music information retrieval. I know that there are some formats of datasets (such as MIDI, Spectrogram, Piano-roll, MusicXML, etc.) for ...
user avatar
  • 111
1 vote
0 answers
24 views

Scikit-Learn: monotoneous quantile estimation

I would like to implement various AI-estimators for quantile estimation for a regression problem. It would be necessary to have non-crossing quantiles, that is larger quantiles would correspond to ...
user avatar
  • 11
1 vote
0 answers
15 views

Are hadoop ecosystem tools main goal is to break up large data sets into fast readable files?

I am new to big data theory, and during the past 3 days, I took an official big data course with some of the best instructors available in my country in this domain. The things was little bit obscure ...
user avatar
  • 131
0 votes
0 answers
4 views

How to identify pulse pattern in data

So I am using a pulse sensor which is giving out a certain data. When I place my finger on the sensor and see the data plotted in a graph it shows a varying (non-repetitive as no two pulses are ...
user avatar
  • 1
0 votes
0 answers
24 views

Neural Network learning XOR. I collected Data on my networks convergence. Is this expected behavior?

I build a neural network from scratch to get a better understanding of the fundamentals of machine learning. The network contains a bias for each neuron and calculates the final error via the mean ...
user avatar
  • 101
0 votes
0 answers
15 views

Deep learning to fill sequence elements missing at random

I have the following problem setup: There is a list of floats (between -1 and 1) that is about 768*2 in length. The values of the floats are features that depend on two documents, the first 768 ...
user avatar
0 votes
0 answers
19 views

Training the Model properly

I am relatively new to Machine Learning. I want to build a good stock price prediction neural network model and I am using features that depend on the price as well as features that do not depend on ...
user avatar
0 votes
1 answer
114 views

multi vs one prediction using Regression

I was trying to build a prediction system where I have the input data arranged in multiple columns. The input data would be of the type where I have weather, service type (bronze, silver, gold), size ...
user avatar