We’re rewarding the question askers & reputations are being recalculated! Read more.

Questions tagged [data-science]

Use for questions related to Data Science aspects of AI. Generally speaking, only basic Data Science questions should be asked on this Stack, ideally involving the fundamental concepts. For more advanced questions related to Data Science, please use the Data Science stack: https://datascience.stackexchange.com/

12 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
4
votes
1answer
69 views

Psychological models at Facebook et al

As a layman in AI I want to get an idea how big data players like Facebook model individuals (of which they have so many data). There are two scenarios I can imagine: Neural networks build clusters ...
4
votes
1answer
76 views

How to deal with small amount of labeled samples?

I'm trying to develop skill to deal with very small amount of labeled samples (250 labeled/20000 total, 200 features) practicing on Kaggle "Don't Overfit" dataset (Traget_Practice have provided all 20,...
2
votes
1answer
41 views

How to make a distinction between item feature and environment feature?

My data is stock data with features such as stocks' closing prices.I am curious to know if I can put the economy feature such as 'national interest rate' or 'unemployment rate' besides each stocks' ...
2
votes
0answers
69 views

An idea I had to create the first Humanoid using Deep Learning

I've come up with an idea on how we could use a combination of Deep Learning and body sensors to create a walking talking living humanoid. Here goes: First, we will recruit 1 billion people and have ...
2
votes
0answers
183 views

How do to mitigate or design out hidden feedback loops when designing ML systems?

Two months ago, I've found myself working on a churn detection problem which can be briefly described as follows: Assume the current date is N Use customer behavior for N-1,..N-x dates to develop ...
2
votes
0answers
97 views

Performance Evaluation Metrics used in Training, Validation and Testing

Which specific performance evaluation metrics are used in training, validation and testing and why? I am thinking error metrics (RMSE, MAE, MSE) are used in validation, and testing should use a wide ...
2
votes
0answers
159 views

Deep NN architecture for predicting a matrix from two matrices

Recently my friend asked me a question: having two input matrices X and Y (each size NxD) where D >> N, and ground truth matrix Z of size DxD, what deep architecture shall I use to learn a deep model ...
1
vote
0answers
9 views

Are hadoop ecosystem tools main goal is to break up large data sets into fast readable files?

I am new to big data theory, and during the past 3 days, I took an official big data course with some of the best instructors available in my country in this domain. The things was little bit obscure ...
0
votes
0answers
11 views

Scikit-Learn: monotoneous quantile estimation

I would like to implement various AI-estimators for quantile estimation for a regression problem. It would be necessary to have non-crossing quantiles, that is larger quantiles would correspond to ...
0
votes
0answers
2 views

How to improve the AUC - test of LightBoost based on BayesSearchCv

I need to use LightGBM for improve the auc score of my binary classification algorithm. I have used BayesSearchCv with score:"roc-auc" but i dont know how can i make it able to search the best ...
0
votes
0answers
31 views

Mimicking certain human functions

Is it a common practice to do 3-dimensional imagary data acquisition and implementing the dataset to certain high resolution motor driven humanoid candidates to mimic the human micro expressions or ...
0
votes
1answer
68 views

multi vs one prediction using Regression

I was trying to build a prediction system where I have the input data arranged in multiple columns. The input data would be of the type where I have weather, service type (bronze, silver, gold), size(...