# Questions tagged [statistical-ai]

For questions about the applications/clarifications/intuitions/proofs behind the use of statistical methods in AI/ML programs.

53 questions
Filter by
Sorted by
Tagged with
1 vote
73 views

### What is the difference between q and p in Statistical Notation(used in VAE)?

I'm looking at general visuals of Variational Autoencoders and I'm seeing that the encoder is typically expressed as q(z|x) with phi as a subscript while the decoder is p(x|z) with theta as a ...
1 vote
27 views

### How can we construct a skewed noise distribution using the maximum likelihood approach?

When the probability of observing a large positive error is larger than the probability of observing a large negative error in binary classification, how can this be modelled by a skewed noise ...
74 views

### Loss function of logistic Regression Geometric

In linear Regression, I train the Model so the Graph runs best through the Data Points, so the geometric distance between f(x) and y^i is minimized. Now is it correct that in logistic Regression I do ...
36 views

### Must dataset strictly come from marginal distribution in VAE?

My question is what if the population of the dataset is another marginal distribution, but whose support covers the original marginal distribution $p(\mathbf{x})$, can we use VAE to infer this target ...
31 views

### Plotting gradient over weights ratio, mean or std dev to synthetize tensors?

I was studying the lecture of Andrej Karpathy about "Activations, Gradients and BatchNorm" that he uploaded on youtube: link here. At chapter "viz #4: update:data ratio over time" ...
64 views

### Did old-fashioned, rule-based systems die out when statistical learning broke through into NLP?

It is not quite clear to me whether the statistical approach superseded the rule-based system in the 90s. McMahon and Smith (1998) report that many other researchers used "hybrids of statistical ...
102 views

### The Small Set Expansion Hypothesis, this problem was solved or is open problem yet?

I found this problem by article called "Ten Lectures and Forty-Two Open Problems in the Mathematics of Data Science" published at 2016. I`m looking for an open problem at Data Science or/and ...
44 views

### What does it mean by "dynamics of a sequence" mathematically?

Consider the following paragraph from the topic named sequential models from the textbook titled Dive into Deep Learning Both cases raise the obvious question of how to generate training data. One ...
204 views

### Is logic AI a complement to learning AI?

I want to know the relation between logic AI and learning AI. Logic AI here refers to the branch of AI that is based on mathematical logic. Learning AI refers to the branch of AI that is based on ...
112 views

### Machine learning with raw data alone / or raw data with its statistics

My question is very general and it does not originate from a specific problem. Let's assume that, through experience, we have learned that some statistical property of a set of data is important in ...
1 vote
274 views

### Can I treat "experience" in reinforcement learning as "training data" in statistical learning?

Statistics is a branch of mathematics that extracts useful information from data. The data is generally called as "training data" in statistical (machine) learning. Consider the following ...
1 vote
30 views

4k views

### Is Nassim Taleb right about AI not being able to accurately predict certain types of distributions?

So Taleb has two heuristics to generally describe data distributions. One is Mediocristan, which basically means things that are on a Gaussian distribution such as height and/or weight of people. The ...
1k views

### Why do we need Upsampling and Downsampling in Progressive Growing of Gans

I was working recently on Progressive Growing of GANs (aka PGGANs). I have implemented the whole architecture, but the problem that was ticking my mind is that in simple GANs, like DCGAN, PIX2PIX, we ...
1 vote
91 views

### Confidence interval around a DNN prediction

I am facing a problem and do not know whether it is even solvable: I want to predict the behaviour of a system using a DNN, say a CNN, in the sense that I want to predict the time and intensity of a ...
66 views

### How important will statistical learning be to a conscious AI?

Deep learning is based on getting a large number of samples and essentially making statistical deductions and outputting probabilities. On the other hand, we have formal programming languages, like ...
109 views

### Finding the right questions to increase accuracy in classification

Lets say I have a list of 100k medical cases from my hospital, each row = patient with symptoms (such as fever , funny smell, pain etc.. ) and my labels are medical conditions such as Head trauma, ...
422 views

### Are standard deviation, variance, skew good features for ML?

Pretty simple question here: Is it useful to use the standard deviation, skew, kurtosis, or any other extrapolatory stats as features, and if so in which problem sets? In this case, I am talking ...
97 views

### Is there a way of computing a prominence score based on the prevalence of features in an image?

Is there any previous work on computing some sort of prominence score based on the prevalence of features in an image? For example, let's say I am classifying images based on whether or not they have ...