Questions tagged [books]
For questions related to books in the context of artificial intelligence. For example, if you're looking for a reference AI book, you may use this tag. If you want someone to clarify something in an AI book, you can use this tag.
55
questions
3
votes
1
answer
45
views
Clarification on why Deep Learning works from Goodfellow's book
I am reading the section 5.11.2 from the Deep Learning book where the authors explain Deep Learning can deal with high dimensionality data in contrast to classical machine learning algorithms. However,...
- 221
0
votes
1
answer
63
views
Book(s) recomendation for Probability Theory Foundations
I am in the process of learning ML and AI. I've been taking some courses, and I now understand the foundations of the big picture of Machine Learning. I've been using Pattern Recognition and Machine ...
0
votes
2
answers
167
views
Textbooks (or other sources) on deep reinforcement learning which explain theory along with good examples
I am looking for a textbook/other sources on deep reinforcement learning which explain theory along with good examples. I will be happy for suggestions.
- 973
1
vote
2
answers
114
views
Books that contains exclusively math problems/assignments in Deep Learning & Neural Networks
I am doing a Deep Learning Course.Suggest some books that contains exclusively math problems/assignments in Deep Learning & Neural Networks. I can understand that majority of the replies suggest &...
- 13
3
votes
1
answer
100
views
Are the Dot Product and Tensor Product the same thing in Machine Learning?
I'm currently reading "Deep Learning with Python, Second Edition" by François Chollet, and I need help understanding one thing.
Below paragraph was copied from the page 41
2.2.3 Tensor ...
- 133
0
votes
0
answers
21
views
Book suggestion about deploying real deep learning models in real world
Can you suggest books about deploying machine learning algorithms on robots, especially on real time stream? I don't know how to deal with latency and other challenges that real time inference/stream ...
- 882
0
votes
1
answer
58
views
Gradient: any resource on how to understand everything about it?
I have read some resources about AI, and they all speak about the gradient.
Is there any book focused on this? maybe with tons of images / diagrams?
Cheers
- 3
1
vote
0
answers
86
views
Where can I find the solutions to the problems in the book "An Introduction to Computational Learning Theory"?
I have been going through "An Introduction to Computational Learning Theory" (Kearns-Vazirani). I don't know if my solutions to the problems are correct and have no other way of checking my ...
- 111
3
votes
0
answers
206
views
Best calculus books for Deep Learning
Recommend some calculus books for Deep Learning and neural networks. I know what is integration, differentiation, derivates, limits on a based level. I would like to understand on deep level the ...
- 31
0
votes
1
answer
447
views
Machine Learning book for fundamentals - Simon Haykin vs. Christopher M. Bishop [closed]
Since I started studying Machine Learning, I was torn between two books in this area, and I could never decide which one is the best to follow.
The first book is widely used and known: Pattern ...
- 101
2
votes
1
answer
259
views
Mathematics books for reinforcement learning
This question is not about the math prerequisites of reinforcement learning, but about the textbooks of mathematics that are enough to understand the literature on reinforcement learning.
What are the ...
- 3,960
0
votes
2
answers
308
views
Concise and mathematically-oriented book on AI and neural networks suitable as a gift [closed]
I would like to buy a book about AI and neural networks written on accessible level for a 17 years old mathematically very gifted student interested in these topics. The book should contain some ...
- 67
1
vote
1
answer
128
views
Which formula of p(x, y) to use?
The probability distribution $p(x, y)$ can be calculated in two ways :
$p(x, y) = p(y \mid x) p(x)$
$p(x, y) = p(x \mid y) p(y)$
But according to the book Deep Generative Modeling (page number 3 ...
- 185
0
votes
0
answers
51
views
Does it make sense to compare images (samples) with words (features)?
Consider the following paragraphs from the introduction of the chapter named Recurrent Neural Networks from the textbook titled Dive into Deep Learning
So far we encountered two types of data: ...
- 3,960
2
votes
1
answer
154
views
Textbook for CNN-LSTM networks of predictions of numerical data
I am learning NN algorithms because I'd like to create my own project.
What I found on the internet, is that for my type of project which I have in mind CNN-LSTM neural network would be ideal.
But now ...
4
votes
1
answer
49
views
What do we mean by "orderly opinions" in this sentence in the context of Bayes theorem?
In this page, it's written (emphasis mine)
If probabilities are thought to describe orderly opinions, Bayes theorem describes how the opinions should be updated in the light of new information
What ...
- 41
1
vote
0
answers
71
views
Book/course recommendation on game theory application to multi-agent system (reinforcement learning)
Is there any great game theory book or course that discusses the application of game theory to modern reinforcement learning or multi-agent systems? Or a classic reference book that can help me get a ...
- 471
7
votes
3
answers
6k
views
What is the difference between the US and global edition of the AIMA book by Russell and Norvig?
The book Artificial Intelligence: A Modern Approach by Russell and Norvig has two editions: global and the US. It looks like these two are generally the same, but have some differences in the order of ...
- 215
0
votes
1
answer
1k
views
What are the Calculus books recommended for beginner to advanced researchers in artificial intelligence?
Calculus is a branch of mathematics that primarily deals with the rate of change of outputs of a function w.r.t the inputs.
It contains several concepts including limits, first-order derivatives, ...
- 3,960
2
votes
2
answers
250
views
Why does critical points and stationary points are used interchangeably?
Consider the following paragraph from Numerical Computation of the deep learning book.
When $f'(x) = 0$, the derivative provides no information about which
direction to move. Points where $f'(x)$ = 0 ...
- 3,960
1
vote
2
answers
28
views
Why not undefined expression is different from numerical underflow?
Consider an architecture or programming language that uses $n$ bits for storing a floating point number in a particular format. Then each and every floating point number it can store should be in a ...
- 3,960
1
vote
1
answer
784
views
What exactly is a grid-like topology according to the book Deep Learning?
I am reading this book called "Deep Learning" (by Goodfellow, Bengio and Courville).
On page 326, in the first paragraph, it says:
CNNs, are a specialized kind of neural network for ...
- 275
1
vote
1
answer
159
views
Is there an entry level textbook on Bayesian Inference that is a nice blend of theory and applications?
I am looking for a textbook that is a nice entry level to Bayesian Inference. I was hoping that there is a nice blend of theory and applications (data sets) on how concepts are applied. Programming ...
- 185
1
vote
2
answers
378
views
Are the held-out datasets used for testing, validation or both?
I came across a new term "held-out corpora" and I confused regarding its usage in the NLP domain
Consider the following three paragraphs from N-gram Language Models
#1: held-out corpora as a ...
- 3,960
3
votes
2
answers
306
views
Example of lemma having multiple boldface forms
Number of lemmas can be used as a rough measure for the number of words in a language. A lemma can have multiple word-form types. It can be understood from the following paragraph taken from p12 of ...
- 3,960
1
vote
0
answers
30
views
Why can't recurrent neural network handle large corpus for obtaining embeddings?
In order to learn the embeddings, we need to train a model based on some objective function. The model can be an RNN and the objective function can be the likelihood. We learn the embeddings by ...
- 3,960
2
votes
3
answers
192
views
Is there a recent book that covers the theoretical and philosophical aspects of artificial intelligence?
What are some recent books that introduce AI and neural networks while also discussing the related philosophical issues, like epistemology and whether AI is really thinking, etc.?
- 215
1
vote
1
answer
54
views
What are the 'noisy factors' leading to overfitting?
Consider the following excerpt from section 5.5 Regularization (p. 13) of this chapter Logistic Regression.
There is a problem with learning weights that make the model perfectly match the training ...
- 3,960
3
votes
2
answers
324
views
Why do we commonly use the $\log$ to squash frequencies?
Term frequency and inverse document frequency are well-known terms in information retrieval.
I am presenting the definitions for both from p:12,13 of Vector Semantics and Embeddings
On term frequency
...
- 3,960
0
votes
0
answers
291
views
Why Word2Vec is called a neural model if no neural network is used in it?
Word2Vec model does not use any neural network. It uses logistic regression only.
Consider the following paragraph from p:18 of Vector Semantics and Embeddings
We’ll see how to do neural ...
- 3,960
2
votes
1
answer
173
views
What is the meaning of "continuous" in a continuous bag-of-words model?
The word continuous in mathematics is a property of either a set or a function that says that the underlying object has no discontinuity in the range mentioned. If the object is a set, then $[-1,1]$ ...
- 3,960
0
votes
2
answers
784
views
What is the exact difference between distributional semantics and distributed semantics?
While studying word embeddings in natural language processing, I encountered the following statement on page 327 of the textbook Natural Language Processing by Jacob Eisenstein
Distributional ...
- 3,960
0
votes
2
answers
473
views
Book(s) for text embedding
Text here refers to either character or word or sentence.
Is there any recent textbook that encompasses from classical methods to the modern techniques for embedding texts?
If a single textbook is ...
- 3,960
4
votes
1
answer
294
views
How is the state-value function expressed as a product of sums?
The state-value function for a given policy $\pi$ is given by
$$\begin{align}
V^{\pi}(s) &=E_{\pi}\left\{r_{t+1}+\gamma r_{t+2}+\gamma^{2} r_{t+3}+\cdots \mid s_{t}=s\right\} \\
&=E_{\pi}\...
- 3,960
1
vote
1
answer
86
views
What is meant by "real-valued argument" in this context of the convolution operation?
Consider the following statement from Deep Learning book (p. 327, chapter 9: Convolutional Networks)
In its most general form, convolution is an operation on two functions
of a real-valued argument.
...
- 3,960
5
votes
1
answer
519
views
What does "statistical efficiency" mean in this context?
Consider the following statement(s) from Deep Learning book (p. 333, chapter 9: Convolutional Networks) by Ian Goodfellow et al.
Convolution is thus dramatically more efficient than dense matrix
...
- 3,960
1
vote
1
answer
135
views
Is there any comprehensive book that reviews topics in the area of brain-inspired computing?
I am looking to write my master's thesis next year about brain-inspired computing. Hence, I am looking to get a good overview of this domain.
Do you know of any comprehensive book that reviews topics ...
2
votes
1
answer
84
views
In Probabilistic Graphical Model (written by Daphne Koller), what's the meaning of "parameter" in representation of the distribution?
I just started to read the PGM book written by Daphne Koller.
In the chapter of Bayesian Network Representation(Chapter 3), there are some descriptions about the standard parameterization of the joint ...
- 21
13
votes
2
answers
8k
views
What are other examples of theoretical machine learning books?
I am looking for a book about machine learning that would suit my physics background. I am more or less familiar with classical and complex analysis, theory of probability, сcalculus of variations, ...
- 133
4
votes
3
answers
832
views
What introductory books to reinforcement learning do you know, and how do they approach this topic?
Currently, I'm only going through these two books
Reinforcement Learning: An Introduction, by Sutton and Barto: RL explained on an engineering level (mathematical, but readable for a non-...
- 392
1
vote
0
answers
30
views
Are there any good resources (preferably books) about techniques used for entity extraction?
Given some natural language sentences like
I would like to talk to Mr. Smith
I would like to extract entities, like the person "Smith".
I know that frameworks, which are capable of doing ...
- 61
10
votes
1
answer
3k
views
What are some resources on computational learning theory?
Pretty soon I will be finishing up Understanding Machine Learning: From Theory to Algorithms by Shai Ben-David and Shai Shalev-Shwartz. I absolutely love the subject and want to learn more, the only ...
- 258
1
vote
4
answers
167
views
What are examples of books or papers on the details of convolutional neural networks?
I'm studying a master's degree and my final work is going to be about the convolutional neural network.
I read a lot of books and I did Convolutional Network Standford's course, but I need more.
Are ...
- 493
4
votes
1
answer
223
views
Which books or papers clearly explain the relation between Ising models and deep neural networks?
I am looking for a book or paper which clearly explains the relationship between Ising models and deep neural networks.
Can anyone provide any references?
- 151
5
votes
1
answer
447
views
Which part of "Perceptrons: An Introduction to Computational Geometry" tells that a perceptron cannot solve the XOR problem?
In the book "Perceptrons: An Introduction to Computational Geometry" by Minsky and Papert (1969), which part of this book tells that a single-layer perceptron could not solve the XOR problem?
I have ...
- 51
5
votes
2
answers
235
views
Which linear algebra book should I read to understand vectorized operations?
I am reading Goodfellow's book about neural networks, but I am stuck in the mathematical calculus of the back-propagation algorithm. I understood the principle, and some Youtube videos explaining this ...
- 151
2
votes
1
answer
128
views
What are some books/papers that deal with fundamental and philosophical issues of ML and relate it to the global discourse of AIs?
In my experience, most of the time, when people talk about AI nowadays they mostly mean machine learning. Despite this, ML is usually seen as a mere technique to build high-performance software.
I ...
- 759
2
votes
1
answer
51
views
What does the notation $[m]=\{1, \ldots, m\}$ mean in the equation of the empirical error?
The empirical error equation given in the book Understanding Machine Learning: From Theory to Algorithms is
My intuition for this equation is: total wrong predictions divided by the total number of ...
- 33
3
votes
0
answers
256
views
What are examples of good reference books on unsupervised learning?
I am looking for good introductory and advanced books on unsupervised learning. I have already read books like Probabilistic Graphical Models from D. Kholler and Pattern Recognition and Machine ...
- 31
3
votes
2
answers
426
views
What are some books or state of the art papers about the development of a strong-AI?
I am looking for books or to state of the art papers about current the development trends for a strong-AI.
Please, do not include opinions about the books, just refer the book with a brief ...
- 1,293