16

Artificial Intelligence is a very broad field and it covers many and very deep areas of computer science, mathematics, hardware design and even biology and psychology. As for the math: I think calculus, statistics and optimization are the most important topics, but learning as much math as you can won't hurt. There are many good free introductory resources ...


16

Dennis Soemers' answer is correct: you should use a HashSet or a similar structure to keep track of visited states in BFS Graph Search. However, it doesn't quite answer your question. You're right, that in the worst case, BFS will then require you to store 16! nodes. Even though the insertion and check times in the set will be O(1), you'll still need an ...


10

To excel in in AI you need a mathematical intuition or point of view. In order to become a full stack AI engineer, it is important that you have a firm understanding of the mathematical foundations of machine learning. My advice to anyone preparing to jump into the field is that learning mathematics is about doing. Remember the 20/80 rule. You need to ...


10

Start with Andrew Ng's introduction to Machine Learning course on Coursera. There are not many prerequisites for that course, but you will learn how to make some useful things. And, more importantly, it will clearly show you which subjects you need to learn next.


10

A neuron is said activated when its output is more than a threshold, generally 0. For examples : \begin{equation} y = Relu(a) > 0 \end{equation} when \begin{equation} a = w^Tx+b > 0 \end{equation} Same goes for sigmoid or other activation functions.


8

You can use a set (in the mathematical sense of the word, i.e. a collection that cannot contain duplicates) to store states that you have already seen. The operations you'll need to be able to perform on this are: inserting elements testing if elements are already in there Pretty much every programming language should already have support for a data ...


7

Supervised learning is typically an attempt to learn a mathematical function, $f(\bf X)=\bf y$. For this, you need both the input vector $\bf X$ and the output vector $\bf y$. The model outputs have whatever dimensionality that the target values have. Unsupervised learning models instead learn a structure from the data. A clustering model, for example, is ...


7

While the answers given are generally true, a BFS in the 15-puzzle is not only quite feasible, it was done in 2005! The paper that describes the approach can be found here: http://www.aaai.org/Papers/AAAI/2005/AAAI05-219.pdf A few key points: In order to do this, external memory was required - that is the BFS used the hard drive for storage instead of RAM....


6

You'll find that both Calculus and Linear Algebra have some application in AI/ML techniques. In many senses, you can argue that most of ML reduces to Linear Algebra, and Calculus is used in, eg. the backpropagation algorithm for training neural networks. You'd be well served to take a class or two in probability and statistics as well. Programming ...


6

Backpropagation is a subroutine often used when training Artificial Neural Networks with a Gradient Descent learning algorithm. Gradient Descent requires computation of the error gradient, i.e. derivatives, of a cost function with respect to the network parameters. BP allows you to find this gradient a lot faster than using naive methods. Reinforcement ...


5

This is fairly boilerplate advice, but, since you're brand new to AI, I'd personally suggest writing a classical Tic-Tac-Toe AI, ideally using minimax. I suggest this because minimax is fundamental to AI, and there are many webpages devoted to this subject, such as How to make your Tic Tac Toe game unbeatable by using the minimax algorithm and Tic Tac Toe: ...


5

When I got interested in AI, I started with the most basic things. My very first book was Russell&Norvig's Artificial Intelligence- A modern Approach. I think that's a good place to start, even if you're mostly interested in Deep Nets. It treats not just the basic AI concepts and algorithms (expert systems, depth-first and breadth-first search,knowledge ...


5

AI is quite large in scope and it sits at the intersection of several areas. However, there are a few essential fields or topics that you need to know Set theory Logic Linear algebra Calculus Probability and statistics I would recommend you to first explore the AI algorithms that you might be interested in. I advise you to start with machine learning and ...


5

Well, you are definitely mixing two different things. Here are those bits: The function that deep learning approximates is basically a function that best fits the INPUT DATA points. You should not think about its differentiability or optimization aspects. We don't care what type of function it is; we just want the best fit of input data (ofcourse ...


5

As it can be easily pointed out that true random numbers cannot be generated fully by programming and some random seed is required. This is true. In fact, it is impossible to solve using software. No software-only technique can generate randomness without an initial random seed or support from hardware. This is also true for AI software. No AI design that ...


5

Using a machine learning or AI-powered model once it has been built and tested, is not directly an AI issue, it is just a development issue. As such, you won't find many machine learning tutorials that focus on this part of the work. But they do exist. In essence it is the same as integrating any other function, which might be in a third-party library: ...


4

Here are some resources I have found useful to get to know the basics of AI Andrew Ng's lecture series on AI Andrew Ng's lecture at the Stanford Business School Andrew Ng - The State of Artificial Intelligence Andrew Ng is a visiting professor at Stanford, founder of Coursera and currently the head of research at Alibaba. The above videos should give you (...


4

The current, cutting edge AI methods all heavily rely on statistical modeling. You might want to browse the Data Science and Cross Validated stacks to see what people are doing, and the types of maths they are using. (This is not really my field, so I'll leave it to the Neural Network and Deep Learning crowd to provide more detail here.) I'd also strongly ...


4

I would suggest you to start with Andrew Ng's Machine Learning course on Coursera. He provides the brief introduction to mathematics necessary for machine learning. Though not complete, it will be enough to cruise through the course. Next carefully learn logistic regression in the course. The sigmoid function will be widely used in neural networks. In the ...


4

In your question you didn’t specify the type of pooling that you aren’t doing. So it’s possible that you could have, for example a mean pool followed by a max or min pool. What this could do is combine the idea of reducing dimensionality of your data from a holistic perspective with the mean pool and then choosing the best of your averages with your max ...


4

The term "activated" is mostly used when talking about activation functions which only outputs a value (except 0) when the input to the activation function is greater than a certain treshold. Especially when discussing ReLU the term "activated" may be used. ReLU will be "activated" when it's output is greater than 0, which is also when it's input is greater ...


4

In many cases, a production-ready model has everything it needs to make predictions without retaining training data. For example: a linear model might only need the coefficients, a decision tree just needs rules/splits, and a neural network needs architecture and weights. The training data isn't required as all the information needed to make a prediction is ...


4

What you have could be well described as a Task Allocation problem, which is studied as part of the planning subfield of AI. Chapters 10 & 11 of Russell & Norvig provide a good overview of this area, although I think they don't talk too much about Task Allocation in particular. There are two basic approaches to this problem: centralized approaches, ...


4

The term you are looking for is stylometry, which is related to a technique in forensic linguistics called writeprint analysis. There are many different techniques to perform stylometric analysis, from the very basic 5-feature analysis classifying features such as the lexicon and idiosyncrasies unique to a person to more complex analysis utilizing neural ...


4

It's correct that knowledge based Expert systems have fallen out of fashion. They were intensive researched in the 1970s and 1980s. The new, more exciting topic, is called data-driven and machine learning approach. This kind of turnaround can be traced back in the literature. Since the 1990s lots of papers were created about data-mining and only a few ...


4

Trying to address all the questions asked in the end in the same order Most definitely possible. I would say its best you approach this with segmentation to start with. Just use a free GPU runtime notebook service such as Google Colab or Kaggle Kernels. But you would not directly be able to integrate with the device, you'd have to keep moving input and ...


3

Before getting into Artificial Intelligence, one should be done with the prerequisites. There is not a solid list, but a good knowledge of various algorithms is compulsory. Apart from that you should be comfortable with at least one programming language, like C++ or Java. I won’t suggest you to dive into Artificial Intelligence if you are completely new to ...


3

To start AI first of all understand what is AI. Why MNIST's accuracy increase rapidly after 2012. Why machine learning need AI to increase its accuracy. To start and build Application on Machine learning with AI you didn't need maths or some kind of rocket science. You are late my bro people build shortcuts for all machine learning problems like a wrapper....


3

What you need is a tutorial. You need somewhere to start, and a goal. There are a ton of libraries out there, with a variety of supported languages. What matters the most is what you plan to do with your AI. Here are a few examples: JS: Synaptic.js tensorfire (not currently released, looks like it will be good) deeplearn.js Python: Keras CNTK Theano ...


3

On the first hand, it may look surprising that Lisp and Prolog are used even today. Lisp is usually known in the context of Lisp-machines which are outdated since the 1980s, and from a technical point of view, all the functionality can be emulated with C++. But, in many AI projects from the 2010s, Lisp and Prolog are used for planning and high-level tasks, ...


Only top voted, non community-wiki answers of a minimum length are eligible