Questions tagged [definitions]

For questions about the definition of terms used in artificial intelligence research and development, including the definition of intelligence, algorithms, jargon, principles, methodologies, mathematical terms, concepts, topologies, architectures, designs, jargon, and AI domains such as robotics, network training, or automated vehicles.

Filter by
Sorted by
Tagged with
2
votes
1answer
40 views

What is Federated Learning?

How would you explain Federated Learning in simple layman terms for a non-STEM person? What are the main ideas behind Federated Learning?
1
vote
1answer
45 views

What is the definition of the hinge loss function?

I came across the hinge loss function for training a neural network model, but I did not know the analytical form for the same. I can write the mean squared error loss function (which is more often ...
8
votes
3answers
1k views

What are the differences between an agent and a model?

In the context of Artificial Intelligence, sometimes people use the word "agent" and sometimes use the word "model" to refer to the output of the whole "AI-process". For ...
0
votes
1answer
60 views

Can AI be understood as a generalized statistics tool? [duplicate]

I am a (soon-to-become, to be honest) theoretical physicist. I want to learn a bit about AI. So as you know in physics we develop theories based on as few and as simple basic equations as possible ...
1
vote
0answers
26 views

What is the definition of pre-training?

I want to pre-train a model (combined by two popular modules A and B, and both are large blocks), then fine-tune it on downstream tasks. What if for the weight initialization for pre-training, module ...
2
votes
1answer
59 views

What are support values in a support vector machine?

I started reading up on SVM and very little is defined of what are support values. I reckon it's they are denoted as $\alpha$ in most formulations.
3
votes
1answer
62 views

In the machine learning literature, what does it mean to say that something is “embedded” in some space?

In the machine learning literature, I often see it said that something is "embedded" in some space. For instance, that something is "embedded" in feature space, or that our data ...
4
votes
4answers
458 views

What is the fundamental difference between an ML model and a function?

A model can be roughly defined as any design that is able to solve an ML task. Examples of models are the neural network, decision tree, Markov network, etc. A function can be defined as a set of ...
5
votes
2answers
151 views

What is the Bellman Equation actually telling?

What does the Bellman equation actually say? And are there many flavours of that? I get a little confused when I look for the Bellman equation, because I feel like people are telling slightly ...
2
votes
1answer
31 views

Why is it useful to define the return as the sum of the rewards from time $t$ onward rather than up to $t$?

Why is it useful to define the return as the sum of the rewards from time $t$ onward rather than up to $t$? The return for an MDP is usually defined as $$G_t=R_{t+1}+R_{t+2}+ \dots +R_T$$ Why is this ...
1
vote
1answer
54 views

Is it okay to think of any dataset in artificial intelligence as a mathematical set?

A dataset is a collection of data points. It is known that the data points in the dataset can repeat. And the repetition does matter for building AI models. So, why does the word dataset contain the ...
4
votes
1answer
82 views

Is case-based reasoning a machine learning technique?

A few years ago when I was in university, I had implemented (for my final year project) an Itinerary Planning System, which incorporates an AI technique called "case-based reasoning". Is ...
2
votes
0answers
35 views

What exactly does meta-learning in reinforcement learning setting mean?

We can use DDPG to train agents to stack objects. And stacking objects can be viewed as first grasping followed by pick and place. In this context, how does meta-reinforcement learning fit? Does it ...
2
votes
0answers
48 views

What is the return-to-go in reinforcement learning?

In reinforcement learning, the return is defined as some function of the rewards. For example, you can have the discounted return, where you multiply the rewards received at later time steps by ...
2
votes
1answer
62 views

What's the difference between estimation and approximation error?

I'm unable to find online, or understand from context - the difference between estimation error and approximation error in the context of machine learning (and, specifically, reinforcement learning). ...
3
votes
1answer
63 views

What is the difference between parametric and non-parametric models?

A model can be classified as parametric or non-parametric. How are models classified as parametric and non-parametric models? What is the difference between the two approaches?
3
votes
2answers
99 views

Why is regret so defined in MABs?

Consider a multi-armed bandit(MAB). There are $k$ arms, with reward distributions $R_i$ where $1 \leq i \leq k$. Let $\mu_i$ denote the mean of the $i^{th}$ distribution. If we run the multi-armed ...
2
votes
1answer
37 views

What's the threshold to call something 'machine learning'?

For example, if I use some iterative solvers to find a solution to a non-linear least squares problem, is that already considered machine learning?
2
votes
1answer
87 views

What are proxy reward functions?

The understanding I have is that they somehow adjust the objective to make it easier to meet, without changing the reward function. ... the observed proxy reward function is the approximate solution ...
4
votes
1answer
105 views

What is eager learning and lazy learning?

What is the difference between eager learning and lazy learning? How does eager learning or lazy learning help me build a neural network system? And how can I use it for any target function?
0
votes
1answer
82 views

What is Cognitive Intelligence?

Similarly to the question, What is artificial intelligence? Cognitive Intelligence, as well as being a part of Artificial Intelligence, is an area that mainly covers the technology and tools that ...
1
vote
1answer
78 views

What is the difference between artificial neural network (ANN) and deep learning?

I have read many mixed definitions around these two terms. For example, is it right to say deep learning is any ANN with more than two hidden layers? What are formal definitions for these two?
1
vote
2answers
426 views

What is the Turing test?

I'm looking for intuition in simple words but also some simple insights (I don't know if the latter is possible). Can anybody shed some light on the Turing test?
1
vote
1answer
104 views

Does self-supervised learning require auxiliary tasks?

Self-supervised learning algorithms provide labels automatically. But, it is not clear what else is required for an algorithm to fall under the category "self-supervised": Some say, self-...
2
votes
2answers
415 views

What are the main algorithms used in computer vision?

Nowadays, CV has really achieved great performance in many different areas. However, it is not clear what a CV algorithm is. What are some examples of CV algorithms that are commonly used nowadays and ...
0
votes
1answer
104 views

What is a convolutional neural network?

Given that this question has not yet been asked on this site, although similar questions have already been asked in the past (e.g. here or here), what is essentially a convolutional neural network (...
5
votes
3answers
899 views

What is Reinforcement Learning?

What is the cleanest, easiest way to explain someone who is a non-STEM work colleague the concept of Reinforcement Learning? What are the main ideas behind Reinforcement Learning?
5
votes
1answer
194 views

How do I recognise a bandit problem?

I'm having difficulty understanding the distinction between a bandit problem and a non-bandit problem. An example of the bandit problem is an agent playing $n$ slot machines with the goal of ...
3
votes
1answer
192 views

How do we express $q_\pi(s,a)$ as a function of $p(s',r|s,a)$ and $v_\pi(s)$?

The task (exercise 3.13 in the RL book by Sutton and Barto) is to express $q_\pi(s,a)$ as a function of $p(s',r|s,a)$ and $v_\pi(s)$. $q_\pi(s,a)$ is the action-value function, that states how good ...
2
votes
1answer
64 views

Can the agent wait until the end of the episode to determine the reward in SARSA?

From Sutton and Barto's book Reinforcement Learning (Adaptive Computation and Machine Learning series) (p. 99), the following definition for first-visit MC prediction, for estimating $V \sim V_\pi$ is ...
2
votes
2answers
192 views

Why is the policy not a part of the MDP definition?

I'm reading an article on reinforcement learning, and I don't understand why the agent's policy $\pi$ is not part of definition of Markov Decision process(MDP): Bu, Lucian, Robert Babu, and Bart De ...
0
votes
1answer
88 views

Is my understanding of how AI works correct?

In my discussion over my question on Math SE, I explained to a user, how I think AI works, I wrote that with the sigmoid(logistic) function, features of a data set are identified, many such iterations ...
2
votes
1answer
96 views

In what RL algorithm category is MiniMax?

Q-learning is a temporal-difference method and Monte Carlo tree search is a Monte Carlo method. In what category is MiniMax?
4
votes
1answer
135 views

Would you categorize policy iteration as an actor-critic reinforcement learning approach?

One way of understanding the difference between value function approaches, policy approaches and actor-critic approaches in reinforcement learning is the following: A critic explicitly models a value ...
3
votes
1answer
45 views

Is the test time the phase when the model's accuracy is calculated with test data set?

When papers talk about the "test time", does this mean the phase when the model is passed with new data instances to derive the accuracy of the test data set? Or is "test time" the phase when the ...
1
vote
0answers
60 views

What's the meaning of the Jaccard decay and the Jaccard recall? [closed]

For reference, see: Jaccard decay, Jaccard recall, and class-agnostic binary segmentation (SE:CS) I know the meaning of the Jaccard index and the formula associated to it, but when it comes to Jaccard ...
2
votes
1answer
81 views

What are preferences and preference functions in multi-objective reinforcement learning?

In RL (reinforcement learning) or MARL (multi-agent reinforcement learning), we have the usual tuple: (state, action, transition_probabilities, reward, next_state) ...
1
vote
1answer
70 views

What is generalized policy iteration?

I am reading Sutton and Barto's material now. I know value iteration, which is an iterative algorithm taking the maximum value of adjacent states, and policy iteration. But what is generalized policy ...
8
votes
1answer
578 views

Can neural networks with a sigmoid as the activation function of the output layer approximate continuous functions?

Neural networks are commonly used for classification tasks, in fact from this post it seems like that's where they shine brightest. However, when we want to classify using neural networks, we often ...
15
votes
5answers
3k views

What is the idea called involving an AI that will eventually rule humanity?

It's an idea I heard a while back but couldn't remember the name of. It involves the existence and development of an AI that will eventually rule the world and that if you don't fund or progress the ...
2
votes
2answers
251 views

Can you provide some pseudocode examples of what constitutes an AI?

After years of learning, I still can't understand what is considered to be an AI. What are the requirements for an algorithm to constitute Artificial Intelligence? Can you provide pseudocode examples ...
1
vote
1answer
114 views

What is teacher forcing?

In the paper Neural Programmer-Interpreters, the authors use the teacher forcing technique, but what exactly is it?
1
vote
1answer
61 views

What is an end-to-end AI project?

I often read about the so-called end-to-end AI (or analytics) projects, but I couldn't find a definition of it. What is an end-to-end AI project? Can someone explain what is meant/expected when ...
3
votes
0answers
50 views

How exactly does self-play work, and how does it relate to MCTS?

I am working towards using RL to create an AI for a two-player, hidden-information, a turn-based board game. I have just finished David Silver's RL course and Denny Britz's coding exercises, and so am ...
2
votes
1answer
74 views

How does crossover work in a genetic algorithm?

If I had the weights of a certain number of "parents" that I wanted to crossbreed, and I used whatever method to pick out the "best parents" (I used a roulette wheel option, if that's any relevant), ...
1
vote
1answer
57 views

Is the following statement about neural networks overclaimed?

Is the following statement about neural networks overclaimed? Neural networks are iterative methods that minimize a loss function defined on the output layer of neurons. I wrote this statement in ...
7
votes
1answer
347 views

What is the mathematical definition of an activation function? [duplicate]

What is the mathematical definition of an activation function to be used in a neural network? So far I did not find a precise one, summarizing which criterions (e.g. monotonicity, differentiability, ...
3
votes
1answer
1k views

What is a cascaded convolutional neural network?

For a project I am doing, I found the paper Face Alignment in Full Pose Range: A 3D Total Solution. It is using a cascaded convolutional neural network, but I wasn't able to find the original paper ...
2
votes
1answer
98 views

How to define the “Pre-Processing” in machine learning?

Is every process1 that is done on the data before we train the model is always called the pre-processing part? Or are there some processes which are not included? 1"Every process" is includes data ...
4
votes
1answer
161 views

When exactly is a model considered over-parameterized?

When exactly is a model considered over-parameterized? There are some recent researches in Deep Learning about the role of over-parameterization toward generalization, so it would be nice if I can ...