Optimization problems are formally defined by two things:
- Optimization objective: $$\min_{x \in \mathbb{R}} f(x)$$
- List of constraints: $\text{s.t. } x > 0$; $\text{s.t. } x^2 < 100$, ...
Optimization theory as a field deals with variations of such problems. The algorithms that are part of optimization include gradient descent and variants, the simplex algorithm, simulated annealing and many more. I would also include evolutionary algorithms as one of the algorithms in this field.
I am confused. Is he actually teaching optimization? If yes, why is the name of the course not "Optimization"?
Evolutionary algorithms are a subfield of optimization. The name of the course is evolutionary algorithms as you likely don't deal with the other aspects of optimization theory (e.g. the algorithms mentioned above).