Search Results
| Search type | Search syntax |
|---|---|
| Tags | [tag] |
| Exact | "words here" |
| Author |
user:1234 user:me (yours) |
| Score |
score:3 (3+) score:0 (none) |
| Answers |
answers:3 (3+) answers:0 (none) isaccepted:yes hasaccepted:no inquestion:1234 |
| Views | views:250 |
| Code | code:"if (foo != bar)" |
| Sections |
title:apples body:"apples oranges" |
| URL | url:"*.example.com" |
| Saves | in:saves |
| Status |
closed:yes duplicate:no migrated:no wiki:no |
| Types |
is:question is:answer |
| Exclude |
-[tag] -apples |
| For more details on advanced search visit our help page | |
Results tagged with optimization
Search options not deleted
user 85497
For questions about implementing and improving optimization algorithms used in creating AI programs, or optimization in general.
2
votes
2
answers
889
views
Why isn’t this formula used at all?
$$ w_{n+1} = w_n - \alpha \frac{f \nabla f}{||\nabla f||^2} $$
It calculates where the line that’s in the same direction as gradient and has $f$’s slope in that direction becomes zero.
In one dimensio …
- 173
1
vote
1
answer
25
views
Why doesn’t this optimization method work?
My idea is simple, for a loss function $L$, learning rate $\alpha$ and weights $W_n$ define the function $u_n(\alpha)$ as:
$$u_n(\alpha) = L(W_n - \alpha \nabla_n L)$$
If we find the minimum of $u_n$, …
- 173