Skip to main content
3 votes

Can layers of deep neural networks be seen as Hopfield networks?

Deep Learning is not a generalization of Hopfield networks. Deep Learning is a "generalization" of the neural networks/connectionism field started by Rumelhart and McClelland. There are two ...
samlaf's user avatar
  • 221
3 votes
Accepted

Is a calculus or ML approach to varying learning rate as a function of loss and epoch been investigated?

Has this been done? Difficult to prove a negative, but I suspect although plenty of research has been done into finding ideal learning rate values (the need for learning rate at all is an annoyance), ...
Neil Slater's user avatar
  • 32.7k
3 votes

Are there any animation tools available to visualise and simulate deep neural networks?

I suggest you take a look at Chris Olah's blog. Has several interesting post including ones on visualizing weights and interpretability. Most of his papers also have Google Colab links so you can ...
serali's user avatar
  • 890
3 votes

Are Modular Neural Networks more effective than large, monolithic networks at any tasks?

There is indeed an investigation in progress, regarding this topic. A first publication from last march noted that modularity has been done, although not explicitly, since some time ago, but somehow ...
David's user avatar
  • 511
2 votes

Are Modular Neural Networks more effective than large, monolithic networks at any tasks?

A benchmark comparison of systems comprised of separately trained networks relative to single deeper networks would not likely reveal a universally applicable best choice.1 We can see in the ...
Douglas Daseeco's user avatar
2 votes
Accepted

Neural networks of arbitrary/general topology?

The simplistic neural networks that have been given away for free after they prove insufficient by themselves in field use consist solely of two orthogonal dimensions. Layer width — the number ...
Douglas Daseeco's user avatar
2 votes
Accepted

How can AI be used to more reliably analyze and plan around the tie between climate and emissions?

Can AI provide a more reliable analysis of the gross effects of carbon emissions on extinctions of species ice-cap melting, and other effects? Yes. The work of Judea Pearl and others over the last 20 ...
John Doucette's user avatar
2 votes

In what ways is the term "topology" applied to Artificial Intelligence?

In addition to the ways the term topology is itself used generically to describe the "shape" of various aspects of Machine Learning, the term appears in the field Topological Data Analysis: In ...
brazofuerte's user avatar
  • 1,031
2 votes

In what ways is the term "topology" applied to Artificial Intelligence?

I spent some time thinking about it, but I'm aware of only two main meanings. There might be more that aren't coming to me right now though... In local search problems or sometimes in optimization ...
John Doucette's user avatar
1 vote

Does topology have a place in ai

This is not be a full answer to your question, but a good start I believe. Take a look at TDA (Topological Data Analysis) and how is topology used in nlp.
Mostafa Eid's user avatar
1 vote

What topologies support recognition of action sequences?

This is an old area of AI called "Plan Recognition", which has about 3.5 million results in Google Scholar. A lot of the modern work is done with classical search techniques coupled with expert ...
John Doucette's user avatar

Only top scored, non community-wiki answers of a minimum length are eligible