7 votes
Accepted

What's a good resource for getting familiar with reinforcement learning?

To the good answers here, I would add A brief overview of RL: Most essential concepts in one place. Another brief overview, in presentation format. Ben Recht's An outsider's tour of RL is pretty ...
cantordust's user avatar
7 votes
Accepted

What are some online courses for deep reinforcement learning?

Let me first say that deep RL is just the combination of RL with deep learning. So, if you study RL and deep learning, then studying deep RL should be straightforward. For this reason, this answer ...
nbro's user avatar
  • 40.1k
7 votes

Is there a way to easily simulate video games, without actually rendering the pixels on screen?

It depends on the game environment and on the model being trained. If you are training an agent that uses vision to decide action, then typically you need a copy of the rendered screen: If that ...
Neil Slater's user avatar
  • 31.5k
6 votes
Accepted

Is there any way to draw a neural network's connections in a nice way?

I'm the developer of Neataptic, a Javascript neural network library. I don't know if it is exactly what you're looking for, but it has a built-in graph creator using D3 and webcola. Basically, each ...
Thomas Wagenaar's user avatar
6 votes
Accepted

What exactly is an XPU?

XPU is a device abstraction for Intel heterogeneous computation architectures, which can be mapped to CPU, GPU, FPGA and other accelerators. The "X" from XPU is just like a variable, like in ...
JVGD's user avatar
  • 1,108
5 votes
Accepted

What are some academic AI podcast out there?

Also a few others options (that I listen to) include: Learning Machines 101 Machine Learning Guide Machine Learning - Software Engineering Daily
knapptimezzz's user avatar
5 votes
Accepted

Small size datasets for object detection, segmentation and localization

There are various dataset available such as Pascal VOC dataset: You can perform all your task with these. size of the dataset is as follows ADE20K Semantic Segmentation Dataset: you can perform ...
Posi2's user avatar
  • 358
5 votes

What are some online courses for deep reinforcement learning?

For the programming part I suggest this YouTube channel by Phil Tabor (he also has a website: neuralnet.ai. I found his videos really useful while I was attending reinforcement learning classes at the ...
Edoardo Guerriero's user avatar
5 votes

What are some alternatives to "Papers with Code"?

Recently arxiv.org added a Code Tab towards the end of paper descriptions. Which contains links to both the official and community code. I don't know if this is the case for all the papers or not ...
Saurav Maheshkar's user avatar
4 votes

Is there an open-source implementation for graph convolution networks for weighted graphs?

You can use Pytorch_Geometric library for your projects. Its supports weighted GCNs. It is a rapidly evolving open-source library with easy to use syntax. It is mentioned in the landing page of ...
user1825567's user avatar
4 votes
Accepted

What tools are used to deal with adversarial examples problem?

However, do industrial strength, production ready defensive strategies and approaches exist? Are there known examples of applied adversarial-resistant networks for one or more specific types (e.g. for ...
Dennis Soemers's user avatar
  • 10.2k
4 votes

What are some academic AI podcast out there?

I'll add a few, though I'm also not sure what exactly would constitute an "academic" podcast. I'm not going to link everything, they should be easy enough to find. Partially derivative Data sceptic ...
BlindKungFuMaster's user avatar
4 votes

What are some intermediate or advanced books on neural networks?

Neural Network Design (2nd edition) by Hagan et al. is one resource you could look at. It's a huge tome, weighing in at over 1000 pages in pdf form, but it is freely available (you can also buy a dead-...
mindcrime's user avatar
  • 3,757
4 votes

What's a good resource for getting familiar with reinforcement learning?

Before that ask yourself if you really want to learn about "reinforcement learning." Although there is much hype about reinforcement learning, the real-world applicability of reinforcement learning is ...
thecomplexitytheorist's user avatar
4 votes

What's a good resource for getting familiar with reinforcement learning?

There's a Youtube playlist (in the DeepMind channel) whose title is Introduction to reinforcement learning, which is a course (of 10 lessons) on reinforcement learning by David Silver. A person who ...
nbro's user avatar
  • 40.1k
4 votes

What are some alternatives to "Papers with Code"?

Another good resource is the free CatalyzeX browser extension — it adds in-line links to any relevant code wherever you come across papers on various websites: AI/ML Papers with Code Everywhere - ...
Gaurav Ragtah's user avatar
3 votes
Accepted

Where can I find an implementation of the wake-sleep algorithm?

I found the following detailed and well documented Python notebook, which uses only NumPy.
TheCG's user avatar
  • 156
3 votes
Accepted

What is the best resources to learn Graph Convolutional Neural Networks?

I believe Graph Representation Learning book by William L. Hamilton is a great resource to start
gcorso's user avatar
  • 356
3 votes

Book(s) on generative models

From the theoretical foundations one can look into the Chapter 20: Deep Generative Models of the classic DL book by Goodfellow, Bengio https://amzn.to/2MmZNbH. Not ...
spiridon_the_sun_rotator's user avatar
3 votes

Is there a way to easily simulate video games, without actually rendering the pixels on screen?

Bypassing graphics As mentioned in Neil Slater's answer, manipulating the engine to bypass graphics rendering to speed up AI simulation can be a valid approach. I have done that myself. But there are ...
meekee7's user avatar
  • 31
2 votes

Is there any way to draw a neural network's connections in a nice way?

You might have come across the Tensorflow Playground which has a wonderful visualization of the network connections and the neuron weights. Their code is available in GitHub (here), and the code ...
Alpha's user avatar
  • 458
2 votes

What are examples of resources that describe the basics of Spiking Neural Networks in detail?

There are so many different versions of spiking neural networks out there. I think it is mainly due to the fact that there has been no dominant successful SNN model with proper learning algorithm like ...
Kyungsu Stanley Kim's user avatar
2 votes

What are examples of resources that describe the basics of Spiking Neural Networks in detail?

There is a book Spiking Neuron Models: Single Neurons, Populations, Plasticity (2002) by Wulfram Gerstner and Werner M. Kistler. I also found these slides that could be useful. (Additional resources ...
Erin Loy's user avatar
2 votes

What's a good resource for getting familiar with reinforcement learning?

I recently saw a course by Microsoft on edx. It is called 'Reinforcement Learning Explained'. Here is the link: https://www.edx.org/course/reinforcement-learning-explained-0 This is not quite ...
mash's user avatar
  • 21
2 votes
Accepted

How can I implement back-propagation for medium-sized neural networks?

Backpropagation isn't too much more complicated, but understanding it well will require a bit of mathematics. This tutorial is my go-to resource when students want more detail, because it includes ...
John Doucette's user avatar
2 votes

Is there a database somewhere of common lists?

So here’s a couple quick resources that i could think of. First of all, you could look at this, https://en.m.wikipedia.org/wiki/List_of_lists_of_lists It has classics such accidents, hospitals in ...
juicedatom's user avatar
2 votes
Accepted

Is there an open-source implementation for graph convolution networks for weighted graphs?

A Comprehensive Survey on Graph Neural Networks (2019) presents a list of ConvGNN's. All of the following accept weighted graphs, and three accept those with edge weights as well: And below is a ...
brazofuerte's user avatar
  • 1,031
2 votes

Is there an AI tool to reverse engineer scanned data to obtain its CAD file?

Two years later, it seems there is no (open) project to train AI on engineering data and no AI tool to reverse engineer things yet. The growing number of open source hardware projects should provide a ...
eMPee584's user avatar
  • 121
2 votes

Is there a good website where I can learn about Deep Deterministic Policy Gradient?

Spinning Up by Open Ai. Be sure to read up Part 3 (Intro to Policy Optimisation) before you move on to : https://spinningup.openai.com/en/latest/algorithms/ddpg.html
kikram's user avatar
  • 43

Only top scored, non community-wiki answers of a minimum length are eligible