7 votes
Accepted

What's a good resource for getting familiar with reinforcement learning?

To the good answers here, I would add A brief overview of RL: Most essential concepts in one place. Another brief overview, in presentation format. Ben Recht's An outsider's tour of RL is pretty ...
7 votes

Is there a way to easily simulate video games, without actually rendering the pixels on screen?

It depends on the game environment and on the model being trained. If you are training an agent that uses vision to decide action, then typically you need a copy of the rendered screen: If that ...
  • 24.6k
6 votes
Accepted

Is there any way to draw a neural network's connections in a nice way?

I'm the developer of Neataptic, a Javascript neural network library. I don't know if it is exactly what you're looking for, but it has a built-in graph creator using D3 and webcola. Basically, each ...
6 votes
Accepted

What are some online courses for deep reinforcement learning?

Let me first say that deep RL is just the combination of RL with deep learning. So, if you study RL and deep learning, then studying deep RL should be straightforward. For this reason, this answer ...
  • 34.9k
6 votes
Accepted

What exactly is an XPU?

XPU is a device abstraction for Intel heterogeneous computation architectures, which can be mapped to CPU, GPU, FPGA and other accelerators. The "X" from XPU is just like a variable, like in ...
  • 1,038
5 votes
Accepted

Small size datasets for object detection, segmentation and localization

There are various dataset available such as Pascal VOC dataset: You can perform all your task with these. size of the dataset is as follows ADE20K Semantic Segmentation Dataset: you can perform ...
  • 328
5 votes
Accepted

What are some academic AI podcast out there?

Also a few others options (that I listen to) include: Learning Machines 101 Machine Learning Guide Machine Learning - Software Engineering Daily
5 votes

What are some online courses for deep reinforcement learning?

For the programming part I suggest this YouTube channel by Phil Tabor (he also has a website: neuralnet.ai. I found his videos really useful while I was attending reinforcement learning classes at the ...
4 votes
Accepted

What tools are used to deal with adversarial examples problem?

However, do industrial strength, production ready defensive strategies and approaches exist? Are there known examples of applied adversarial-resistant networks for one or more specific types (e.g. for ...
  • 9,519
4 votes

What are some academic AI podcast out there?

I'll add a few, though I'm also not sure what exactly would constitute an "academic" podcast. I'm not going to link everything, they should be easy enough to find. Partially derivative Data sceptic ...
4 votes

What are some intermediate or advanced books on neural networks?

Neural Network Design (2nd edition) by Hagan et al. is one resource you could look at. It's a huge tome, weighing in at over 1000 pages in pdf form, but it is freely available (you can also buy a dead-...
  • 3,697
4 votes

What's a good resource for getting familiar with reinforcement learning?

Before that ask yourself if you really want to learn about "reinforcement learning." Although there is much hype about reinforcement learning, the real-world applicability of reinforcement learning is ...
4 votes

What's a good resource for getting familiar with reinforcement learning?

There's a Youtube playlist (in the DeepMind channel) whose title is Introduction to reinforcement learning, which is a course (of 10 lessons) on reinforcement learning by David Silver. A person who ...
  • 34.9k
4 votes

What are some alternatives to "Papers with Code"?

Recently arxiv.org added a Code Tab towards the end of paper descriptions. Which contains links to both the official and community code. I don't know if this is the case for all the papers or not ...
3 votes

Is there an open-source implementation for graph convolution networks for weighted graphs?

You can use Pytorch_Geometric library for your projects. Its supports weighted GCNs. It is a rapidly evolving open-source library with easy to use syntax. It is mentioned in the landing page of ...
3 votes
Accepted

Where can I find an implementation of the wake-sleep algorithm?

I found the following detailed and well documented Python notebook, which uses only NumPy.
  • 156
3 votes
Accepted

What is the best resources to learn Graph Convolutional Neural Networks?

I believe Graph Representation Learning book by William L. Hamilton is a great resource to start
  • 326
3 votes

What are some alternatives to "Papers with Code"?

Another good resource is the free CatalyzeX browser extension — it adds in-line links to any relevant code wherever you come across papers on various websites: AI/ML Papers with Code Everywhere - ...
3 votes

Book(s) on generative models

From the theoretical foundations one can look into the Chapter 20: Deep Generative Models of the classic DL book by Goodfellow, Bengio https://amzn.to/2MmZNbH. Not ...
3 votes

Is there a way to easily simulate video games, without actually rendering the pixels on screen?

Bypassing graphics As mentioned in Neil Slater's answer, manipulating the engine to bypass graphics rendering to speed up AI simulation can be a valid approach. I have done that myself. But there are ...
  • 31
2 votes

Is there any way to draw a neural network's connections in a nice way?

You might have come across the Tensorflow Playground which has a wonderful visualization of the network connections and the neuron weights. Their code is available in GitHub (here), and the code ...
  • 448
2 votes

What are examples of resources that describe the basics of Spiking Neural Networks in detail?

There are so many different versions of spiking neural networks out there. I think it is mainly due to the fact that there has been no dominant successful SNN model with proper learning algorithm like ...
2 votes

What are examples of resources that describe the basics of Spiking Neural Networks in detail?

There is a book Spiking Neuron Models: Single Neurons, Populations, Plasticity (2002) by Wulfram Gerstner and Werner M. Kistler. I also found these slides that could be useful. (Additional resources ...
2 votes

What's a good resource for getting familiar with reinforcement learning?

I recently saw a course by Microsoft on edx. It is called 'Reinforcement Learning Explained'. Here is the link: https://www.edx.org/course/reinforcement-learning-explained-0 This is not quite ...
  • 21
2 votes
Accepted

How can I implement back-propagation for medium-sized neural networks?

Backpropagation isn't too much more complicated, but understanding it well will require a bit of mathematics. This tutorial is my go-to resource when students want more detail, because it includes ...
2 votes

Is there a database somewhere of common lists?

So here’s a couple quick resources that i could think of. First of all, you could look at this, https://en.m.wikipedia.org/wiki/List_of_lists_of_lists It has classics such accidents, hospitals in ...
2 votes
Accepted

Is there an open-source implementation for graph convolution networks for weighted graphs?

A Comprehensive Survey on Graph Neural Networks (2019) presents a list of ConvGNN's. All of the following accept weighted graphs, and three accept those with edge weights as well: And below is a ...
2 votes
Accepted

Is there any resource that describes in detail a naive example-based machine translation algorithm?

I have not found any simple implementation of a naive EBMT system, but I found some articles, papers and books that may be helpful (although I haven't read them, apart from the first and last one), so ...
  • 34.9k
2 votes

Is there a good website where I can learn about Deep Deterministic Policy Gradient?

Spinning Up by Open Ai. Be sure to read up Part 3 (Intro to Policy Optimisation) before you move on to : https://spinningup.openai.com/en/latest/algorithms/ddpg.html
  • 43

Only top scored, non community-wiki answers of a minimum length are eligible