# All Questions

6,062 questions
Filter by
Sorted by
Tagged with
3 views

### Do I have to crossover my node genes in NEAT, and how?

I'm currently trying to code the NEAT algorithm by myself, but I got stuck with two questions. Here they are: What happens if during crossover, a node is removed/disabled, and there's a connection ...
6 views

### What is the relationship between the reward function and the value function?

To clarify it in my head, the value function calculates how 'good' it is to be in a certain state by summing all future (discounted) rewards, while the reward function is what the value function uses ...
6 views

### AI predicting on what's going to Happen through Gaming?

When you play video games, sometimes their is an AI on knowing what are you going to do, like for instance Candy Crush, if you finish the level and you still have move remaining, you get to see fishes ...
7 views

### Does this prove AI Safety is undecidable?

Does this prove AI Safety is undecidable? As I see it, this uses a similar proof as the one on Wikipedia to prove that the halting problem is undecidable. See: https://en.wikipedia.org/wiki/...
7 views

### Should I be trying to create a generic application or something more specific to a particular game?

I'm creating an RL application for the game Connect Four. In general, should I be aiming to create an application that's more generic, which would 'learn' different games, or specific to a particular ...
6 views

### How should I define the reward function for the Connect Four game?

I'm creating an RL application for the game Connect Four. I've researched the different strategies for the game and which positions are more favourable to lead to a win. Should I be assigning ...
10 views

### Why can the core reinforcement learning algorithms be applied to POMDPs?

Why can an AI, like AlphaStar, work in StarCraft, although the environment is only partially observable? As far as I know, there are no theoretical results on RL in the POMDP environment, but it ...
7 views

### More Relevant and Compact Learning Material For Artificial Intelligence [closed]

I'm an Intermediate Machine Learning student and want to get more detailed and specific intuition about Artificial Intelligence. I have made a couple of searches over the well-observed learning sites ...
15 views

In chapter 3.5 of Sutton's book, the value function is defined as: Can someone give me some clarification about why there is the expectation sign behind the entire equation? Considering that the ...
12 views

### How can I find the appropriate reward value for my reinforcement learning problem?

I am wondering how can I find the appropriate reward value for each specific problem. I know this is a highly empirical process, but I am sure that the value is not set totally at random. I want to ...
8 views

### Is the TD-residual defined for timesteps $t$ past the length of the episode?

Let $\mathcal{S}$ be the state-space in a reinforcement learning problem where rewards are in $\mathbb{R}$, and let $V:\mathcal{S} \to \mathbb{R}$ be an approximate value function. Following the GAE ...
20 views

### What is the role of convex optimisation in AI systems?

Convex optimisation is defined as: I have seen a lot of talk about convex loss functions in Neural Networks and how we are optimising rewards or penalty in AI/ML systems. But I have never seen any ...
23 views

### How can I train a neural network if I don't have enough data?

I have created a neural network that is able to recognize images with the numbers 1-5. The issue is that I have a database of 16x5 images which ,unfortunately, is not proving enough as the neural ...
23 views

### Which humanoid robots have open-source software (or hardware)?

Apart from iCub, whose open-source software can be found at https://github.com/robotology/icub-main, what other humanoid robots have open-source and freely accessible software (or hardware)?
17 views

### Is the derivative of the loss wrt a single scalar parameter proportional to the loss?

I am wondering about the correlation between the loss and the derivative of the loss wrt a single scalar parameter, with the same sample. That means: considering a machine learning model with ...
22 views

### Should I always start from the same start state in reinforcement learning?

In an episodic training of an RL agent, should I always start from the same initial state or I can start from several valid initial states? For example, in a gym environment, should my ...
19 views

### NN for card game evaluation function

I've written an Monte Carlo Tree Search player for the game of Castle (AKA Shithead, Shed, Palace...). I have set this MCTS player to play against a basic rule based AI for ~30000 games and collected ~...
13 views

### How can I implement a Facial Recognition algorithm in C++ from scratch, without using OpenCV?

I wanna implement an algorithm for Facial Recognition in C++ with the help of Viola-Jones, aka Adaboost, but without using OpenCV or any other similar library. I wanna do it all from scratch. Any tips?...
11 views

### Efficient algorithm to obtain near optimal policies for an MDP

Given a discrete, finite Markov Decision Process (MDP) with its usual parameters $(S, A, T, R, \gamma)$, it is possible to obtain the optimal policy $\pi^{*}$ and the optimal value function $V^{*}$ ...
12 views

### What are the most common non-Markov RL paradigms?

I am interested in doing model-free RL but not using the Markov assumptions typical for MDPs or POMDPs. What are alternative paradigms that don't rely on the Markov assumptions? Are there any common ...
6 views

### How to generate non-linear line connection by using Taylor series for CNN like model in python?

I intend to implement CNN like progressively expanded neural network in Keras. The basic idea is the first input node can be decomposed into multiple nodes with different orders and coefficient, then ...
24 views

### What is the difference between using dense layers vs convolutional layers when dealing with images/image data?

I'm working on building a GAN and wondering what is the difference between using dense layers vs convolutional layers in my networks.
36 views

### Does Rice's theorem prove safe AI is undecidable?

According to Wikipedia In computability theory, Rice's theorem states that all non-trivial, semantic properties of programs are undecidable. A semantic property is one about the program's ...
24 views

### Alternatives to U-Net for biomedical image segmentation

Soon I will be working on biomedical image segmentation (microscopy images). There will be a small amount of data (a few dozens at best). My question is really straightforward: is there a neural ...
7 views

### tf.data.Dataset: The batch_size argument must not be specified for the given input type [migrated]

I'm using Talos and Google colab TPU to run hyperparameter tuning of a Keras model. Note that I'm using Tensorflow 1.15.0 and Keras 2.2.4-tf. ...
6 views

### What are the current research trends in recognizing narrative similarity?

I am currently working on a term paper on the topic of Narrative Similarity, based on Loizos Michael's work "Similarity of Narratives". I am trying to find the latest trends within this field of study ...
9 views

### How to productionize a YOLO model? [migrated]

I have successfully trained a YOLO v3 model using the AlexeyAB fork. Now I need to deploy the generated weight file into a service-oriented architecture production environment. For example, I need to ...
15 views

### How should I define the loss function when using DQN to estimate the probability density?

I'm doing a Deep Q-learning project. All of my rewards are positive and there are two terminal states. One of them has a zero reward and the other has a high positive reward. The rewards are ...
50 views

### Is my backpropagation code correct? [closed]

I am trying to implement the back-propagation algorithm for the following neural network. ...
8 views

### How can I perform object detection by cutting the image into many pieces each containing one object?

Our task is to do a special object detection: In the traditional case, the neural network will output some rectangle bounding boxes. But in our case, the network should output many nearly-vertical ...
20 views

### Is the MDP value function used in the minimax algorithm? [closed]

Is the MDP value function represented (or used) in the minimax algorithm? If so, could you please give an example?
13 views

### How to develop a face recognition program from scratch in C++? [closed]

Recently, I've got this project on facial recognition for the uni that I have to finish by the end of the semester. The teacher asked us to do it in C++, without using any useful things, such as ...
30 views

### Can this be a possible deep q learning pseudocode?

I am not using replay here. Can this be a possible deep q learning pseudocode? ...
76 views

### What assumptions are made when positing the emergence of superintelligence?

Many experts seem to think that artificial general intelligence, or AGI, (on the level of humans) is possible and likely to emerge in the near-ish future. Some make the further step to say that ...
11 views

### Can I run Tensorflow if my GPU is compatible but my CPU is not? [migrated]

I am considering buying a GPU that is compatible with Tensorflow. However, the CPU in the same machine is not. Can I still run only Tensorflow GPU? Thanks
23 views

### What does it mean to have epochs=30 in Keras' fit method given certain data?

I have read a lot of information about several notions, like batch_size, epochs, iterations, but because of explanation was without numerical examples and I am not native speaker, I have some kind of ...
43 views

### a simple new way to artificial intelligence [closed]

I just want to share this new way of building knowledge organizer How to build new type of ai with some simple tools. # image DNA # Google glass # marker # mark strength # A4 Why we didn't build a ...
19 views

### How to define observation and action space for an array-like input?

I am working on a problem, and I want to implement it as a reinforcement learning problem and integrate it into the OpenAI's gym. My states are in the form of lists of length $n$, where each element ...
12 views

### Can I use deepfake to rotoscope for animation?

I'm a big fan of animation and have kept an eye on the deepfake's ability to replicate full body motion. So I ask Is there a deepfake software available I can use to gather animation from a video? ...
7 views

### How can I add logic for invalid moves when using stable-baselines in OpenAI's gym?

I want to integrate my environment into the OpenAI's gym and then use the stable baselines library for training it. The learning method in the stable baseline is with one-line learning and you don't ...
19 views

### How should I avoid illegal states in OpenAI's gym?

I'm trying to make a gym environment for a simulation problem. In my gym environment, I have a set of illegal states which I don't want my agent to go into them. What is the easiest way to add such ...
17 views

### How much time does it take to train DQN on Atari environment?

I am trying to build a DQN model for the Atari Pong game, but I am not sure whether the model is learning at all. I am using the architecture described in the paper Playing Atari with Deep ...
20 views

### Do I have to downsample the input and upsample the output of the neural network when implementing the NICE algorithm?

Consider that my input is an RGB image. The size of my image is $N\times N$. I'm trying to implement NICE algorithm presented by Dinh. The bijective function $f: \mathbb{R}^d \to \mathbb{R}^d$ maps $X$...
38 views

### What is relation between gradient descent and regularization in deep learning?

Gradient descent is used to reduce the loss and regularization is used to fight over-fitting. Is there any relation between gradient descent and regularization, or both are independent of each other?...
23 views

...
19 views

### Which work originally introduced gradient clipping?

The Deep Learning book mentions that it's been used for years but the oldest sources it mentions are from 2012: A simple type of solution has been in use by practitioners for many years: clipping ...
26 views

### Atari Breakout Infrastructure

This is how they describe their infrastructure in https://www.cs.toronto.edu/~vmnih/docs/dqn.pdf. I want to implement the game of Atari Breakout. ...
13 views

### Will structured knowledge bases continue to be used in question answering with the likes of BERT gaining popularity?

This may come across as an open and opinion-based question, I definitely want to hear expert opinions on the subject but I am also looking for references to materials that I can read deeply. One of ...
It is well-known that deep feedforward networks can approximate any continuous function from $\mathbb{R}^k$ to $\mathbb{R}^l$, (uniformly on compacts). However, in practice feature maps are ...