All Questions

Filter by
Sorted by
Tagged with
0
votes
0answers
3 views

Do I have to crossover my node genes in NEAT, and how?

I'm currently trying to code the NEAT algorithm by myself, but I got stuck with two questions. Here they are: What happens if during crossover, a node is removed/disabled, and there's a connection ...
1
vote
1answer
6 views

What is the relationship between the reward function and the value function?

To clarify it in my head, the value function calculates how 'good' it is to be in a certain state by summing all future (discounted) rewards, while the reward function is what the value function uses ...
0
votes
0answers
6 views

AI predicting on what's going to Happen through Gaming?

When you play video games, sometimes their is an AI on knowing what are you going to do, like for instance Candy Crush, if you finish the level and you still have move remaining, you get to see fishes ...
0
votes
1answer
7 views

Does this prove AI Safety is undecidable?

Does this prove AI Safety is undecidable? As I see it, this uses a similar proof as the one on Wikipedia to prove that the halting problem is undecidable. See: https://en.wikipedia.org/wiki/...
0
votes
0answers
7 views

Should I be trying to create a generic application or something more specific to a particular game?

I'm creating an RL application for the game Connect Four. In general, should I be aiming to create an application that's more generic, which would 'learn' different games, or specific to a particular ...
1
vote
0answers
6 views

How should I define the reward function for the Connect Four game?

I'm creating an RL application for the game Connect Four. I've researched the different strategies for the game and which positions are more favourable to lead to a win. Should I be assigning ...
1
vote
0answers
10 views

Why can the core reinforcement learning algorithms be applied to POMDPs?

Why can an AI, like AlphaStar, work in StarCraft, although the environment is only partially observable? As far as I know, there are no theoretical results on RL in the POMDP environment, but it ...
0
votes
0answers
7 views

More Relevant and Compact Learning Material For Artificial Intelligence [closed]

I'm an Intermediate Machine Learning student and want to get more detailed and specific intuition about Artificial Intelligence. I have made a couple of searches over the well-observed learning sites ...
2
votes
2answers
15 views

Why is there an expectation sign in the Bellman equation?

In chapter 3.5 of Sutton's book, the value function is defined as: Can someone give me some clarification about why there is the expectation sign behind the entire equation? Considering that the ...
1
vote
0answers
12 views

How can I find the appropriate reward value for my reinforcement learning problem?

I am wondering how can I find the appropriate reward value for each specific problem. I know this is a highly empirical process, but I am sure that the value is not set totally at random. I want to ...
1
vote
0answers
8 views

Is the TD-residual defined for timesteps $t$ past the length of the episode?

Let $\mathcal{S}$ be the state-space in a reinforcement learning problem where rewards are in $\mathbb{R}$, and let $V:\mathcal{S} \to \mathbb{R}$ be an approximate value function. Following the GAE ...
1
vote
1answer
20 views

What is the role of convex optimisation in AI systems?

Convex optimisation is defined as: I have seen a lot of talk about convex loss functions in Neural Networks and how we are optimising rewards or penalty in AI/ML systems. But I have never seen any ...
0
votes
2answers
23 views

How can I train a neural network if I don't have enough data?

I have created a neural network that is able to recognize images with the numbers 1-5. The issue is that I have a database of 16x5 images which ,unfortunately, is not proving enough as the neural ...
1
vote
1answer
23 views

Which humanoid robots have open-source software (or hardware)?

Apart from iCub, whose open-source software can be found at https://github.com/robotology/icub-main, what other humanoid robots have open-source and freely accessible software (or hardware)?
1
vote
0answers
17 views

Is the derivative of the loss wrt a single scalar parameter proportional to the loss?

I am wondering about the correlation between the loss and the derivative of the loss wrt a single scalar parameter, with the same sample. That means: considering a machine learning model with ...
1
vote
1answer
22 views

Should I always start from the same start state in reinforcement learning?

In an episodic training of an RL agent, should I always start from the same initial state or I can start from several valid initial states? For example, in a gym environment, should my ...
1
vote
0answers
19 views

NN for card game evaluation function

I've written an Monte Carlo Tree Search player for the game of Castle (AKA Shithead, Shed, Palace...). I have set this MCTS player to play against a basic rule based AI for ~30000 games and collected ~...
0
votes
0answers
13 views

How can I implement a Facial Recognition algorithm in C++ from scratch, without using OpenCV?

I wanna implement an algorithm for Facial Recognition in C++ with the help of Viola-Jones, aka Adaboost, but without using OpenCV or any other similar library. I wanna do it all from scratch. Any tips?...
1
vote
0answers
11 views

Efficient algorithm to obtain near optimal policies for an MDP

Given a discrete, finite Markov Decision Process (MDP) with its usual parameters $(S, A, T, R, \gamma)$, it is possible to obtain the optimal policy $\pi^{*}$ and the optimal value function $V^{*}$ ...
1
vote
0answers
12 views

What are the most common non-Markov RL paradigms?

I am interested in doing model-free RL but not using the Markov assumptions typical for MDPs or POMDPs. What are alternative paradigms that don't rely on the Markov assumptions? Are there any common ...
1
vote
0answers
6 views

How to generate non-linear line connection by using Taylor series for CNN like model in python?

I intend to implement CNN like progressively expanded neural network in Keras. The basic idea is the first input node can be decomposed into multiple nodes with different orders and coefficient, then ...
0
votes
0answers
24 views

What is the difference between using dense layers vs convolutional layers when dealing with images/image data?

I'm working on building a GAN and wondering what is the difference between using dense layers vs convolutional layers in my networks.
2
votes
0answers
36 views

Does Rice's theorem prove safe AI is undecidable?

According to Wikipedia In computability theory, Rice's theorem states that all non-trivial, semantic properties of programs are undecidable. A semantic property is one about the program's ...
1
vote
1answer
24 views

Alternatives to U-Net for biomedical image segmentation

Soon I will be working on biomedical image segmentation (microscopy images). There will be a small amount of data (a few dozens at best). My question is really straightforward: is there a neural ...
0
votes
0answers
7 views

tf.data.Dataset: The `batch_size` argument must not be specified for the given input type [migrated]

I'm using Talos and Google colab TPU to run hyperparameter tuning of a Keras model. Note that I'm using Tensorflow 1.15.0 and Keras 2.2.4-tf. ...
0
votes
0answers
6 views

What are the current research trends in recognizing narrative similarity?

I am currently working on a term paper on the topic of Narrative Similarity, based on Loizos Michael's work "Similarity of Narratives". I am trying to find the latest trends within this field of study ...
0
votes
0answers
9 views

How to productionize a YOLO model? [migrated]

I have successfully trained a YOLO v3 model using the AlexeyAB fork. Now I need to deploy the generated weight file into a service-oriented architecture production environment. For example, I need to ...
0
votes
0answers
15 views

How should I define the loss function when using DQN to estimate the probability density?

I'm doing a Deep Q-learning project. All of my rewards are positive and there are two terminal states. One of them has a zero reward and the other has a high positive reward. The rewards are ...
0
votes
1answer
50 views

Is my backpropagation code correct? [closed]

I am trying to implement the back-propagation algorithm for the following neural network. ...
0
votes
0answers
8 views

How can I perform object detection by cutting the image into many pieces each containing one object?

Our task is to do a special object detection: In the traditional case, the neural network will output some rectangle bounding boxes. But in our case, the network should output many nearly-vertical ...
0
votes
0answers
20 views

Is the MDP value function used in the minimax algorithm? [closed]

Is the MDP value function represented (or used) in the minimax algorithm? If so, could you please give an example?
0
votes
0answers
13 views

How to develop a face recognition program from scratch in C++? [closed]

Recently, I've got this project on facial recognition for the uni that I have to finish by the end of the semester. The teacher asked us to do it in C++, without using any useful things, such as ...
1
vote
1answer
30 views

Can this be a possible deep q learning pseudocode?

I am not using replay here. Can this be a possible deep q learning pseudocode? ...
2
votes
1answer
76 views

What assumptions are made when positing the emergence of superintelligence?

Many experts seem to think that artificial general intelligence, or AGI, (on the level of humans) is possible and likely to emerge in the near-ish future. Some make the further step to say that ...
0
votes
0answers
11 views

Can I run Tensorflow if my GPU is compatible but my CPU is not? [migrated]

I am considering buying a GPU that is compatible with Tensorflow. However, the CPU in the same machine is not. Can I still run only Tensorflow GPU? Thanks
0
votes
2answers
23 views

What does it mean to have epochs=30 in Keras' fit method given certain data?

I have read a lot of information about several notions, like batch_size, epochs, iterations, but because of explanation was without numerical examples and I am not native speaker, I have some kind of ...
-2
votes
0answers
43 views

a simple new way to artificial intelligence [closed]

I just want to share this new way of building knowledge organizer How to build new type of ai with some simple tools. # image DNA # Google glass # marker # mark strength # A4 Why we didn't build a ...
1
vote
0answers
19 views

How to define observation and action space for an array-like input?

I am working on a problem, and I want to implement it as a reinforcement learning problem and integrate it into the OpenAI's gym. My states are in the form of lists of length $n$, where each element ...
1
vote
0answers
12 views

Can I use deepfake to rotoscope for animation?

I'm a big fan of animation and have kept an eye on the deepfake's ability to replicate full body motion. So I ask Is there a deepfake software available I can use to gather animation from a video? ...
1
vote
0answers
7 views

How can I add logic for invalid moves when using stable-baselines in OpenAI's gym?

I want to integrate my environment into the OpenAI's gym and then use the stable baselines library for training it. The learning method in the stable baseline is with one-line learning and you don't ...
1
vote
0answers
19 views

How should I avoid illegal states in OpenAI's gym?

I'm trying to make a gym environment for a simulation problem. In my gym environment, I have a set of illegal states which I don't want my agent to go into them. What is the easiest way to add such ...
2
votes
0answers
17 views

How much time does it take to train DQN on Atari environment?

I am trying to build a DQN model for the Atari Pong game, but I am not sure whether the model is learning at all. I am using the architecture described in the paper Playing Atari with Deep ...
2
votes
0answers
20 views

Do I have to downsample the input and upsample the output of the neural network when implementing the NICE algorithm?

Consider that my input is an RGB image. The size of my image is $N\times N$. I'm trying to implement NICE algorithm presented by Dinh. The bijective function $f: \mathbb{R}^d \to \mathbb{R}^d$ maps $X$...
1
vote
1answer
38 views

What is relation between gradient descent and regularization in deep learning?

Gradient descent is used to reduce the loss and regularization is used to fight over-fitting. Is there any relation between gradient descent and regularization, or both are independent of each other?...
0
votes
2answers
23 views
2
votes
0answers
19 views

Which work originally introduced gradient clipping?

The Deep Learning book mentions that it's been used for years but the oldest sources it mentions are from 2012: A simple type of solution has been in use by practitioners for many years: clipping ...
1
vote
0answers
26 views

Atari Breakout Infrastructure

This is how they describe their infrastructure in https://www.cs.toronto.edu/~vmnih/docs/dqn.pdf. I want to implement the game of Atari Breakout. ...
1
vote
0answers
13 views

Will structured knowledge bases continue to be used in question answering with the likes of BERT gaining popularity?

This may come across as an open and opinion-based question, I definitely want to hear expert opinions on the subject but I am also looking for references to materials that I can read deeply. One of ...
0
votes
0answers
13 views
1
vote
0answers
43 views

What are examples of commonly used feature and readout maps?

It is well-known that deep feedforward networks can approximate any continuous function from $\mathbb{R}^k$ to $\mathbb{R}^l$, (uniformly on compacts). However, in practice feature maps are ...

15 30 50 per page
1
2 3 4 5
122