Questions tagged [implementation]
For questions about implementation of software/algorithms related to Artificial Intelligence.
36
questions
0
votes
0answers
10 views
DQN is unable to learn from image data
I am trying to write a DQN model that will be able to solve OpenAI gym CartPole environment. I successfully managed to do it using scalar observation data that ...
2
votes
0answers
22 views
How much time does it take to train DQN on Atari environment?
I am trying to build a DQN model for the Atari Pong game, but I am not sure whether the model is learning at all.
I am using the architecture described in the paper Playing Atari with Deep ...
1
vote
0answers
28 views
How can I get to a final output of shape $224 \times 224$, without FC layers, from a tensor of specific shape, in OpenPose?
I am approaching the implementation of the OpenPose algorithm for realtime human body pose estimation.
According to the official paper OpenPose: Realtime Multi-Person 2D Pose
Estimation using Part ...
0
votes
1answer
27 views
Why isn't the implementation of my policy evaluation for a simple MDP converging?
I am trying to code out a policy evaluation algorithm to find the $V^\pi(s)$ for all states. The following diagram below shows the MDP.
In this case i let p = q = 0.5.
the rewards for each states ...
1
vote
0answers
16 views
Invalid argument: indices[0,0] = -4 is not in [0, 40405) [migrated]
I have a model that was kinda working on some data. I've added in some tokenized word data in the dataset (somewhat truncated for brevity):
...
2
votes
0answers
71 views
How can I implement derivative of softmax function for matrices in Python?
I have trouble understanding how to implement derivative of softmax function. Here is what I tried:
...
2
votes
1answer
51 views
How difficult is this sound classification?
I want a microphone to pick up sounds around me (let's say beyond a 3 foot radius), but ignore sounds made at my desk, such as the rustling of paper, clicking a mouse and typing, my hands brushing up ...
1
vote
0answers
33 views
Why are the current means and the old ones the same in this implementation of Elastic Weight Consolidation?
I'm trying to re-implement Elastic Weight Consolidation (EWC) as outlined in this paper. As a reference, I am also using this Github repository (another implementation).
My model/idea is pretty ...
1
vote
0answers
27 views
Are there any general tips for troubleshooting a VAE when apparently it is not learning?
I am trying to train a VAE for anomaly detection. I chose one architecture from this Github repository and I adjusted the input and output to match what I need. In my case, the input (and hence the ...
5
votes
1answer
81 views
Context-based gap-fill face posture-mapper GAN
These images are handmade, not auto-generated like they will be in production. Apologies for inaccuracies in the graph overlay.
I am trying to build an AI like that displayed in the diagram: when ...
9
votes
5answers
6k views
What does AI software look like, and how is it different from other software?
What does AI software look like? What is the major difference between AI software and other software?
2
votes
0answers
78 views
How can I increase the speed and performance of my implementation of an AI for Reversi?
I made an AI for Reversi, aka Othello (8×8), like Alpha Zero, using this book. This book is written in Japanese. The source code of the AI I implemented can be found in this Github repository. There ...
3
votes
0answers
82 views
How is the rollout from the MCTS implemented in both of the AlphaGo Zero and the AlphaZero algorithms?
In a vanilla Monte Carlo tree search (MCTS) implementation, the rollout is usually implemented following a uniform random policy, that is, it takes random actions until the game is finished and only ...
2
votes
0answers
47 views
Implementation of SVM - theory to practice
I'm studying Support Vector Machines in the machine learning course, I'm a computer scientist, I've quite understood how SVM are designed thanks also to 16. Learning: Support Vector Machines - MIT.
...
3
votes
2answers
48 views
Are feature maps merged or are they passed on as they are?
I am unsure about the following parts of the architecture and mechanics of convolution layers in CNNs. Possibly, this is implementation-dependent though.
First question:
Say I have 2 convolution ...
3
votes
1answer
34 views
How does Monte Carlo Tree Search UCT exploitation value change based on perspective?
In this blog toward the end, the author writes the following:
For the sake of my question, let’s assume that a terminal state gives a reward of +1 for a win and -1 for a loss.
When the author says “...
4
votes
2answers
56 views
How is parallelism implemented in RL algorithms like PPO?
There are multiple ways to implement parallelism in reinforcement learning. One is to use parallel workers running in their own environments to collect data in parallel, instead of using replay memory ...
2
votes
0answers
59 views
How can the convolution operation be implemented as a matrix-vector multiplication?
How can the convolution operation used by CNNs be implemented as a matrix-vector multiplication? We often think of the convolution operation in CNNs as a kernel that slides across the input. However, ...
0
votes
0answers
70 views
Using AI to guess a mathematical pattern of certain polynomials in four variables: practical challenge
I'd like to use machine learning to guess a mathematical pattern: the input are certain polynomials in four variables $q_1,q_2,q_3,q_4$, the output can be zero or one.
Allowed polynomials are such ...
1
vote
1answer
65 views
How to impliment AI using js [closed]
I want to implement AI in client side. Any Javascript libraries that has been already used.
What are the libraries can be used and some samples?
2
votes
2answers
88 views
Which of these two numerical methods for z-score normalisation is preferable, in multivariate linear regression?
In the exercise Exercise 3: Multivariate Linear Regression, by Andrew Ng, the author suggests to "scale both types of inputs by their standard deviations and set their means to zero".
$$x_{n e w}=\...
3
votes
1answer
113 views
Does depth-first search always stop when it has found the leftmost solution?
I'm a fresh learner of AI. I was told that depth-first search is not an optimal searching algorithm since "it finds the 'leftmost' solution, regardless of depth or cost". Therefore, does it mean that ...
1
vote
3answers
127 views
How to implement a Restricted Boltzmann Machine manually?
I am learning about Restricted Boltzmann Machines and I'm so excited by the ability it gives us for unsupervised learning. The problem is that I do not know how to implement it using one of the ...
3
votes
1answer
568 views
Regarding Yolo and Keras [closed]
I'm trying to implement YOLO (tiny version, v1) into Keras framework. For the past two days, I've been relentlessly digging through Github and the likes in order to ...
1
vote
0answers
52 views
Deep Q-Network concepts and implementation
How does sequential DQN work?
How would one construct the simple sequential DQN?
OpenAI Baselines: DQN
9
votes
5answers
257 views
Why isn't ethics more integrated into current AI systems?
I am a PhD student in computer science, and currently creating a state of the art overview in applications done in Machine Ethics (a multidisciplinary field combining philosophy and AI, that looks at ...
6
votes
2answers
513 views
How should I handle action selection in the terminal state when implementing SARSA?
I recently started learning about reinforcement learning and currently I am trying to implement the SARSA algorithm, however I do not know how to deal with $Q(s', a')$, when $s'$ is the terminal state....
3
votes
1answer
106 views
Are there independent evaluations of various major AI platforms?
Has anyone had a chance to tinker with multiple major AI platforms such as TensorFlow, Cognitive Talk, Quill etc...
What are the strengths and weaknesses of different AI platforms?
Comprehensive ...
5
votes
1answer
502 views
Could an AI be killed in an infinite loop?
Currently, we use control flow statements (such as loops) to program the artificially intelligent systems. Could an AI be killed in an infinite loop (created by itself, for example, while manipulating ...
9
votes
4answers
714 views
Are we technically able to make, in hardware, arbitrarily large neural networks with current technology?
If neurons and synapses can be implemented using transistors, what prevents us from creating arbitrarily large neural networks using the same methods with which GPUs are made?
In essence, we have ...
4
votes
1answer
310 views
State representation of position in 2D plane for Reinforcement Learning (Q Learning)
I recently finished Course on RL by David Silver (on YT) and thought about trying it out on simple application in Unity Game Engine, where I've built simple labyrint with ball and want to teach the ...
3
votes
1answer
582 views
How to represent a large decision tree?
A system makes a decision basing on a large number of varied factors, following a "live" decision tree - one that is (independently, through other subsystem) updated with new decisions, new situations....
3
votes
1answer
119 views
Are there any anthropological studies involving AI right now?
Are there currently any studies to simulate gradual (or sudden) implementation of AIs in the general work force?
1
vote
1answer
108 views
What are the approaches to teach AI to how to render html page based on its source code?
I'm wondering, instead of implementing new web browsers over and over again with millions line of code which is very difficult to manage, would it be possible to use ANN or GA algorithm to teach it ...
1
vote
1answer
150 views
What are the minimum requirements to call something artificial neural network?
I've found this short Python code which implements neural network in 11 lines of code:
...
3
votes
2answers
84 views
How to distinguish AI modeling from implementation?
Quote from this Eric's meta post about modelling and implementation:
They are not exactly the same, although strongly related. This was a very difficult lesson to learn among mathematicians and ...
