All Questions

Filter by
Sorted by
Tagged with
0
votes
0answers
9 views

Is there a rule-of-thumb to determine which behaviours must be learned in a lifetime and which innate?

I was training an AI to learn things during its lifetime such as find food and navigate a maze. Behaviors that might change during its lifetime. But I hit upon a snag. Some behaviors, like avoiding ...
0
votes
0answers
5 views

When should I stop the object detection model training while mAP are not stable?

I am re-training the SSD MobileNet with 900 images from the Berkeley Deep Drive dataset, and eval towards 100 images from that dataset. The problem is that after ...
1
vote
1answer
9 views

Why are activation functions independent layers in CNNs rather than part of convolutional layers?

I have been reading up on CNNs. One of the different confusing things has been that people always talk of normalization layers. A common normalization layer is a ReLU layer. But I never encountered an ...
0
votes
0answers
22 views

Unique game problem (ML, DP, PP etc)

Looking for a solution to my below game problem. I believe it to require some sort of reinforcement learning, dynamic programming, or probabilistic programming solution, but am unsure... This is my ...
1
vote
0answers
19 views

What is ratio of the objective function in the case of continuous action spaces?

I'm trying to implement the proximal policy optimization (PPO) algorithm. I'm confused on how to make it work with continuous action space. For discrete action space, the output of the network is the ...
1
vote
1answer
21 views

How can I learn tensors for deep learning?

I've seen in most deep learning papers use tensors. I understood what tensors are, but I want to dive into them, because I think that might be beneficial for further studies in Artificial Intelligence....
2
votes
1answer
22 views

Will the target network, which is less trained than the normal network, output inferior estimates?

I'm having some trouble understanding some parts of the usage of target networks. I get that having the same network predict the state/action/advantage values for both the current networks can lead ...
1
vote
2answers
17 views

Are feature maps merged or are they passed on as they are?

I am unsure about the following parts of the architecture and mechanics of convolution layers in CNNs. Possibly, this is implementation-dependent though. First question: Say I have 2 convolution ...
1
vote
2answers
28 views

Does this hyperparameter optimisation approach yield the optimal hyperparameters?

Say I have a ML model which is not very costly to train. It has around say 5 hyperparameters. One way to select best hyperparameters would be to keep all the other hyperparamaters fixed and train ...
3
votes
0answers
40 views

How can I use Q-learning for inventory decision making?

I am trying to model operational decisions in inventory control. The control policy is base stock with a fixed stock level $S$. That is replenishment orders are placed for every demand arrival to take ...
2
votes
0answers
23 views

Will the RL agent implemented as a neural network fine-tune itself?

Normally, when you develop a neural network, train it for object recognition (on normal objects like bike, car, plane, dog, cloud, etc.), and it turns out to perform very well, you would like to fine-...
1
vote
0answers
13 views

Is the Tesla Autopilot driving to fast at the highway?

The latest firmware update of the Tesla autopilot introduced a new feature called “unlimited speed”. It allows to activate the system at 90 mph which is equal to 150km/h in Europe. At this speed the ...
0
votes
1answer
33 views

If the goal of training of a GAN is to have $P_g=P_{data}$, shouldn't this produce the exact same images?

Referring to the blog, Image Completion with Deep Learning in TensorFlow, it clearly says that we would want a generator $g$ whose modeled distribution fits our dataset $data$, in other words, $P_{...
1
vote
1answer
34 views

How do layers in an artificial neural network transform inputs to outputs?

To me, most ANN/RNN related articles don't tell me actually how the network is implemented. I know that in the ANN you'll have multiple neurons, activation function, weights, etc. But, how do you, ...
-2
votes
0answers
33 views

Graduation project [on hold]

Iam a senior electronic engineering faculty And I must make a project to graduate I learned embedded systems and web Now I think to make my project a mix between two fields(embedded &web ) with ...
0
votes
1answer
31 views

Probabilistic action selection in pursuit algorithm

In the Pursuit algorithm (to balance exploration and exploitation), the greedy action has a probability say $p_1$ (updated every episode) of being selected, while the rest have a probability $p_2$ (...
0
votes
0answers
8 views

Is Rapidly-exploring random tree the appropriate algorithm for solving Sokoban?

In the game of Sokoban, a robot has to push boxes to a goal in a map. He has only the ability to move in four directions (left, right, up, down) and the map is small (15x15 fields) so it looks like an ...
1
vote
1answer
34 views

How to verify your ideas for AI model

I have very practical problem. When I would like to solve some "harder" problems, I usually have multiple ideas how to solve it. My problem is, that I don't know how to verify my ideas in easy/fast ...
2
votes
2answers
56 views

What is the difference between a machine learning engineer and deep learning engineer?

What is the difference between a Machine Learning Engineer and Deep Learning Engineer and an AI developer? What would be their daily tasks at the office?
2
votes
1answer
22 views

Change a data compression function into prediction

I've heard prediction is equivalent to data compression. prediction (essentially equivalent to data compression) Is there a way to take a compression function and use it to create an AI that ...
3
votes
1answer
26 views

Is it possible to have a dynamic $Q$-function?

I am trying to use Q-learning for energy optimization. I only wish to have states that will be visited by the learning agent, and, for each state, I have a function that generates possible actions, so ...
0
votes
1answer
18 views

How to rescale data to its original range after MinMaxScaler?

I'm using sklearn's MinMaxScaler in order to scale my data down. However, it would be nice to be able to rescale it back to its original range. Is there any way I ...
0
votes
0answers
22 views

Can simple tools like the Pascaline be considered artificial intelligence? [duplicate]

Question in Brief The popular usage (I'm not sure of exact technical usage), limits the term "artificial intelligence" to only the "high-end" tasks; as if AI has something limited to "high-end". But "...
1
vote
1answer
20 views

Understanding the reconstruction loss in the paper “Anomaly Detection using Deep Learning based Image Completion”

I would like to implement the approach represented in this paper. Here they used following reconstruction loss: $$ L(X)= \frac{\lambda \cdot || M \odot (X - F(\overline{M} \odot X)) ||_{1} + (1 - \...
2
votes
0answers
18 views

Does GraphSage use hard attention?

I was reading the recent paper Graph Representation Learning via Hard and Channel-Wise Attention Networks, where the authors claim that there is no hard attention operator for graph data. From my ...
3
votes
1answer
41 views

How does RL based neural architecture search work?

I have read through many of the papers and articles linked in this thread but I haven't been able to find an answer to my question. I have built some small RL networks and I understand how REINFORCE ...
6
votes
1answer
128 views

How to stay a up-to-date researcher in ML/RL community?

As a student who wants to work on machine learning, I would like to know how it is possible to start my studies and how to follow it to stay up-to-date. For example, I am willing to work on RL and MAB ...
0
votes
0answers
8 views

How to slowdown the Eaters example in SOAR?

Recently, I've discovered that the SOAR cognitive architecture comes with built-in examples which are Eaters (a pacman clone) and Tanksoar (which is a Robocode like game).[1] After loading two agents ...
2
votes
1answer
18 views

Using heuristic dense rewards in a sparse problem

If I am training an agent to try and navigate a maze as fast as possible, a simple reward would be something like \begin{align} R(\text{terminal}) &= N - \text{time}\ \ , \ \ N \gg \text{...
2
votes
1answer
40 views

Why do we normalize data in a deep neural network?

I have asked this question a number of times, but I always get confusing answers to this, like "normalized data works better", "data lives in the same scale" How can ...
2
votes
1answer
25 views

Is a multi-layer Kohonen network possible?

The Kohonen network is one fully connected layer, which clusters the input into classes by a given metric. However, the one layer does not allow to operate with complex relations, that's why deep ...
0
votes
0answers
18 views

How can I do entity recognition given the features?

I constructed the features from this tutorial: https://sklearn-crfsuite.readthedocs.io/en/latest/tutorial.html#features. But I did not understand the process of making the model. After doing the ...
1
vote
0answers
16 views

Improving the performance of a DNN model

I have been executing an open-source Text-to-speech system Ossian. It uses feed forward DNNs for it's acoustic modeling. The error graph I've got after running the acoustic model looks like this: ...
0
votes
0answers
13 views

Is a Q&A web application content good to be used to train a closed domain chat-bot?

Background I am currently trying to implement Stack Overflow for Teams where I work and this should cover Q & As about various topics from administrative / HR to internal programming questions. ...
0
votes
0answers
7 views

Imbalance large dataset with keras using flow from directory

I want to detect dataset bias, and for that, the first approach is to build a model that can recognize from which dataset belongs an image. I am working with Python3, with limited computing and more ...
5
votes
2answers
1k views

Was the corruption of Microsoft's “Tay” chatbot an example of catastrophic forgetting?

Tay was a chatbot, who learned from Twitter users. Microsoft's AI fam from the internet that's got zero chill. The more you talk the smarter Tay gets. — Twitter tagline. Microsoft trained the AI ...
0
votes
1answer
22 views

How can I perform multivariable regression with neural networks?

I want to use a neural network to perform a multivariable regression, where my dataset contains multiple features, but I can't for the life of me figure it out. Every kind of tutorial on the internet ...
0
votes
1answer
42 views

Can human intelligence be measured with a stop watch?

According to outdated mainstream psychology, human intelligence is equal to the IQ test result, which is the ability of a human to solve a complex task. The idea is, that human A is able to tackle a ...
3
votes
0answers
21 views

Can computers recognise “grouping” from voice tonality?

In human communication, tonality or tonal language play many complex information, including emotions and motives. But excluding such complex aspects, tonality serves some a very basic purpose of "...
1
vote
0answers
28 views

How can I solve the linkage problem in genetic algorithms?

In a genetic algorithm, the order of the genes on a chromosome can have a significant effect on the performance (capacity to generate adaptation) of the genetic algorithm, where two or more genes ...
1
vote
1answer
39 views

Several questions related to UCT and MCTS

In Bandit Based Monte-Carlo Planning, the article where UCT is introduced as a planning algorithm, there is an algorithm description in page 285 (4 of the pdf). Comparing this implementation of UCT (...
2
votes
0answers
25 views

How can I incrementally train a Yolo model without catastrophic forgetting?

I have successfully trained a Yolo model to recognize k classes. Now I want to train by adding k+1 class to the pre-trained weights (k classes) without forgetting previous k classes. Ideally, I want ...
0
votes
1answer
27 views

Why does keras model get bigger after training?

I notice that I create a model using tensorflow.keras.Sequential(), save it and the file size is around 5 MiB, but after I call ...
1
vote
1answer
17 views

Better to learn the same small set for multiple epochs then go to the next or learn from each one time repeatedly for multiple times?

I don't know if I worded the title correctly. I have a big dataset (300000 of images after augumentation) and I've splitted it into 10 parts, because I can't convert the images into a numpy and save ...
2
votes
1answer
20 views

Spikes in of Train and Test error

I learn a DNN for image recognition. During each epoch, I calculate mean loss in the training set. After each epoch, I calculate loss and number of errors over both training and test set. The problem ...
4
votes
2answers
134 views

Can a computer conclude following philosophical concepts from a story?

Say you have to enter a story to a computer. Now the computer has to identify the philosophical concept on which the story is based, say: Was it a "self-fulfilling prophecy"? Was it an example of "...
1
vote
1answer
35 views

Dropout causes too much noise for network to train

I am using dropout of different values to train my network. The problem is, dropout is contributing almost nothing to training, either causing so much noise the error never changes, or seemingly ...
2
votes
2answers
28 views

Can non-Markov environments also be deterministic?

The definition of deterministic environment I am familiar with goes as follows: The next state of the agent depends only on the current state and the action chosen by the agent. By exclusion, ...
0
votes
0answers
22 views

Which nonfictional documentaries about Artificial Intelligence are available?

From the subjective perspective, the number of documentaries about the subject Artificial Intelligence and robotics is small. It seems, that the topic is hard to visualize for the audience and in most ...
1
vote
0answers
53 views

What can be inferred about the training data from a trained neural network?

Suppose we trained a neural network on some training set that we call $X$. Given the neural network and the method of training(algorithm, hyperparameters etc.) can we infer anything about $X$. Now, ...

15 30 50 per page