The Stack Overflow podcast is back! Listen to an interview with our new CEO.

Questions tagged [ai-design]

For questions related to the design of AI agents, algorithms or models.

Filter by
Sorted by
Tagged with
0
votes
0answers
22 views

What is the state of the art AI training technique for imperfect information 2 player turn based games?

As far as I can tell (correct me if I'm wrong), Alphazero (with MCTS and neural network heuristic function RL) is the state of the art training method for turn based, deterministic, perfect ...
4
votes
1answer
42 views

How would one implement a multi-agent environment with asynchronous action and rewards per agent?

In a single agent environment, the agent takes an action, then observes the next state and reward: ...
0
votes
2answers
263 views

What is it that humans can provide to AI that AI will need forever?

Just a thought question that came into mind from the current examples in the world. Any AI solution created so far for making the human effort lesser also has a tendency of no human effort at all. Are ...
0
votes
0answers
9 views

How does Transformer network learn to decide in single step?

I read this In Google AI blog: link: https://ai.googleblog.com/2017/08/transformer-novel-neural-network.html S1 : " the Transformer can learn to immediately attend to the word “river” and make this ...
0
votes
1answer
30 views

How would an AI understand grids?

OK, now I think an AI must view grids in a different way to computers. For example a computer would represent a grid like this: ...
3
votes
1answer
22 views

Image classification with an associated matrix

I have a dataset of images with 9 different classes. However, there are different categories with the same type of associated image and only can be differentiated with an associated matrix in my ...
4
votes
2answers
75 views

AI on Academic vs Industry vs Competition

When we are working on an AI project, does the background or the domain make the process different? The "domain" I mean here is like AI for academic research, AI for industry, and AI for competition. ...
3
votes
1answer
50 views

How to handle multiple types of decisions?

In lots of games there are multiple phases or decision points that are not similar yet seem to have a dependency on one another when taking the perspective of the overall strategy of the player. A ...
0
votes
0answers
13 views

AlphaZero value at root node not being affected by training

I have written my own AlphaZero implementation and started training it recently. Problem is, I am 99% sure there is a mistake and I do not know how to tackle this, since I cannot explain it. I am new ...
1
vote
1answer
40 views

Which predictive algorithm is most appropriate for a proceeding situation?

I'm new to artificial intelligence. I am looking for the most appropriate AI solution for my application, which is developing an algorithm to predict a proceeding situation (edited: I want my ...
1
vote
0answers
64 views

Learning AI and Big Data suggestion [closed]

I'm a programmer which know [php(laravel, api), mysql, html/css, javascript] I want to learn AI (machine learning). I have been researching and watching many videos on the internet. But I am getting ...
5
votes
3answers
54 views

What should we do when we have equal observations with different labels?

Suppose we have a labeled data set with columns $A$, $B$, and $C$ and a binary outcome variable $X$. Suppose we have rows as follows: ...
2
votes
1answer
30 views

How to select the most appropriate set of actions for a given environment or task?

Given a robot in a situation such as in a library reading a book. Now I want to create a neural network that suggests an appropriate action in this situation. And, generally, ignore actions such as "...
2
votes
3answers
76 views

One vs multiple output neurons

Consider an MLP that outputs an integer 'rating' of 0 to 4. Would it be correct to say this could be modeled in either of the following ways: map each rating in the dataset to a 'normalized set' ...
0
votes
1answer
55 views

Can AI be used to reverse engineer a black box?

A while back I posted on the Reverse Engineering site about an audio DSP system whose designer had passed away and whose manufacturer no longer had source code (but the question was deleted). ...
1
vote
0answers
15 views

Does behavior based robotics have a grounding problem?

Rodney brooks had invented behavior based robotics in the 1980s in response to the former symbolic AI which is using a world model. A world model needs symbolic grounding which means, that the outside ...
0
votes
1answer
32 views

Excel in multiple formats

I want to use AI to extract data from spreadsheets in different format. Example ...
0
votes
0answers
10 views

A NN based model of a Cattle for 'Heat Detection'

I am very new to AI/ML but have lot of interest in these. I am trying to understand how this gadget works. So far I have understood that a NN model of the cattle is generated by offline ...
1
vote
0answers
14 views

A gated neural network for internal thought?

I have an idea for an RNN which has no separate internal memory state only an output. But there is a gate in which tells the neural network whether the output will be acted out in the physical world ...
0
votes
0answers
26 views

What is the general architecture for a thinking machine?

Assume that there are a set of "black boxes", containing things like neural networks or sensors. I'm wondering what the general architecture for a thinking machine might be. So, for example, black ...
1
vote
1answer
45 views

Create an AI to solve a puzzle (by deduction)

Some puzzle games have a unique solution that can be solved by deduction rather than guesswork (e.g. Slitherlink, Masyu). Using a computer to solve this puzzle it's pretty easy, we can use a ...
3
votes
2answers
30 views

What kind of output should be used for predicting angles in DNNs?

I am building a model which predicts angles as output. What are the different kinds of outputs that can be used to predict angles? For example, output the angle in radians cyclic nature of the ...
1
vote
1answer
228 views

How to estimate the cost and time to complete an AI Projects

If you are a freelancer, when a client asks to create a website we can easily measure how much the total cost is needed based on the requirements of the client. (the backend, UI/UX design, features, ...
1
vote
0answers
24 views

AI for Warcraft 3 Dota

I want to create AI for Dota1. Is it possible to create AI for Warcraft 3? How Open AI works in Dota2? I want to know more about algorithms what are in foundation in Open AI.
1
vote
0answers
38 views

AI for Selenium Test Automation

I am seeking help to implement my idea on developing an automation test framework that can fix locator related issues by itself. My abstract idea is as given below. I will have a Selenium Test ...
3
votes
1answer
88 views

How do I solve this optimal control problem with reinforcement learning?

I am new to reinforcement learning. I would like to solve an optimal control problem with reinforcement learning. The objective is for a wolf to catch a rabbit. The wolf and the rabbit run on a ...
1
vote
0answers
39 views

Coloring graphs with reinforcement learning

I am trying to build an RL agent to solve the NP-hard problem graph coloring. The problem is quite challenging. This how I addressed it. The environment To preserve the scalability of the ...
4
votes
2answers
76 views

How would an AI work out this question?

I am trying to create an AI that makes reasonable guesses at truths of statements. However... Human: "Prove that no number exists which is one more than a billion." AI: "Is it true for the number 1? ...
2
votes
0answers
95 views

What is ratio of the objective function in the case of continuous action spaces?

I'm trying to implement the proximal policy optimization (PPO) algorithm. I'm confused on how to make it work with continuous action space. For discrete action space, the output of the network is the ...
3
votes
0answers
69 views

How can I use Q-learning for inventory decision making?

I am trying to model operational decisions in inventory control. The control policy is base stock with a fixed stock level $S$. That is replenishment orders are placed for every demand arrival to take ...
1
vote
1answer
47 views

How to verify your ideas for AI model

I have very practical problem. When I would like to solve some "harder" problems, I usually have multiple ideas how to solve it. My problem is, that I don't know how to verify my ideas in easy/fast ...
2
votes
1answer
24 views

Change a data compression function into prediction

I've heard prediction is equivalent to data compression. prediction (essentially equivalent to data compression) Is there a way to take a compression function and use it to create an AI that ...
3
votes
1answer
41 views

Is it possible to have a dynamic $Q$-function?

I am trying to use Q-learning for energy optimization. I only wish to have states that will be visited by the learning agent, and, for each state, I have a function that generates possible actions, so ...
6
votes
1answer
78 views

Suicide Predictor and Locator

Suicide is on the increase in my country and most victims tend to leave early traces from text messages, social media accounts, search engine queries. So I came up with the idea to develop an AI ...
2
votes
1answer
51 views

How should I detect an object in a camera image?

I would like to create a model, that will tell me if one type of object is in an image or not. So, for example, I have a camera and I would like to see when one object gets into the shot. Object ...
1
vote
0answers
50 views

Can an AI simulate someone that is diagnosed as “Special Needs”?

Do you think it would be possible to train an AI in such a way as to mimic/simulate someone that is diagnosed as "Special Needs"? Why? Most diagnosis and treatments for people today are subjective, ...
2
votes
0answers
41 views

How should I build an AI that quickly detects falling game assets on screen?

I want to build an AI that plays a simple android game. The game is just a one at a time object falling, some times at an angle. The AI needs to recognize the object and to decide whether to swipe ...
2
votes
0answers
30 views

Which loss functions for transforming a density function to another density function?

I am looking at a problem which can be distilled as follows: I have a phenomenon which can be modeled as a probability density function which is "messy" in that it sums to unity over its support but ...
1
vote
0answers
13 views

Can a cognitive architecture utilized for event recognition?

Cognitive architectures like SOAR, ACT-R and Clarion are often described in the AI literature corpus. The elements of such system are oriented on human information processing. Different modules for ...
2
votes
2answers
50 views

Which online machine learning technique to use for multi-class classification problem with multiple inputs?

I have the following problem. We have $4$ separate discrete inputs, which can take any integer value between $-63$ and $63$. The output is also supposed to be a discrete value between $-63$ and $63$. ...
4
votes
1answer
40 views

Why not go another layer deeper with Auto-AutoML?

So I'm finding AutoML to be pretty interesting but I'm still learning how it all works. I've played with the incredibly broken AutoKeras and got some decent results. The question is, if you are using ...
1
vote
1answer
37 views

How to deal with invalid output in a policy network? [duplicate]

I am interested in creating a neural network-based engine for chess. It uses a $8 \times 8 \times 73$ output space for each possible move as proposed in the Alpha Zero paper: Mastering Chess and Shogi ...
1
vote
0answers
41 views

How should I deal with vector states in reinforcement learning?

I am wondering if anyone has any experience dealing with vector states, that is, a state that has multiple values. I cannot find any coding examples online and I am trying to implement Q-learning. Any ...
2
votes
0answers
91 views

Application of Blockchain in Fraud detection in stock market

I want to develop a fraud detection application in the stock market Using Blockchain technology, we have some pattern that defines the anomaly for use of supervised machine learning but there is one ...
12
votes
1answer
346 views

When should I use Reinforcement Learning vs PID Control?

When designing solutions to problems such as the Lunar Lander on OpenAIGym, Reinforcement Learning is a tempting means of giving the agent adequate action control so as to successfully land. But ...
2
votes
1answer
56 views

What are the known ways to test AI black boxes?

Is there any conmprehensive paper or site that describes an overview of the known black box testing techniques?
4
votes
1answer
106 views

Are the ideas in the paper “Governance by Glass-Box: Implementing Transparent Moral Bounds for AI Behaviour” novel?

In the paper Governance by Glass-Box: Implementing Transparent Moral Bounds for AI Behaviour, the authors seem to be presenting a black box method of testing. Are these ideas really new? Weren't these ...
3
votes
1answer
89 views

How do I solve the problem of positioning 11 pieces into a 8x8 puzzle?

I was trying to figure out how to create a solver to the puzzle of putting 11 pieces in a board (8 x 8). I created the game in http://www.xams.com.br/quebra. It is possible to turn the piece 90 ...
1
vote
0answers
54 views

Do we need to use the experience replay buffer with the A3C algorithm?

I have skimmed through a bunch of deep learning books, but I have not yet understood whether we must use the experience replay buffer with the A3C algorithm. The approached I used is the following: ...
2
votes
1answer
28 views

Adding input features - is complete re-training required?

I've never worked with very large models that require weeks or months of training, but in such a situation, what happens if you want to add extra features inputs, do you need to re-train the entire ...