Questions tagged [ai-design]

For questions related to the design of AI agents, algorithms, or models. If your question is about designing neural networks, reward functions, or fitness functions, you can use the associated more specific tags "neural-network-design", "reward-design" and "fitness-design", respectively.

Filter by
Sorted by
Tagged with
1 vote
1 answer
110 views

How should I design this LSTM network to perform stock prediction?

I'm trying to develop a stock predictor. I'm using LSTM but I am unsure about the structure of the Neural Network. For example, I'm assuming that the Neural Network is a many-to-one since we have ...
2 votes
0 answers
77 views

Best AI Approach for 2D to-down space shooter

I am building a 2d top-down space game, which involves several objects, such as asteroids, drones, spaceships, space litter and power-ups. It follows the rules of space gravity, with speed and ...
2 votes
2 answers
79 views

How to track performance of your model during experimenting? [closed]

During weeks and months of your work, many things may change, for example : You may modify the loss function Your training or validation datasets may change You modify data augmentation Which tools ...
3 votes
0 answers
65 views

What can model everything?

I've been thinking about what "mathematical model" can be used to model every possible thing (including itself). Examples: a simple neuron network models a function but doesn't model an algorithm. A ...
0 votes
0 answers
26 views

What are the properties of a model that is well suited for for high performance real-time inference

What are general best practices or considerations in designing a model that is optimized for real-time inference?
2 votes
0 answers
87 views

How can I predict the nutrients in dishes given the ingredients used to prepare them?

I want to know which algorithm will work most efficiently for calculating nutrients present in a food dish if I am giving the ingredients used in the food. Basically, let us assume that I want to make ...
1 vote
0 answers
131 views

Reinforcement learning for a 2D game involving two players

I'd like to create an AI for a 2D game involving two players fighting against each other. The map look something like this (The map is a NxN array somehow randomly generated): Basically the players ...
  • 166
0 votes
0 answers
43 views

How to perform regression with multiple numeric (positive and negative) inputs and one numeric output?

I have a dataset with different types of numerical values (both negative and positive numerical values) for the inputs (for example, -40, -35, 1, 25, 39, etc., that is, multiple inputs) and single ...
1 vote
1 answer
106 views

Designing a reinforcement learning AI for a game of connect 4 [closed]

I've made a connect 4 game in javascript, and I want to design an AI for it. I made a post the other day about what output would be needed, and I think I could use images of the board and a CNN. I did ...
6 votes
1 answer
119 views

What is the relationship between robustness and adversarial machine learning?

I have been reading a lot of articles on adversarial machine learning and there are mentions of "best practices for robust machine learning". A specific example of this would be when there are ...
2 votes
1 answer
251 views

Can you build a pure CNN phoneme classification model?

I was making a simple phoneme classification model for a 10 week-long class project and I ran into a small question. Is it possible to create a model that takes a 1-second (the longest phoneme is 0.2 ...
2 votes
0 answers
119 views

How can I assign agents to tasks based on time and affinity?

I am working on an assignment problem. Consider $K$ agents $A_1, \dots A_K$ and $N$ tasks $T_1, \dots T_N$. Each task has a certain time $t(T_i)$ to be completed and each agent has a matching (or ...
5 votes
1 answer
330 views

Context-based gap-fill face posture-mapper GAN

These images are handmade, not auto-generated like they will be in production. Apologies for inaccuracies in the graph overlay. I am trying to build an AI like that displayed in the diagram: when ...
3 votes
2 answers
155 views

How do I predict the occurrence of rare events?

I am trying to predict crime. I have data with factors: location, keyword description of the crime, time crime occurred and so on. This is for crimes that occurred in the past. I would like to treat ...
  • 245
1 vote
1 answer
223 views

Which model can I use for this problem with multiple inputs and outputs?

Which model is the most appropriate for this problem with multiple inputs and outputs? The data set is A1, A2, A3, A4, A5, A6, B1, B2, B3, B4 where ...
  • 71
3 votes
3 answers
3k views

How to calculate the optimal placements for settlements in Catan without an ML algorithm?

Is it possible to calculate the best possible placements for settlements in Catan without using an ML algorithm? While it is trivial to simply add up the numbers surrounding the settlement (highest ...
1 vote
1 answer
231 views

An architecture for classifying distance from origin for a sum of vectors?

I built a three-layer neural network (first is 1D convolutional and the remaining two are linear). It takes an input of 5 angles in radians, and outputs two numbers from 0 to 1, which are respectively ...
  • 25
3 votes
0 answers
346 views

What is the state of the art AI training technique for imperfect information 2 player turn based games?

As far as I can tell (correct me if I'm wrong), Alphazero (with MCTS and neural network heuristic function RL) is the state of the art training method for turn based, deterministic, perfect ...
8 votes
1 answer
429 views

How would one implement a multi-agent environment with asynchronous action and rewards per agent?

In a single agent environment, the agent takes an action, then observes the next state and reward: ...
  • 183
0 votes
1 answer
42 views

How would an AI understand grids?

OK, now I think an AI must view grids in a different way to computers. For example a computer would represent a grid like this: ...
  • 2,156
3 votes
1 answer
38 views

Image classification with an associated matrix

I have a dataset of images with 9 different classes. However, there are different categories with the same type of associated image and only can be differentiated with an associated matrix in my ...
  • 31
4 votes
2 answers
354 views

When we are working on an AI project, does the context (academia, industry or competition) make the process different?

When we are working on an AI project, does the domain/context (academia, industry, or competition) make the process different? For example, I see in the competition most participants even winners use ...
  • 2,621
3 votes
1 answer
95 views

How to handle multiple types of decisions?

In lots of games there are multiple phases or decision points that are not similar yet seem to have a dependency on one another when taking the perspective of the overall strategy of the player. A ...
1 vote
0 answers
34 views

AlphaZero value at root node not being affected by training

I have written my own AlphaZero implementation and started training it recently. Problem is, I am 99% sure there is a mistake and I do not know how to tackle this, since I cannot explain it. I am new ...
  • 163
2 votes
1 answer
76 views

Which predictive algorithm is most appropriate for a proceeding situation?

I'm new to artificial intelligence. I am looking for the most appropriate AI solution for my application, which is developing an algorithm to predict a proceeding situation (edited: I want my ...
5 votes
3 answers
71 views

What should we do when we have equal observations with different labels?

Suppose we have a labeled data set with columns $A$, $B$, and $C$ and a binary outcome variable $X$. Suppose we have rows as follows: ...
2 votes
1 answer
42 views

How to select the most appropriate set of actions for a given environment or task?

Given a robot in a situation such as in a library reading a book. Now I want to create a neural network that suggests an appropriate action in this situation. And, generally, ignore actions such as "...
  • 2,156
2 votes
3 answers
643 views

One vs multiple output neurons

Consider an MLP that outputs an integer 'rating' of 0 to 4. Would it be correct to say this could be modeled in either of the following ways: map each rating in the dataset to a 'normalized set' ...
  • 59
3 votes
2 answers
445 views

Can AI be used to reverse engineer a black box?

A while back I posted on the Reverse Engineering site about an audio DSP system whose designer had passed away and whose manufacturer no longer had source code (but the question was deleted). ...
  • 131
1 vote
1 answer
37 views

Excel in multiple formats

I want to use AI to extract data from spreadsheets in different format. Example ...
2 votes
0 answers
40 views

A NN based model of a Cattle for 'Heat Detection'

I am very new to AI/ML but have lot of interest in these. I am trying to understand how this gadget works. So far I have understood that a NN model of the cattle is generated by offline ...
  • 121
1 vote
0 answers
23 views

A gated neural network for internal thought?

I have an idea for an RNN which has no separate internal memory state only an output. But there is a gate in which tells the neural network whether the output will be acted out in the physical world ...
  • 2,156
2 votes
1 answer
480 views

Create an AI to solve a puzzle (by deduction)

Some puzzle games have a unique solution that can be solved by deduction rather than guesswork (e.g. Slitherlink, Masyu). Using a computer to solve this puzzle it's pretty easy, we can use a ...
  • 2,621
1 vote
1 answer
386 views

How to estimate the cost and time to complete an AI Project [closed]

If you are a freelancer, when a client asks to create a website we can easily measure how much the total cost is needed based on the requirements of the client. (the backend, UI/UX design, features, ...
  • 2,621
4 votes
1 answer
471 views

How do I solve this optimal control problem with reinforcement learning?

I am new to reinforcement learning. I would like to solve an optimal control problem with reinforcement learning. The objective is for a wolf to catch a rabbit. The wolf and the rabbit run on a ...
  • 73
2 votes
0 answers
244 views

Coloring graphs with reinforcement learning

I am trying to build an RL agent to solve the NP-hard problem graph coloring. The problem is quite challenging. This how I addressed it. The environment To preserve the scalability of the ...
4 votes
1 answer
93 views

How would an AI work out this question?

I am trying to create an AI that makes reasonable guesses at truths of statements. However... Human: "Prove that no number exists which is one more than a billion." AI: "Is it true for the number 1? ...
  • 2,156
2 votes
0 answers
135 views

What is ratio of the objective function in the case of continuous action spaces?

I'm trying to implement the proximal policy optimization (PPO) algorithm. I'm confused on how to make it work with continuous action space. For discrete action space, the output of the network is the ...
3 votes
0 answers
93 views

How can I use Q-learning for inventory decision making?

I am trying to model operational decisions in inventory control. The control policy is base stock with a fixed stock level of $S$. That is replenishment orders are placed for every demand arrival to ...
  • 31
4 votes
2 answers
185 views

Can a data compression function be used to make predictions?

I've heard that prediction is equivalent to data compression. Is there a way to take a compression function and use it to create an AI that predicts?
3 votes
1 answer
192 views

Is it possible to have a dynamic $Q$-function?

I am trying to use Q-learning for energy optimization. I only wish to have states that will be visited by the learning agent, and, for each state, I have a function that generates possible actions, so ...
  • 77
6 votes
1 answer
87 views

Suicide Predictor and Locator

Suicide is on the increase in my country and most victims tend to leave early traces from text messages, social media accounts, search engine queries. So I came up with the idea to develop an AI ...
3 votes
1 answer
108 views

How should I detect an object in a camera image?

I would like to create a model, that will tell me if one type of object is in an image or not. So, for example, I have a camera and I would like to see when one object gets into the shot. Object ...
1 vote
0 answers
51 views

Can an AI simulate someone that is diagnosed as "Special Needs"?

Do you think it would be possible to train an AI in such a way as to mimic/simulate someone that is diagnosed as "Special Needs"? Why? Most diagnosis and treatments for people today are subjective, ...
  • 11
2 votes
0 answers
58 views

How should I build an AI that quickly detects falling game assets on screen?

I want to build an AI that plays a simple android game. The game is just a one at a time object falling, some times at an angle. The AI needs to recognize the object and to decide whether to swipe ...
2 votes
0 answers
83 views

Which loss functions for transforming a density function to another density function?

I am looking at a problem which can be distilled as follows: I have a phenomenon which can be modeled as a probability density function which is "messy" in that it sums to unity over its support but ...
  • 161
1 vote
1 answer
751 views

How can I encode states where the environment consists of multiple identical elements, but each is characterised by different features?

I am quite new to Deep Reinforcement Learning, and I'm trying to define states in a Reinforcement Learning problem. The environment consists of multiple identical elements, and each one of them is ...
  • 113
3 votes
2 answers
194 views

Which online machine learning technique to use for multi-class classification problem with multiple inputs?

I have the following problem. We have $4$ separate discrete inputs, which can take any integer value between $-63$ and $63$. The output is also supposed to be a discrete value between $-63$ and $63$. ...
4 votes
1 answer
53 views

Why not go another layer deeper with Auto-AutoML?

So I'm finding AutoML to be pretty interesting but I'm still learning how it all works. I've played with the incredibly broken AutoKeras and got some decent results. The question is, if you are using ...
1 vote
1 answer
176 views

How to deal with invalid output in a policy network? [duplicate]

I am interested in creating a neural network-based engine for chess. It uses a $8 \times 8 \times 73$ output space for each possible move as proposed in the Alpha Zero paper: Mastering Chess and Shogi ...
  • 11