As of May 31, 2023, we have updated our Code of Conduct.

Questions tagged [ai-design]

For questions related to the design of AI agents, algorithms, or models. If your question is about designing neural networks, reward functions, or fitness functions, you can use the associated more specific tags "neural-network-design", "reward-design" and "fitness-design", respectively.

Filter by
Sorted by
Tagged with
4 votes
1 answer
267 views

How should I design the LSTM architecture for multivariate time series forecasting problems?

There is plenty of literature describing LSTMs in a lot of detail and how to use them for multi-variate or uni-variate forecasting problems. What I couldn't find though, is any papers or discussions ...
1 vote
0 answers
58 views

How should I define the state space for this life science problem?

I would like to ask for a piece of advice with regard to Q-learning. I am studying RL and would like to do a basic project applied to life science and calculate the reward. I have been trying to get ...
2 votes
0 answers
30 views

Language Learning feedback with AI

Is there a program under development that uses AI technology, like Siri, to "hold hands" so to speak with a language learner and coach them on accent, colloqiual expressions, or to let them guide the ...
2 votes
3 answers
370 views

How can we define common sense in an AI agent?

In our lives, we meet different people and describe their common sense based on how they act on a situation. For example, highly extrovert people are able to deal with people without any awkwardness. ...
3 votes
1 answer
347 views

How can I generate unique random patterns (similar to the ones in Nutella jars)?

How can I generate unique patterns, as they did for these Nutella jars? See, for example, the video Algorithm designs seven million different jars of Nutella.
1 vote
1 answer
113 views

How should I design this LSTM network to perform stock prediction?

I'm trying to develop a stock predictor. I'm using LSTM but I am unsure about the structure of the Neural Network. For example, I'm assuming that the Neural Network is a many-to-one since we have ...
2 votes
0 answers
77 views

Best AI Approach for 2D to-down space shooter

I am building a 2d top-down space game, which involves several objects, such as asteroids, drones, spaceships, space litter and power-ups. It follows the rules of space gravity, with speed and ...
3 votes
0 answers
66 views

What can model everything?

I've been thinking about what "mathematical model" can be used to model every possible thing (including itself). Examples: a simple neuron network models a function but doesn't model an algorithm. A ...
0 votes
0 answers
26 views

What are the properties of a model that is well suited for for high performance real-time inference

What are general best practices or considerations in designing a model that is optimized for real-time inference?
2 votes
0 answers
93 views

How can I predict the nutrients in dishes given the ingredients used to prepare them?

I want to know which algorithm will work most efficiently for calculating nutrients present in a food dish if I am giving the ingredients used in the food. Basically, let us assume that I want to make ...
1 vote
0 answers
134 views

Reinforcement learning for a 2D game involving two players

I'd like to create an AI for a 2D game involving two players fighting against each other. The map look something like this (The map is a NxN array somehow randomly generated): Basically the players ...
2 votes
0 answers
119 views

How can I assign agents to tasks based on time and affinity?

I am working on an assignment problem. Consider $K$ agents $A_1, \dots A_K$ and $N$ tasks $T_1, \dots T_N$. Each task has a certain time $t(T_i)$ to be completed and each agent has a matching (or ...
0 votes
0 answers
44 views

How to perform regression with multiple numeric (positive and negative) inputs and one numeric output?

I have a dataset with different types of numerical values (both negative and positive numerical values) for the inputs (for example, -40, -35, 1, 25, 39, etc., that is, multiple inputs) and single ...
1 vote
1 answer
107 views

Designing a reinforcement learning AI for a game of connect 4 [closed]

I've made a connect 4 game in javascript, and I want to design an AI for it. I made a post the other day about what output would be needed, and I think I could use images of the board and a CNN. I did ...
6 votes
1 answer
122 views

What is the relationship between robustness and adversarial machine learning?

I have been reading a lot of articles on adversarial machine learning and there are mentions of "best practices for robust machine learning". A specific example of this would be when there are ...
7 votes
2 answers
3k views

How do I create an AI for a two-players board game?

Goal I want to create an artificial intelligence to compete against other players in a board game. Game explanation I have a board game similar to 'snakes and ladders'. You have to get to a final ...
6 votes
1 answer
251 views

What does it mean to do multi-dimensional processing with tensors in tensor cores?

In some tweets about NeurIPS 2018, this video from NVIDIA appeared. At around 0.37, she says: If you think about the current computations in our deep learning systems, they are all based on Linear ...
3 votes
0 answers
93 views

How can I use Q-learning for inventory decision making?

I am trying to model operational decisions in inventory control. The control policy is base stock with a fixed stock level of $S$. That is replenishment orders are placed for every demand arrival to ...
5 votes
1 answer
360 views

Context-based gap-fill face posture-mapper GAN

These images are handmade, not auto-generated like they will be in production. Apologies for inaccuracies in the graph overlay. I am trying to build an AI like that displayed in the diagram: when ...
6 votes
1 answer
3k views

How to turn a ternary constraint into three binary constraints?

I'm trying to solve problem 6.6 from the book Artificial Intelligence: A Modern Approach, by Peter Norvig and Stuart Russell. This is in the context of Constraint Satisfaction Problem and how you can ...
4 votes
1 answer
128 views

What beginner-friendly machine learning method should I use to make teams for my pickup ultimate frisbee club fairly balanced?

A bunch of friends and I play ultimate every week. Recently I wrote a program to choose our teams for us, as well as keep track of certain data (like which players were on which team, which team won, ...
3 votes
1 answer
1k views

How can I implement an AI system that learns to recognise a context-free grammar?

Suppose I have context-free grammar (CFG) $L$ that pumps out words in that language. I want a machine learning system that can detect if a word $w$ came from $L$ or not. It has access to a stream from ...
3 votes
2 answers
157 views

How do I predict the occurrence of rare events?

I am trying to predict crime. I have data with factors: location, keyword description of the crime, time crime occurred and so on. This is for crimes that occurred in the past. I would like to treat ...
3 votes
3 answers
3k views

How to calculate the optimal placements for settlements in Catan without an ML algorithm?

Is it possible to calculate the best possible placements for settlements in Catan without using an ML algorithm? While it is trivial to simply add up the numbers surrounding the settlement (highest ...
1 vote
0 answers
91 views

How can I create a chatbot application where the user can create its own bot?

I am trying to create a chatbot application where the user can create its own bot, like Botengine. After going through google, I saw I need some NLP API to process the user's query. As per wit.ai ...
3 votes
0 answers
355 views

What is the state of the art AI training technique for imperfect information 2 player turn based games?

As far as I can tell (correct me if I'm wrong), Alphazero (with MCTS and neural network heuristic function RL) is the state of the art training method for turn based, deterministic, perfect ...
3 votes
1 answer
552 views

How to design an AI that discovers more complex concepts on its own?

How would I go about designing a (relatively) simple AI that discovers and invents random more complex concepts on its own? For example, say I had a robot car. It doesn't know it's a car. It has ...
8 votes
1 answer
460 views

How would one implement a multi-agent environment with asynchronous action and rewards per agent?

In a single agent environment, the agent takes an action, then observes the next state and reward: ...
0 votes
1 answer
42 views

How would an AI understand grids?

OK, now I think an AI must view grids in a different way to computers. For example a computer would represent a grid like this: ...
3 votes
1 answer
38 views

Image classification with an associated matrix

I have a dataset of images with 9 different classes. However, there are different categories with the same type of associated image and only can be differentiated with an associated matrix in my ...
3 votes
1 answer
95 views

How to handle multiple types of decisions?

In lots of games there are multiple phases or decision points that are not similar yet seem to have a dependency on one another when taking the perspective of the overall strategy of the player. A ...
5 votes
3 answers
73 views

What should we do when we have equal observations with different labels?

Suppose we have a labeled data set with columns $A$, $B$, and $C$ and a binary outcome variable $X$. Suppose we have rows as follows: ...
2 votes
1 answer
42 views

How to select the most appropriate set of actions for a given environment or task?

Given a robot in a situation such as in a library reading a book. Now I want to create a neural network that suggests an appropriate action in this situation. And, generally, ignore actions such as "...
1 vote
0 answers
36 views

AlphaZero value at root node not being affected by training

I have written my own AlphaZero implementation and started training it recently. Problem is, I am 99% sure there is a mistake and I do not know how to tackle this, since I cannot explain it. I am new ...
1 vote
1 answer
38 views

Excel in multiple formats

I want to use AI to extract data from spreadsheets in different format. Example ...
4 votes
1 answer
93 views

How would an AI work out this question?

I am trying to create an AI that makes reasonable guesses at truths of statements. However... Human: "Prove that no number exists which is one more than a billion." AI: "Is it true for the number 1? ...
2 votes
3 answers
668 views

One vs multiple output neurons

Consider an MLP that outputs an integer 'rating' of 0 to 4. Would it be correct to say this could be modeled in either of the following ways: map each rating in the dataset to a 'normalized set' ...
2 votes
0 answers
43 views

A NN based model of a Cattle for 'Heat Detection'

I am very new to AI/ML but have lot of interest in these. I am trying to understand how this gadget works. So far I have understood that a NN model of the cattle is generated by offline ...
2 votes
1 answer
535 views

Create an AI to solve a puzzle (by deduction)

Some puzzle games have a unique solution that can be solved by deduction rather than guesswork (e.g. Slitherlink, Masyu). Using a computer to solve this puzzle it's pretty easy, we can use a ...
1 vote
0 answers
24 views

A gated neural network for internal thought?

I have an idea for an RNN which has no separate internal memory state only an output. But there is a gate in which tells the neural network whether the output will be acted out in the physical world ...
4 votes
1 answer
478 views

How do I solve this optimal control problem with reinforcement learning?

I am new to reinforcement learning. I would like to solve an optimal control problem with reinforcement learning. The objective is for a wolf to catch a rabbit. The wolf and the rabbit run on a ...
2 votes
0 answers
252 views

Coloring graphs with reinforcement learning

I am trying to build an RL agent to solve the NP-hard problem graph coloring. The problem is quite challenging. This how I addressed it. The environment To preserve the scalability of the ...
2 votes
0 answers
136 views

What is ratio of the objective function in the case of continuous action spaces?

I'm trying to implement the proximal policy optimization (PPO) algorithm. I'm confused on how to make it work with continuous action space. For discrete action space, the output of the network is the ...
3 votes
1 answer
198 views

Is it possible to have a dynamic $Q$-function?

I am trying to use Q-learning for energy optimization. I only wish to have states that will be visited by the learning agent, and, for each state, I have a function that generates possible actions, so ...
6 votes
1 answer
87 views

Suicide Predictor and Locator

Suicide is on the increase in my country and most victims tend to leave early traces from text messages, social media accounts, search engine queries. So I came up with the idea to develop an AI ...
3 votes
1 answer
109 views

How should I detect an object in a camera image?

I would like to create a model, that will tell me if one type of object is in an image or not. So, for example, I have a camera and I would like to see when one object gets into the shot. Object ...
1 vote
1 answer
191 views

How to deal with invalid output in a policy network? [duplicate]

I am interested in creating a neural network-based engine for chess. It uses a $8 \times 8 \times 73$ output space for each possible move as proposed in the Alpha Zero paper: Mastering Chess and Shogi ...
1 vote
0 answers
51 views

Can an AI simulate someone that is diagnosed as "Special Needs"?

Do you think it would be possible to train an AI in such a way as to mimic/simulate someone that is diagnosed as "Special Needs"? Why? Most diagnosis and treatments for people today are subjective, ...
2 votes
0 answers
59 views

How should I build an AI that quickly detects falling game assets on screen?

I want to build an AI that plays a simple android game. The game is just a one at a time object falling, some times at an angle. The AI needs to recognize the object and to decide whether to swipe ...
14 votes
2 answers
551 views

How should I encode the structure of a neural network into a genome?

For a deterministic problem space, I need to find a neural network with the optimal node and link structure. I want to use a genetic algorithm to simulate many neural networks to find the best network ...