Questions tagged [ai-design]
For questions related to the design of AI agents, algorithms or models.
114
questions with no upvoted or accepted answers
12
votes
0answers
397 views
How can Viv generate new code based on some user's query?
I have been looking into Viv, an artificial intelligent agent in development. Here is a demonstration of Viv (by Dag Kittlaus).
Based on what I understand, this AI can generate new code and execute it ...
4
votes
1answer
118 views
How can I solve the zero subset sum problem with hill climbing?
I want to solve the zero subset sum problem with the hill-climbing algorithm, but I am not sure I found a good state space for this.
Here is the problem: consider we have a set of numbers and we want ...
4
votes
0answers
26 views
What Are the key Plugins And Features to implement in AI Assistant Personal Project?
Hope you're doing great
I'm doing a personal project for android, I want to make an app in Android Studio. The App will be an AI Assistant Like Siri, Jarvis , etc. The idea in mind is to make the app ...
4
votes
2answers
48 views
What kind of output should be used for predicting angles in DNNs?
I am building a model which predicts angles as output. What are the different kinds of outputs that can be used to predict angles?
For example,
output the angle in radians
cyclic nature of the ...
4
votes
1answer
283 views
Building AI from chess - data shape from simulation
Problem
My problem is the following: Given 1000 wins, losses, and ties from a chess simulation I am using, what shape should each game be (I.e., sequence of moves leading to win/loss/tie) in order to ...
4
votes
0answers
56 views
How to use Machine Learning to create a “Draw-A-Person Test”
The process revolves around a child's drawing. Each part of each drawing corresponds to a score as in the Draw a Person Test conceived by Dr. Florence Goodenough in 1926. The goal of the machine is to ...
4
votes
0answers
98 views
Whats the correct technique/technology to identify duplicate data
We store supplier information for many companies. Each supplier database is logically separated, making it possible for a supplier to be common across logical separations.
At the moment, we have ...
4
votes
1answer
116 views
Is it possible to verify SOP of call center conversation using AI?
As we know in call centers there are certain SOP(standard operating procedure), for example few are below,
Agent greeted customer
Agent verified the validity of customer before providing sensitive ...
3
votes
0answers
52 views
Which machine learning method can take a matrix as input?
I am pretty new to the machine learning field. I want to use an $n \times m$ matrix as the input of a model, in order to predict a vector $1 \times m$, both of real numbers. Input data are quite clean,...
3
votes
0answers
76 views
What are the guidelines for defining a reward function in reinforcement learning (bandit problem)?
I'm working currently on a problem and I'm using RL (bandit problem).
In my system, I have an agent that chooses an action among $k$ possible actions, and a user that decides whether the agent ...
3
votes
1answer
74 views
Is a basic neural network architecture better with small datasets?
I'm currently trying to predict 1 output value with 52 input values. The problem is that I only have around 100 rows of data that I can use.
Will I get more accurate results when I use a small ...
3
votes
0answers
207 views
How to define an action space when an agent can take multiple sub-actions in a step?
I'm attempting to design an action space in OpenAI's gym and hitting the following roadblock. I've looked at this post which is closely related but subtly different.
The environment I'm writing needs ...
3
votes
0answers
56 views
What can model everything?
I've been thinking about what "mathematical model" can be used to model every possible thing (including itself).
Examples: a simple neuron network models a function but doesn't model an algorithm. A ...
3
votes
1answer
176 views
Can AI be used to reverse engineer a black box?
A while back I posted on the Reverse Engineering site about an audio DSP system whose designer had passed away and whose manufacturer no longer had source code (but the question was deleted). ...
3
votes
0answers
90 views
How can I use Q-learning for inventory decision making?
I am trying to model operational decisions in inventory control. The control policy is base stock with a fixed stock level of $S$. That is replenishment orders are placed for every demand arrival to ...
3
votes
2answers
93 views
Which online machine learning technique to use for multi-class classification problem with multiple inputs?
I have the following problem. We have $4$ separate discrete inputs, which can take any integer value between $-63$ and $63$. The output is also supposed to be a discrete value between $-63$ and $63$. ...
3
votes
0answers
168 views
What can be considered a deep recurrent neural network?
In the paper Deep Recurrent Q-Learning for Partially Observable MDPs, the DRQN is described as DQN with the first post-convolutional fully-connected layer replaced by a recurrent LSTM.
I have DQN ...
3
votes
0answers
72 views
An idea I had to create the first Humanoid using Deep Learning
I've come up with an idea on how we could use a combination of Deep Learning and body sensors to create a walking talking living humanoid. Here goes:
First, we will recruit 1 billion people and have ...
3
votes
0answers
78 views
How would I implement this New Type of NN
CIO NN
CIO NN stands for Controller Input Output Nerual Network
note due to a typo the "nearon" means "neron"
For this we have to redefine the Nearon
2 Inputs
2 Outputs
4 Weights (each input and ...
3
votes
1answer
116 views
How can I design a hierarchy of agents each of which with different goals?
I read some light material earlier about the possibility of building a hierarchy of agents, where the agents at the leaves solve primitive tasks while higher-level agents are optimized for ...
3
votes
0answers
208 views
Has anyone used YodaQA for natural language processing?
Has anyone used YodaQA for natural language processing? How easy is it to link to a document database other than Wikipedia?
We're thinking we can create a bot to use AI to analyze our developer and ...
2
votes
0answers
81 views
How to translate sudoku XV boards in CNF format?
I'm trying to implement the logic for a Sudoku XV puzzle, that it's essentially a standard sudoku with the addition of X and V markers between some pairs of squares. X markers in adjacent pairs ...
2
votes
0answers
43 views
How can I formulate a prediction problem (given labeled data) as an RL problem and solve it with Q-learning?
One of my friends sent me a problem he was working on lately, and I couldn't help but I wonder how could it be solved using Q-learning. The statement is as follows:
Given the following datasets, the ...
2
votes
0answers
31 views
Is there an online RL algorithm that receives as input a camera frame and produces an action as output?
I want to build a reinforcement learning model, which takes a camera picture as input, that learns online (in terms of machine learning). Based on the position of an object on the camera, I want the ...
2
votes
0answers
208 views
Wooden railway search problem AI
I have this problem.
A basic wooden railway set contains the pieces shown in Figure 3.32.
The task is to connect these pieces into a railway that has no overlapping tracks and no loose ends where a ...
2
votes
0answers
78 views
Which activation functions should I use for polynomial regression?
I am a beginner in machine learning and neural networks. I have only used neural networks for classification problems. My aim is to modify it so that it can work for polynomial regression as well. In ...
2
votes
1answer
42 views
A model for each sub-problem vs one model for the whole problem
Let's say one wants to use a neural net to learn some function $g(x)$. Let's say that we know that $g$ is a combination of two functions (or two sub-problems), $g(x)=f_2(f_1(x))$, and that we have two ...
2
votes
0answers
30 views
How can I formalise a non-zero-sum game of $N$ agent as Markov game?
I coded a non-zero-sum game of $N$ agents in a discrete dynamic environment to RL with Q-learning and DQN agents.
It's like a marathon. Only two actions are available per agent: $\{ G \text{ (move ...
2
votes
0answers
25 views
How should I define the reward function for the Connect Four game?
I'm creating an RL application for the game Connect Four. I've researched the different strategies for the game and which positions are more favourable to lead to a win.
Should I be assigning ...
2
votes
0answers
29 views
How can I implement a Facial Recognition algorithm in C++ from scratch, without using OpenCV?
I wanna implement an algorithm for Facial Recognition in C++ with the help of Viola-Jones, aka Adaboost, but without using OpenCV or any other similar library. I wanna do it all from scratch. Any tips?...
2
votes
0answers
26 views
How to create a best strategy AI for a specific complex ruleset?
I am new to this topic, researched a lot, but still, I have no clue which way might be the right one. As I do not have previous Expertise on this, it is very difficult for me to even find out the ...
2
votes
0answers
18 views
Language Learning feedback with AI
Is there a program under development that uses AI technology, like Siri, to "hold hands" so to speak with a language learner and coach them on accent, colloqiual expressions, or to let them guide the ...
2
votes
0answers
77 views
Is this a problem well suited for machine learning?
The light-field of a certain scene is the set of all light rays that travel through the volume of that scene at a specific point of time. A light-field camera for example captures and stores a subset ...
2
votes
0answers
45 views
How can I predict the nutrients in dishes given the ingredients used to prepare them?
I want to know which algorithm will work most efficiently for calculating nutrients present in a food dish if I am giving the ingredients used in the food. Basically, let us assume that I want to make ...
2
votes
0answers
28 views
Greedy Algorithm with State modelling
My Question
Would it be viable to implement and also how would I go about implementing something like this, "AI Agent Rating State-machine"?
Problem and constraints:
An AI Agent is tasked ...
2
votes
0answers
114 views
How can I assign agents to tasks based on time and affinity?
I am working on an assignment problem.
Consider $K$ agents $A_1, \dots A_K$ and $N$ tasks $T_1, \dots T_N$. Each task has a certain time $t(T_i)$ to be completed and each agent has a matching (or ...
2
votes
0answers
188 views
What is the state of the art AI training technique for imperfect information 2 player turn based games?
As far as I can tell (correct me if I'm wrong), Alphazero (with MCTS and neural network heuristic function RL) is the state of the art training method for turn based, deterministic, perfect ...
2
votes
0answers
22 views
A NN based model of a Cattle for 'Heat Detection'
I am very new to AI/ML but have lot of interest in these. I am trying to understand how this gadget works.
So far I have understood that a NN model of the cattle is generated by offline ...
2
votes
0answers
115 views
Coloring graphs with reinforcement learning
I am trying to build an RL agent to solve the NP-hard problem graph coloring. The problem is quite challenging.
This how I addressed it.
The environment
To preserve the scalability of the ...
2
votes
0answers
108 views
What is ratio of the objective function in the case of continuous action spaces?
I'm trying to implement the proximal policy optimization (PPO) algorithm. I'm confused on how to make it work with continuous action space.
For discrete action space, the output of the network is the ...
2
votes
0answers
49 views
How should I build an AI that quickly detects falling game assets on screen?
I want to build an AI that plays a simple android game.
The game is just a one at a time object falling, some times at an angle. The AI needs to recognize the object and to decide whether to swipe ...
2
votes
0answers
52 views
Which loss functions for transforming a density function to another density function?
I am looking at a problem which can be distilled as follows: I have a phenomenon which can be modeled as a probability density function which is "messy" in that it sums to unity over its support but ...
2
votes
0answers
107 views
Application of Blockchain in Fraud detection in stock market
I want to develop a fraud detection application in the stock market Using Blockchain technology, we have some pattern that defines the anomaly for use of supervised machine learning but there is one ...
2
votes
0answers
46 views
What methods are there to detect discrimination in trained models?
I've been researching AI regulation and compliance (see my related question on law.stackexchange), and one of the big take-aways that I had is that the regulations that apply to a human will apply to ...
2
votes
0answers
90 views
NLP proved against US legal texts
I'm new to AI development and am looking for a quality algorithm (potentially nlp?) implementation proved against US legal texts.
Obviously some training would need to be done, but I've found little ...
2
votes
0answers
98 views
Continuous Real-Time AI Simulation Loop
Due to my ignorance in this space I am not sure if a similar approach has already been proposed for what I outline below (I am not sure what terminology to even search for):
I have been doing some ...
2
votes
1answer
138 views
possible to train some model to recognize trash?
I want to build a semi autonomous robot/machine that will clean up trash in cities. For this to be possible it needs to recognize 'trash'. As trash can be all sorts of things (think ciggaret buts, ...
1
vote
0answers
50 views
How to design my Neural Network for Game AI
For my school project, I have to develop an agent to play my game.
The base I have is a 'GameManager' which call 2 AIs, each taking a random move to do.
To make my AI perform, I decided to make a ...
1
vote
0answers
27 views
How to find a parameter combination for a black box using AI?
I am working on a project where I encountered a component which takes 96 arguments (all integer values) and outputs 12 float values.
I would like to find a useful combination of these 96 values to ...
1
vote
0answers
37 views
Which is the best RL algo for continuous states but discrete action spaces problem
I am trying to train an AI with an environment where the states are continuous but the actions are discrete, that means I can not apply DDPG or TD3.
Can someone please help to let know what should be ...
