Questions tagged [ai-design]

For questions related to the design of AI agents, algorithms or models.

Filter by
Sorted by
Tagged with
0
votes
0answers
31 views

How to create MDP (RL) environment for custom problem?

I am trying to solve scheduling of resources problem using RL/GA. I am stuck on how to create custom environment for the problem and actually carry out some tests. I read and implemented Q-Learning ...
3
votes
1answer
95 views

How can I design a hierarchy of agents each of which with different goals?

I read some light material earlier about the possibility of building a hierarchy of agents, where the agents at the leaves solve primitive tasks while higher-level agents are optimized for ...
0
votes
1answer
28 views

How to add more than 1 agent in one generation with Q Learning

Sometimes the agent learns a bit slow and you want to have multiple agents in one generation. And at each episode you'll draw on the screen only the best of them or all of them. How is that possible? ...
1
vote
1answer
33 views

How can I model and solve the Knight Tour problem with reinforcement learning?

I've read about the Knight Tour problem. And I wanted to try to solve it with a reinforcement learning algorithm with OpenAI's gym. So, I want to make a bot that can move on the chess table like the ...
3
votes
0answers
51 views

How to define an action space when an agent can take multiple sub-actions in a step?

I'm attempting to design an action space in OpenAI's gym and hitting the following roadblock. I've looked at this post which is closely related but subtly different. The environment I'm writing needs ...
1
vote
0answers
29 views

What should the action space for the card game Crib be?

I'm working on creating an environment for a card game, which the agent chooses to discard certain cards in the first phase of the game, and uses the remaining cards to play with. (The game is Crib if ...
1
vote
1answer
129 views

How should I encode the input which are 5 cards from a deck of 52 cards?

How should I design my input layer for the following classification problem? Input: 5 cards (from a deck of 52 cards) in a card game; Output: some classification using a neural network How ...
2
votes
1answer
56 views

Is there a way that helps me to architect my CNN fundamentally before training?

While we train a CNN model we often experiment with the number of filters, the number of convolutional layers, FC layers, filter size, sometimes stride, activation function, etc. More often than not ...
4
votes
2answers
77 views

How can I design an AI that knows when its being spoken to?

I am trying to make an intelligent agent similar to Jarvis from Iron Man, but much less complex. However, I want my AI to be able to determine if I am talking to it or not. So, I plan on having it ...
1
vote
0answers
16 views

Is there an AI tool to reverse engineer scanned data to obtain its CAD file?

Today, if you scan an object and want its CAD file (Solidworks/Autocad), you need to use reverse engineering software (Geomagic). This takes time and you need experience of the software tools. Is ...
1
vote
1answer
53 views

What AI designs are suited for producing title replacements?

Problem: "For a given news article, generate another title for the article if the article is to be published under a different Publication." Which algorithm will be well suited for this? Should I use ...
3
votes
0answers
30 views

Which machine learning method can take a matrix as input?

I am pretty new to the machine learning field. I want to use an $n \times m$ matrix as the input of a model, in order to predict a vector $1 \times m$, both of real numbers. Input data are quite clean,...
1
vote
1answer
32 views

How would you build an AI to output the primary concept of a paragraph?

My thinking is you input a paragraph, or sentence, and the program can boil it down to the primary concept(s). Example: Input: Sure, it would be nice if morality was simply a navigation toward ...
4
votes
1answer
30 views

How can I make ELIZA more realistic?

I’ve coded a simple ELIZA chatbot for a high school coding competition. The chatbot is part of an app that’s designed to help its user cope with depression, anxiety, and similar mental health ...
2
votes
0answers
20 views

Is there an online RL algorithm that receives as input a camera frame and produces an action as output?

I want to build a reinforcement learning model, which takes a camera picture as input, that learns online (in terms of machine learning). Based on the position of an object on the camera, I want the ...
1
vote
1answer
82 views

Are there some guidelines for designing the architecture of neural networks?

I started to study neural networks recently. I understand how I should define the input and output layers. But I can't find any guidelines on how to build hidden layers. More concretely, for each ...
1
vote
1answer
67 views

How many layers and neurons on the layers does a neural network need for for sales prediction?

The inputs (features) and expected output for my ANN are these: Input 1: Product id (number, cast to double) Input 2: Year in the past (1900..2017, cast to double) Input 3: Month of year (1..12, cast ...
3
votes
1answer
183 views

How does one even begin to mathematically model an AI algorithm?

How does one even begin to mathematically model an AI algorithm, like alpha-beta pruning or even its thousands of variations, to determine which variation is best?
2
votes
0answers
48 views

Wooden railway search problem AI

I have this problem. A basic wooden railway set contains the pieces shown in Figure 3.32. The task is to connect these pieces into a railway that has no overlapping tracks and no loose ...
1
vote
1answer
41 views

What AI conferences in Europe should I consider submitting papers to explaining the ongoing work on RefPerSys?

https://afia.asso.fr/journee-hommage-j-pitrat/ is a seminar on March 6th, 2020, in Paris (France, European Union), in honor of the late Jacques Pitrat, who advocated during all his professional life a ...
2
votes
0answers
28 views

Which activation functions should I use for polynomial regression?

I am a beginner in machine learning and neural networks. I have only used neural networks for classification problems. My aim is to modify it so that it can work for polynomial regression as well. In ...
1
vote
0answers
26 views

How to approach learning(deeper understanding) about AI? [closed]

I already took an undergrad class about AI. We used AIMA as a reference and CS 188 course materials from UC Berkeley. My issue with learning is that we took a very shallow approach to learning about ...
1
vote
1answer
111 views

Can AI be used to reverse engineer a black box?

A while back I posted on the Reverse Engineering site about an audio DSP system whose designer had passed away and whose manufacturer no longer had source code (but the question was deleted). ...
1
vote
0answers
19 views

Can SqueezeNet be used for regression?

I want a model that outputs the pixel coordinates of the tip of my forefinger, and whether it's touching something or not. Those would be 3 output neurons: 2 for the X-Y coordinates and 1, with a ...
1
vote
0answers
26 views

Automating browser actions using AI

I am at a very initial stage of my research so I will try to describe what I am trying to achieve: I want to create an AI model which learns how to navigate the browser's component like clicking or ...
4
votes
1answer
104 views

Is it possible to verify SOP of call center conversation using AI?

As we know in call centers there are certain SOP(standard operating procedure), for example few are below, Agent greeted customer Agent verified the validity of customer before providing sensitive ...
1
vote
0answers
13 views

How can I design a system that suggests physical exercises to a person while keeping into account the fatigue?

I want to create an exercise suggester. Each day either has a routine or is a rest day. A routine has 4 slots. For each slot we select an exercise. We constrain the legal exercises, only do upper-body ...
1
vote
1answer
29 views

How can I process neural network with 25000 input nodes?

I'm trying to build a neural network between protein sequence and its drug fingerprint. My input size is 20000. The output size is 881. The sample size is 610. Can I process this huge neural network? ...
5
votes
2answers
76 views

Two data classes for a convolutional neural network, can one have a LOT more images for training than the other?

I have two classes in the training set: one that has images with a feature and the other of images without that feature. Can there be a LOT more images with "no feature" so I can fit in all possible ...
2
votes
1answer
36 views

What are the best classifiers for this type of data?

I would like to classify a dataset Credit Scoring, which is composed of 21 attributes, some of them are numeric and others are boolean. For the output, I want to know if they have a good or bad ...
2
votes
1answer
30 views

A model for each sub-problem vs one model for the whole problem

Let's say one wants to use a neural net to learn some function $g(x)$. Let's say that we know that $g$ is a combination of two functions (or two sub-problems), $g(x)=f_2(f_1(x))$, and that we have two ...
1
vote
0answers
30 views

How can I approximate a function that determines the priority of objects?

I am facing the following supervised learning problem: An object is fully characterized by its position in $R^n$. There are $m$ objects. There are fully observable (i.e. their positions are always ...
1
vote
0answers
21 views

How do we determine the membership functions and values for this problem?

The goal of our project is to identify the quality of a grain and we have two values, A and B. ...
5
votes
2answers
1k views

Should the prediction of the body temperature given a camera image be modelled as classification or regression?

I am fairly new to deep learning in general and I am currently facing a problem I want to solve using neural networks and I am unsure if it is a classification or regression problem. I am aware that ...
4
votes
2answers
37 views

What kind of output should be used for predicting angles in DNNs?

I am building a model which predicts angles as output. What are the different kinds of outputs that can be used to predict angles? For example, output the angle in radians cyclic nature of the ...
1
vote
0answers
20 views

What should be a good playing strategy in this 2-player simultaneous game?

This is a bot making problem from here. I am detailing the problem. The picture above shows the initial configuration of the game. P1 represents player1 and P2 represents player2. A scotch bottle is ...
1
vote
0answers
22 views

How can I design a DQN or policy gradient model to explore and collect all optimal solutions?

I am working to use DQN and Policy Gradient reinforcement learning models to solve classic maze escaping problems. So far, I have been able to train a model, which, after around 100 episodes, ...
4
votes
1answer
58 views

How can I solve the zero subset sum problem with hill climbing?

I want to solve the zero subset sum problem with the hill-climbing algorithm, but I am not sure I found a good state space for this. Here is the problem: consider we have a set of numbers and we want ...
4
votes
1answer
43 views

How should I encode a categorical input?

Let's say you have an input which can take one of 10 different unique values. How would you encode it? Have input length 10 and one-hot encode it. Have 1 input but normalise the value between the ...
1
vote
0answers
36 views

Why is the number of neurons used in various neural networks power of 2?

I have noticed that almost all tutorials take the number of neurons as a power of 2. Is there any proper mathematical and well-proven reason for that? If you sometimes change it to some other odd ...
3
votes
5answers
87 views

Which classifier should I use for a dataset with one feature?

I have a labeled dataset composed of 3000 data. Its single feature is the price of the house and its label is the number of bedrooms. Which classifier would be a good choice to classify these data?
1
vote
0answers
11 views

Leaky Discriminators and Siamese GANs

Is it useful to use Siamese network structure for GANs like sharing latent space between ...
3
votes
2answers
68 views

Which online machine learning technique to use for multi-class classification problem with multiple inputs?

I have the following problem. We have $4$ separate discrete inputs, which can take any integer value between $-63$ and $63$. The output is also supposed to be a discrete value between $-63$ and $63$. ...
2
votes
0answers
22 views

How can I formalise a non-zero-sum game of $N$ agent as Markov game?

I coded a non-zero-sum game of $N$ agents in a discrete dynamic environment to RL with Q-learning and DQN agents. It's like a marathon. Only two actions are available per agent: $\{ G \text{ (move ...
1
vote
0answers
7 views

How do I format task features with a one-hot task identification vector to ensure separate weight matrices for each task in multi-task RL?

I am on Lecture 2 of Stanford CS330 Multi-Task and Meta-learning, and on slide 10, the professor describes using a one-hot input vector to represent the task, and she also explained that there would ...
1
vote
0answers
21 views

Why is my SVM not reaching good accuracy when trained to perform binary classification of search results?

I am trying to perform binary classification of search results based on the relevance to the query. I followed this tutorial on how to make an SVM, and I got it to work with a small iris dataset. Now, ...
4
votes
2answers
93 views

Why do we need both the validation set and test set?

I know that this has been asked a hundred times before, however, I was not able to find a question (and an answer) which actually answered what I wanted to know, respectively, which explained it in a ...
3
votes
1answer
49 views

Is a basic neural network architecture better with small datasets?

I'm currently trying to predict 1 output value with 52 input values. The problem is that I only have around 100 rows of data that I can use. Will I get more accurate results when I use a small ...
1
vote
1answer
39 views

Should I be trying to create a generic or specific (to particular game) reinforcement learning agent?

I'm creating an RL application for the game Connect Four. In general, should I be aiming to create an application that's more generic, which would 'learn' different games, or specific to a ...
5
votes
1answer
238 views

Building AI from chess - data shape from simulation

Problem My problem is the following: Given 1000 wins, losses, and ties from a chess simulation I am using, what shape should each game be (I.e., sequence of moves leading to win/loss/tie) in order to ...

1
2 3 4 5
7