Questions tagged [ai-design]

For questions related to the design of AI agents, algorithms or models.

Filter by
Sorted by
Tagged with
0
votes
0answers
33 views

How to create MDP (RL) environment for custom problem?

I am trying to solve scheduling of resources problem using RL/GA. I am stuck on how to create custom environment for the problem and actually carry out some tests. I read and implemented Q-Learning ...
0
votes
1answer
28 views

How to add more than 1 agent in one generation with Q Learning

Sometimes the agent learns a bit slow and you want to have multiple agents in one generation. And at each episode you'll draw on the screen only the best of them or all of them. How is that possible? ...
1
vote
1answer
33 views

How can I model and solve the Knight Tour problem with reinforcement learning?

I've read about the Knight Tour problem. And I wanted to try to solve it with a reinforcement learning algorithm with OpenAI's gym. So, I want to make a bot that can move on the chess table like the ...
1
vote
0answers
29 views

What should the action space for the card game Crib be?

I'm working on creating an environment for a card game, which the agent chooses to discard certain cards in the first phase of the game, and uses the remaining cards to play with. (The game is Crib if ...
1
vote
0answers
16 views

Is there an AI tool to reverse engineer scanned data to obtain its CAD file?

Today, if you scan an object and want its CAD file (Solidworks/Autocad), you need to use reverse engineering software (Geomagic). This takes time and you need experience of the software tools. Is ...
3
votes
0answers
32 views

Which machine learning method can take a matrix as input?

I am pretty new to the machine learning field. I want to use an $n \times m$ matrix as the input of a model, in order to predict a vector $1 \times m$, both of real numbers. Input data are quite clean,...
4
votes
1answer
30 views

How can I make ELIZA more realistic?

I’ve coded a simple ELIZA chatbot for a high school coding competition. The chatbot is part of an app that’s designed to help its user cope with depression, anxiety, and similar mental health ...
2
votes
0answers
20 views

Is there an online RL algorithm that receives as input a camera frame and produces an action as output?

I want to build a reinforcement learning model, which takes a camera picture as input, that learns online (in terms of machine learning). Based on the position of an object on the camera, I want the ...
2
votes
0answers
48 views

Wooden railway search problem AI

I have this problem. A basic wooden railway set contains the pieces shown in Figure 3.32. The task is to connect these pieces into a railway that has no overlapping tracks and no loose ...
2
votes
0answers
28 views

Which activation functions should I use for polynomial regression?

I am a beginner in machine learning and neural networks. I have only used neural networks for classification problems. My aim is to modify it so that it can work for polynomial regression as well. In ...
1
vote
0answers
26 views

How to approach learning(deeper understanding) about AI? [closed]

I already took an undergrad class about AI. We used AIMA as a reference and CS 188 course materials from UC Berkeley. My issue with learning is that we took a very shallow approach to learning about ...
1
vote
0answers
19 views

Can SqueezeNet be used for regression?

I want a model that outputs the pixel coordinates of the tip of my forefinger, and whether it's touching something or not. Those would be 3 output neurons: 2 for the X-Y coordinates and 1, with a ...
1
vote
0answers
26 views

Automating browser actions using AI

I am at a very initial stage of my research so I will try to describe what I am trying to achieve: I want to create an AI model which learns how to navigate the browser's component like clicking or ...
1
vote
0answers
13 views

How can I design a system that suggests physical exercises to a person while keeping into account the fatigue?

I want to create an exercise suggester. Each day either has a routine or is a rest day. A routine has 4 slots. For each slot we select an exercise. We constrain the legal exercises, only do upper-body ...
2
votes
1answer
37 views

What are the best classifiers for this type of data?

I would like to classify a dataset Credit Scoring, which is composed of 21 attributes, some of them are numeric and others are boolean. For the output, I want to know if they have a good or bad ...
2
votes
1answer
32 views

A model for each sub-problem vs one model for the whole problem

Let's say one wants to use a neural net to learn some function $g(x)$. Let's say that we know that $g$ is a combination of two functions (or two sub-problems), $g(x)=f_2(f_1(x))$, and that we have two ...
1
vote
0answers
30 views

How can I approximate a function that determines the priority of objects?

I am facing the following supervised learning problem: An object is fully characterized by its position in $R^n$. There are $m$ objects. There are fully observable (i.e. their positions are always ...
1
vote
0answers
21 views

How do we determine the membership functions and values for this problem?

The goal of our project is to identify the quality of a grain and we have two values, A and B. ...
1
vote
0answers
20 views

What should be a good playing strategy in this 2-player simultaneous game?

This is a bot making problem from here. I am detailing the problem. The picture above shows the initial configuration of the game. P1 represents player1 and P2 represents player2. A scotch bottle is ...
1
vote
0answers
22 views

How can I design a DQN or policy gradient model to explore and collect all optimal solutions?

I am working to use DQN and Policy Gradient reinforcement learning models to solve classic maze escaping problems. So far, I have been able to train a model, which, after around 100 episodes, ...
1
vote
0answers
36 views

Why is the number of neurons used in various neural networks power of 2?

I have noticed that almost all tutorials take the number of neurons as a power of 2. Is there any proper mathematical and well-proven reason for that? If you sometimes change it to some other odd ...
1
vote
0answers
11 views

Leaky Discriminators and Siamese GANs

Is it useful to use Siamese network structure for GANs like sharing latent space between ...
1
vote
1answer
32 views

How would you build an AI to output the primary concept of a paragraph?

My thinking is you input a paragraph, or sentence, and the program can boil it down to the primary concept(s). Example: Input: Sure, it would be nice if morality was simply a navigation toward ...
2
votes
0answers
22 views

How can I formalise a non-zero-sum game of $N$ agent as Markov game?

I coded a non-zero-sum game of $N$ agents in a discrete dynamic environment to RL with Q-learning and DQN agents. It's like a marathon. Only two actions are available per agent: $\{ G \text{ (move ...
3
votes
5answers
87 views

Which classifier should I use for a dataset with one feature?

I have a labeled dataset composed of 3000 data. Its single feature is the price of the house and its label is the number of bedrooms. Which classifier would be a good choice to classify these data?
1
vote
0answers
7 views

How do I format task features with a one-hot task identification vector to ensure separate weight matrices for each task in multi-task RL?

I am on Lecture 2 of Stanford CS330 Multi-Task and Meta-learning, and on slide 10, the professor describes using a one-hot input vector to represent the task, and she also explained that there would ...
1
vote
0answers
21 views

Why is my SVM not reaching good accuracy when trained to perform binary classification of search results?

I am trying to perform binary classification of search results based on the relevance to the query. I followed this tutorial on how to make an SVM, and I got it to work with a small iris dataset. Now, ...
4
votes
2answers
93 views

Why do we need both the validation set and test set?

I know that this has been asked a hundred times before, however, I was not able to find a question (and an answer) which actually answered what I wanted to know, respectively, which explained it in a ...
1
vote
1answer
39 views

Should I be trying to create a generic or specific (to particular game) reinforcement learning agent?

I'm creating an RL application for the game Connect Four. In general, should I be aiming to create an application that's more generic, which would 'learn' different games, or specific to a ...
2
votes
0answers
17 views

How should I define the reward function for the Connect Four game?

I'm creating an RL application for the game Connect Four. I've researched the different strategies for the game and which positions are more favourable to lead to a win. Should I be assigning ...
1
vote
0answers
21 views

How can I find the appropriate reward value for my reinforcement learning problem?

I am wondering how can I find the appropriate reward value for each specific problem. I know this is a highly empirical process, but I am sure that the value is not set totally at random. I want to ...
2
votes
0answers
18 views

How can I implement a Facial Recognition algorithm in C++ from scratch, without using OpenCV?

I wanna implement an algorithm for Facial Recognition in C++ with the help of Viola-Jones, aka Adaboost, but without using OpenCV or any other similar library. I wanna do it all from scratch. Any tips?...
1
vote
1answer
29 views

How can I process neural network with 25000 input nodes?

I'm trying to build a neural network between protein sequence and its drug fingerprint. My input size is 20000. The output size is 881. The sample size is 610. Can I process this huge neural network? ...
1
vote
1answer
30 views

How can I develop a reinforcement learning agent that plays memory cards game?

I am new to RL, and I am thinking of doing a little project. The goal of the project is to learn an agent play the memory game with cards. I already created the program for detecting the cards on the ...
2
votes
0answers
18 views

How to create a best strategy AI for a specific complex ruleset?

I am new to this topic, researched a lot, but still, I have no clue which way might be the right one. As I do not have previous Expertise on this, it is very difficult for me to even find out the ...
0
votes
0answers
28 views

Non-linear regression with a neural network

I have to perform a regression on three curves as shown in the following plot. Here, accA (y-axis) is the dependent variable, and ...
3
votes
0answers
61 views

What are the guidelines for defining a reward function in reinforcement learning (bandit problem)?

I'm working currently on a problem and I'm using RL (bandit problem). In my system, I have an agent that chooses an action among $k$ possible actions, and a user that decides whether the agent ...
4
votes
1answer
58 views

How can I solve the zero subset sum problem with hill climbing?

I want to solve the zero subset sum problem with the hill-climbing algorithm, but I am not sure I found a good state space for this. Here is the problem: consider we have a set of numbers and we want ...
1
vote
0answers
35 views

How to deal with features which are here just for training?

I'm new to the Data Science field and last week I started to learn about Neural Networks and Deep Learning. To practice, I decided to do a small project: design a Neural Network to predict the winner ...
1
vote
0answers
38 views

Use cases for AI inside the software company

This question is a bit philosophic and is about making new use cases for software companies. Let me describe what exist for now, why it is not enough, and what is needed. I know that there are a lot ...
1
vote
0answers
41 views

Which model should I choose to maximise reward of having chosen two numbers from a list?

I am looking for a technique to train a machine learning model to choose two items from a list. So, given a list $x=[x_1, x_2, x_3, x_4, \dots, x_n]$, the model needs to choose two elements $(x_i, ...
3
votes
1answer
49 views

Is a basic neural network architecture better with small datasets?

I'm currently trying to predict 1 output value with 52 input values. The problem is that I only have around 100 rows of data that I can use. Will I get more accurate results when I use a small ...
1
vote
0answers
18 views

Train an AI to infer accurate mathematical calculations by simply “looking” at images of shapes/objects

I’d like to build a model that has an understanding of geometry, where it can be applied to question and answering system. Specifically, it would be nice if it could determine the volume of an object ...
1
vote
1answer
41 views

What AI conferences in Europe should I consider submitting papers to explaining the ongoing work on RefPerSys?

https://afia.asso.fr/journee-hommage-j-pitrat/ is a seminar on March 6th, 2020, in Paris (France, European Union), in honor of the late Jacques Pitrat, who advocated during all his professional life a ...
1
vote
0answers
14 views

AI Logistic center simulation [closed]

First of all, I am pretty new to python and Ai and never realised a project before. I am a PLC-programmer with experience, but never did anything like this: I was thinking about a logistic center ...
1
vote
0answers
50 views

How should I define the state space for this life science problem?

I would like to ask for a piece of advice with regard to Q-learning. I am studying RL and would like to do a basic project applied to life science and calculate the reward. I have been trying to get ...
2
votes
0answers
14 views

Language Learning feedback with AI

Is there a program under development that uses AI technology, like Siri, to "hold hands" so to speak with a language learner and coach them on accent, colloqiual expressions, or to let them guide the ...
0
votes
0answers
30 views

What inputs would a programming AI take?

I'm trying to create an AI that makes it's own computer programs. What do you think would be good inputs? For example, one input might just be the instructions of what the program does in natural ...
3
votes
0answers
51 views

How to define an action space when an agent can take multiple sub-actions in a step?

I'm attempting to design an action space in OpenAI's gym and hitting the following roadblock. I've looked at this post which is closely related but subtly different. The environment I'm writing needs ...
1
vote
0answers
36 views

Can AI be trained to create social media post?

I am trying to conduct an experiment for fun to see if AI could be trained to create "good" social media post. I pulled examples of 1,000s "good" social media post from Facebook. Can someone point ...

1
2 3 4 5
7