Questions tagged [ai-design]

For questions related to the design of AI agents, algorithms, or models. If your question is about designing neural networks, reward functions, or fitness functions, you can use the associated more specific tags "neural-network-design", "reward-design" and "fitness-design", respectively.

Filter by
Sorted by
Tagged with
2 votes
1 answer
225 views

How to implement RAM versions of Atari games

I have coded the breakout RAM version, but, unfortunately, its highest reward was 5. I trained it for about 2 hours and never reached a higher score. The code is huge, so I can't paste here, but, in ...
1 vote
1 answer
223 views

Which model can I use for this problem with multiple inputs and outputs?

Which model is the most appropriate for this problem with multiple inputs and outputs? The data set is A1, A2, A3, A4, A5, A6, B1, B2, B3, B4 where ...
0 votes
1 answer
65 views

I understand a neural network is a program, or something similar, but what exactly does it look like while it's learning?

I'm currently working on a novel which has a neural network at its center, and I'm no expert in programming. This might be the wrong place to ask, but I was curious what it looks like if you're ...
0 votes
1 answer
94 views

Rebuild Tiktok Manga/Anime AI model

I have a task to build the Tiktok Manga/Anime AI model or the Anime AI model like Snap Edit application. I have researched and collected several models on Github, but they still are not good enough, ...
2 votes
1 answer
225 views

Is there an AI tool to reverse engineer scanned data to obtain its CAD file?

Today, if you scan an object and want its CAD file (Solidworks/Autocad), you need to use reverse engineering software (Geomagic). This takes time and you need experience of the software tools. Is ...
4 votes
3 answers
265 views

Will we be able to build an artificial intelligence that feels empathy?

Nowadays, robots or artificial agents often only perform the specific task they have been programmed to do. Will we be able to build an artificial intelligence that feels empathy, that understands ...
7 votes
2 answers
362 views

How can I solve the zero subset sum problem with hill climbing?

I want to solve the zero subset sum problem with the hill-climbing algorithm, but I am not sure I found a good state space for this. Here is the problem: consider we have a set of numbers and we want ...
1 vote
2 answers
97 views

How to train a model to predict the number of people at a certain bus stop before they cumulate in large numbers?

Each person probably uses an app that tracks his/her position periodically and sends it to our servers. What I want is to use these data to train a model to predict the rush hours of each bus-stop on ...
0 votes
1 answer
40 views

Do different architectures really make a difference or is it just a matter of the training process?

I was wondering which influence different architectures for deep learning truly have on the performance. Of course, substantial changes in the paradigms we use when building neural networks (such as ...
0 votes
1 answer
26 views

Causal Inference: Understanding the impact of an intervention

I'm trying to create a pipeline for a very common business scenerio. I want to see whats the impact of an intervention on an outcome. For example I want to know if I send a marketing email (...
2 votes
1 answer
149 views

How to translate sudoku XV boards in CNF format?

I'm trying to implement the logic for a Sudoku XV puzzle, that it's essentially a standard sudoku with the addition of X and V markers between some pairs of squares. X markers in adjacent pairs ...
0 votes
1 answer
412 views

How to do early classification of time series event with small dataset?

I would like to build a real-time binary classifier that can predict an event of interest that is occurring as soon as it starts. These are electromyographic signals, and the event classification ...
2 votes
2 answers
184 views

How to design a recommendation system for shift swapping?

I need to design an algorithm such that it handles the request for shift swapping. The algorithm will recommend a list of people who are more likely to swap that shift with the person by analyzing ...
2 votes
2 answers
72 views

How should I train the players in the game of tag?

I have a simple game of tag, where red player tries to catch the blue player. Red player wins if it catches the blue player in under 10 seconds, but if not, then blue wins. My goal is to teach the ...
0 votes
1 answer
55 views

Cross Validation and hyperparameter selection correct procedure

I am trying to run a regression supervised learning problem. The dataset is not very large and I wanted to do some cross-validation to avoid overfitting. As I have read it's important to do a ...
3 votes
2 answers
194 views

Which online machine learning technique to use for multi-class classification problem with multiple inputs?

I have the following problem. We have $4$ separate discrete inputs, which can take any integer value between $-63$ and $63$. The output is also supposed to be a discrete value between $-63$ and $63$. ...
0 votes
0 answers
24 views

Which algorithm should I use to determine if users would enjoy various restaurants?

Lets say I have lots of location-based and demographic data on a user. I know their age, what restaurants they visit most often, what they have rated them on Yelp, the type of food & ambiance they ...
0 votes
0 answers
16 views

what's the best way of Inferring probability chance of heads with a coin of Unknown Bias that changes regularly

hi what would be the best strategy to infer the range of probabilities of getting heads with a coin of Unknown Bias that is variable? I'm working on a similar problem with a game AI. I'm working on a ...
0 votes
1 answer
23 views

Is this a better formulation of the Turing test?

Would the Turing test be better formulated by assessing whether the creator (as opposed to a third party) was able to tell the difference between their program and a human? A magician, through the use ...
2 votes
2 answers
151 views

Is Computer Vision always related to Machine Learning?

So I have AI project about motion detection with image subtraction. Regardless what are the object used, if there are change between two frames according threshold ...
10 votes
2 answers
3k views

Using AI to extend an imagine pattern

I have created some nice patterns using the MidJourney tool. I'd like to find a way to extend these patterns, and I was thinking about an AI tool that takes one of these patterns and extends it in all ...
0 votes
0 answers
11 views

Best FAANG Publications on Software Development Aspects of Model Training, Deployment and Monitoring

I recently came upon this good reference from Microsoft on software development aspects of deep learning models and their operationalisation. The paper itself is based mostly on Microsoft's internal ...
0 votes
0 answers
47 views

How to Extract Specific Information From Web Pages Containing Job Postings?

I am currently working on my first research project, which is to implement machine learning based web scraping in the e-recruitement environment. Currently, I am building the dataset that needs to be ...
0 votes
0 answers
41 views

What reinforcement learning architecture is recommended for multiple outputs in continuous resource management?

I would like to develop an agent to provide resources to multiple machines simultaneously. The overall resources are limited. The agent should distribute the resources in such a way that the machines ...
0 votes
1 answer
37 views

Theoretically, how can the trait "humbleness" be incorporated into AI design, specifically Artificial General Intelligence?

On Google Scholar ("humble" and "AI") yields (About 175,000 results), while ("Humble AI") yields about 34 results. It seems that the trait of "humbleness" and ...
3 votes
1 answer
72 views

A model for each sub-problem vs one model for the whole problem

Let's say one wants to use a neural net to learn some function $g(x)$. Let's say that we know that $g$ is a combination of two functions (or two sub-problems), $g(x)=f_2(f_1(x))$, and that we have two ...
0 votes
1 answer
124 views

How to add contextual follow up like Google Assistant

I am developing PDA like Google assistant on Android. So far, so good. But now, I want to add contextual follow up like Google assistant so it can keep the train of thought. As demonstrated here- ...
2 votes
1 answer
251 views

Can you build a pure CNN phoneme classification model?

I was making a simple phoneme classification model for a 10 week-long class project and I ran into a small question. Is it possible to create a model that takes a 1-second (the longest phoneme is 0.2 ...
0 votes
0 answers
557 views

Which is the best RL algo for continuous states but discrete action spaces problem

I am trying to train an AI with an environment where the states are continuous but the actions are discrete, that means I can not apply DDPG or TD3. Can someone please help to let know what should be ...
4 votes
1 answer
208 views

Which machine learning method can take a matrix as input?

I am pretty new to the machine learning field. I want to use an $n \times m$ matrix as the input of a model, in order to predict a vector $1 \times m$, both of real numbers. Input data are quite clean,...
3 votes
3 answers
460 views

How could human behavior and relationships be implemented? [closed]

One of the most compelling issues regarding AI would be in behavior and relationships. What are some of the methods to address this? For example, friendship, or laughing at joke? The concept of ...
1 vote
1 answer
231 views

An architecture for classifying distance from origin for a sum of vectors?

I built a three-layer neural network (first is 1D convolutional and the remaining two are linear). It takes an input of 5 angles in radians, and outputs two numbers from 0 to 1, which are respectively ...
1 vote
2 answers
573 views

Musical notes interpretation [closed]

Musical notes Musical notes videos Piano Can AI, Machine learning, Data science, Computer vision, image processing technologies assist in interpreting musical notes ? Input dataset : Musical notes ...
1 vote
0 answers
82 views

How to represent multiple-output logic circuits in tree-based genetic programming

Consider the following digital logic circuit, which has multiple inputs and one output: The logic circuit above can be represented in tree form: This tree representation could then be used in a tree-...
2 votes
0 answers
118 views

What to look out for when designing an environment regarding observations?

When designing an environment, what should one look out for when designing the observation space to make the environment as easy to be learnable for an agent as possible? E.g. make sure the markov ...
3 votes
2 answers
445 views

Can AI be used to reverse engineer a black box?

A while back I posted on the Reverse Engineering site about an audio DSP system whose designer had passed away and whose manufacturer no longer had source code (but the question was deleted). ...
4 votes
2 answers
354 views

When we are working on an AI project, does the context (academia, industry or competition) make the process different?

When we are working on an AI project, does the domain/context (academia, industry, or competition) make the process different? For example, I see in the competition most participants even winners use ...
4 votes
2 answers
290 views

Are Neural Net architectures accidental discoveries?

Recently, I have been learning about new neural networks, which are used for specialized purposes, like speech recognition, image recognition, etc. The more I discover the more I get amazed by the ...
-1 votes
1 answer
180 views

Do I need a large pool of training data to train a bot to play the 'pegging' game in the cribbage card game

The game of cribbage https://en.wikipedia.org/wiki/Cribbage is a two-player card game played over a series of deal with the goal to reach 121 points. The game's elements are: the discard. There are ...
1 vote
0 answers
42 views

How to find a parameter combination for a black box using AI?

I am working on a project where I encountered a component which takes 96 arguments (all integer values) and outputs 12 float values. I would like to find a useful combination of these 96 values to ...
2 votes
1 answer
91 views

What components of reinforcement learning influence the result the most?

I'm working on my thesis concerning a reinforcement learning problem and am trying to prioritise my time on different components of it: Formalising the agent environment (like the design of state-, ...
0 votes
0 answers
83 views

Any RL approaches for this 2D space optimization problem?

I have a list of rectangles, they are in a certain order in 2D at the beginning. The task is to move them to get the boundary (rectangular) of the minimal area. It's OK to push off the dotted border ...
1 vote
0 answers
27 views

Derive information for sub-scoring from one scoring model

I am currently working in Python with a random forest algorithm to perform a scoring. My output is binary. The idea now is to derive sub-scores from the above model that give an opinion on different ...
19 votes
2 answers
15k views

How to define states in reinforcement learning?

I am studying reinforcement learning and the variants of it. I am starting to get an understanding of how the algorithms work and how they apply to an MDP. What I don't understand is the process of ...
9 votes
3 answers
2k views

How should I represent the input to a neural network for the games of tic-tac-toe, checkers or chess?

I've been reading a lot about TD-Gammon recently as I'm exploring options for AI in a video game I'm making. The video game is a turn-based positional sort of game, i.e. a "units", or game ...
2 votes
1 answer
150 views

What is the place of ontologies in artificial intelligence?

Very much a general question here, from a somewhat uneducated perspective. I'm currently part way through an MSc in AI, and at the minute I am taking a module on Knowledge Engineering and ...
1 vote
0 answers
97 views

Might AGI need to be flawed?

An example is the halting problem, which states computing cannot be solved by exhaustion, but which humans avoid trivially by becoming exhausted. Humans typically give up what seems like a lost cause ...
0 votes
1 answer
105 views

Appropriate ML algorithm to solve a cutting pattern problem

I have a rectangular area, where I need to place some 2 dimensional geometrical shapes - like a square or circle or a little more complicated shapes. And after the arrangement these shapes should be ...
3 votes
1 answer
1k views

Why do we need both encoder and decoder in sequence to sequence prediction?

Why do we need both encoder and decoder in sequence to sequence prediction? We could just have a single RNN that, given input $x$, outputs some value $y(t)$ and hidden state $h(t)$. Next, given $h(t)$...
5 votes
2 answers
498 views

Should I repeat lengthy deep learning experiments to average results ? How to decide how many times to repeat?

I am doing my MSc thesis on deep learning. My model takes many hours to train. Part of what I do is trying different parameters and settings hoping that they will achieve different results. But I ...

1
2 3 4 5 6