As of May 31, 2023, we have updated our Code of Conduct.

Questions tagged [ai-design]

For questions related to the design of AI agents, algorithms, or models. If your question is about designing neural networks, reward functions, or fitness functions, you can use the associated more specific tags "neural-network-design", "reward-design" and "fitness-design", respectively.

Filter by
Sorted by
Tagged with
2 votes
0 answers
87 views

Which loss functions for transforming a density function to another density function?

I am looking at a problem which can be distilled as follows: I have a phenomenon which can be modeled as a probability density function which is "messy" in that it sums to unity over its support but ...
7 votes
1 answer
169 views

What technologies are needed for a self-driving car?

Google, Tesla or Apple have all built or are building their own self-driving cars. As an expert in a related area, I am interested in knowing at a high level, the systems and techniques that go into ...
4 votes
3 answers
268 views

What machine learning algorithm should be used to analyze the relationship between strings?

I am trying to build a neural network that takes in a single string, ex: "dog" as an input, and outputs 50 or so related hashtags such as, "#pug, #dogsarelife, #realbff". I have thought of using a ...
2 votes
1 answer
248 views

Is it possible to design a neural network from the plot of data points?

Suppose I have been given the following diagram I need to design a neural network to separate the points or classes. How can I do that?
24 votes
2 answers
1k views

Are there any ongoing projects which use the Stack Exchange for machine learning?

Are there any ongoing AI projects which use the Stack Exchange for machine learning?
10 votes
2 answers
836 views

Do self-driving cars resort to randomness to make decisions?

I recently heard someone make a statement that when you're designing a self-driving car, you're not building a car but really a computerized driver, so you're trying to model a human mind -- at least ...
4 votes
1 answer
53 views

Why not go another layer deeper with Auto-AutoML?

So I'm finding AutoML to be pretty interesting but I'm still learning how it all works. I've played with the incredibly broken AutoKeras and got some decent results. The question is, if you are using ...
3 votes
2 answers
144 views

Are there any discount-factors based on branching factors?

I recently came across this function: $$\sum_{t = 0}^{\infty} \gamma^t R_t.$$ It's elegant and looks to be useful in the type of deterministic, perfect-information, finite models I'm working with. ...
2 votes
0 answers
127 views

Application of Blockchain in Fraud detection in stock market

I want to develop a fraud detection application in the stock market Using Blockchain technology, we have some pattern that defines the anomaly for use of supervised machine learning but there is one ...
23 votes
1 answer
6k views

When should I use Reinforcement Learning vs PID Control?

When designing solutions to problems such as the Lunar Lander on OpenAIGym, Reinforcement Learning is a tempting means of giving the agent adequate action control so as to successfully land. But ...
3 votes
1 answer
170 views

How do I solve the problem of positioning 11 pieces into a 8x8 puzzle?

I was trying to figure out how to create a solver to the puzzle of putting 11 pieces in a board (8 x 8). I created the game in http://www.xams.com.br/quebra. It is possible to turn the piece 90 ...
10 votes
3 answers
633 views

Do I need classification or regression to predict the availability of a user given some features?

While studying data mining methods I have come to understand that there are two main categories: Predictive methods: Classification Regression Descriptive methods: Clustering Association rules ...
1 vote
0 answers
594 views

Do we need to use the experience replay buffer with the A3C algorithm?

I have skimmed through a bunch of deep learning books, but I have not yet understood whether we must use the experience replay buffer with the A3C algorithm. The approached I used is the following: ...
5 votes
2 answers
159 views

Feasibility of an AI assistant to expedite game development?

Basically, an AI that can create, rig, and texture 3d models and game environments (by extrapolating from collections of reference models, according to user input), and that can set up physics and ...
2 votes
1 answer
36 views

Adding input features - is complete re-training required?

I've never worked with very large models that require weeks or months of training, but in such a situation, what happens if you want to add extra features inputs, do you need to re-train the entire ...
2 votes
1 answer
1k views

How do I choose the number of neurons in the fully-connected layer before the softmax layer?

I am solving a classification problem with CNN. The number of classes is 5. How can I decide the number of neurons in the FC layer before the softmax layer? Is it $N * 5$, where $N$ is the number of ...
3 votes
0 answers
233 views

What can be considered a deep recurrent neural network?

In the paper Deep Recurrent Q-Learning for Partially Observable MDPs, the DRQN is described as DQN with the first post-convolutional fully-connected layer replaced by a recurrent LSTM. I have DQN ...
1 vote
0 answers
22 views

Has any research been done to solve word searches with AI?

A simple word search seems too simple to solve with a computer AI. But what I'm interested is how human's solve it. They build up strategies over the course of solving the puzzle. For example: 1) ...
10 votes
3 answers
442 views

Is there a trade-off between flexibility and efficiency?

A "general intelligence" may be capable of learning a lot of different things, but possessing capability does not equal actually having it. The "AGI" must learn...and that learning process can take ...
1 vote
3 answers
469 views

Can a program that requires feedback be considered an AI?

If I create a program which takes an input, gives an output and then requires a response to let it know whether the answer it gave was any good does it count as AI? If not, what is the process of AI?...
11 votes
2 answers
44k views

How can these 7 AI problem characteristics help me decide on an approach to a problem?

If this list1 can be used to classify problems in AI ... Decomposable to smaller or easier problems Solution steps can be ignored or undone Predictable problem universe Good solutions are ...
2 votes
1 answer
102 views

Is my Neural Network program fully connected?

I have the following program for my neural network: ...
3 votes
1 answer
166 views

Is learning possible without random thoughts and actions?

In my view intelligence begins once the thoughts/actions are logical rather than purely randomn based. The learning environments can be random but the logic seems to obey some elusive rules. There is ...
2 votes
1 answer
142 views

Relative compute time for each type of layer in a neural network [closed]

Hello, I would like to know whether this picture from the paper: Distributed Training of Deep Neural Networks: Theoretical and Practical Limits of Parallel Scalability valid? Questions: 1) Does ...
3 votes
2 answers
187 views

Is "emotion" ever used in AI?

Is "emotion" ever used in AI? Psychologists have a lot to say about emotion and it's functional utility for survival - but I've never seen any AI research that uses something resembling "emotion" ...
2 votes
2 answers
259 views

What functionality, does control look like in autonomous vehicles levels 4 and 5? [closed]

We are doing a research design project on autonomous vehicles and have some questions on AV Levels 4/5; specifically on the roles, impacts and consequences of AV on society, government, users and ...
0 votes
1 answer
228 views

Can I do oversampling by copying the same image multiple times? Will it effect my neural network accuracy?

I am working on an image data-set. As you may have guessed it is imbalanced data. I have 'Class A, 19,000 images' and 'Class B, 2,876 images'. So I did an undersampling by removing randomly from the ...
2 votes
1 answer
1k views

DQN Breakout adding an extra negative reward to help training?

I'm trying to train a DQN, so I'm using OpenAI gym and Breakout (Breakout-v0). I have altered the reward supplied by the environment: If the episode is not completed fully, the agent gets a -10 ...
15 votes
1 answer
3k views

Why does the policy network in AlphaZero work?

In AlphaZero, the policy network (or head of the network) maps game states to a distribution of the likelihood of taking each action. This distribution covers all possible actions from that state. ...
1 vote
1 answer
3k views

How to combine input from different types of data sources?

I've to train a neural network using microphone data (wav files), accelerometer sensor data and light sensor data. Right now the approach I thought was to convert all data into images and combine ...
2 votes
3 answers
103 views

Would a sentient AI try to create a more optimised AI which would eventually overtake AI 1.0?

Would AI be a self-propogating iteration in which the previous AI is destroyed by a more optimised AI child? Would the AI have branches of it's own AI warning not to create the new AI?
9 votes
4 answers
954 views

Can the English language ever be generalized using a set of grammar rules?

In programming languages, there is a set of grammar rules which govern the construction of valid statements and expressions. These rules help in parsing the programs written by the user. Can there ...
3 votes
3 answers
263 views

What type of AI would you recommend for this complex problem?

I'm trying to develop a kind of AI that will assist in debugging a large software system while we run test cases on it. The AI can get access to anything that the developers of the system can, namely ...
4 votes
1 answer
93 views

Approaches to poker tournament winner prediction?

I’ve done my research and could not find answer anywhere else. My apologies in advance if same problem is answered in different terms on stack-overflow. I am trying to solve poker tournament winner ...
2 votes
0 answers
51 views

What methods are there to detect discrimination in trained models?

I've been researching AI regulation and compliance (see my related question on law.stackexchange), and one of the big take-aways that I had is that the regulations that apply to a human will apply to ...
3 votes
2 answers
858 views

Input optimization on a supervised learning system

Problem Given a collection of pairs (X, y) where X belongs to R^n and y belongs to R, find the X such that the associated y would be maximum. Example Given: (X=(1, 2), y=-9) (X=(-2, 4), y=-36) (X=...
1 vote
1 answer
225 views

Which edges of this tree will be pruned by Alpha-beta pruning?

So I know that 'h' and 'f' will be pruned, but I'm not sure about 'k' and 'l'. When we visit 'j', technically there is no need for us to visit 'k' and 'l' because there are 2 options: one or two of ...
2 votes
1 answer
99 views

Will AI develop in hybrid ways? [closed]

There are two general ways in which AI can interact with humans: Implants of AI devices into human bodies or brains — Such implantation has already begun with health monitors and could grow to ...
2 votes
0 answers
147 views

Can this problem be solved by AI?

I am looking in to building a kind of troubleshooting web application. It would be a form that starts with a first question. Depending on the answer, you get a follow up question and so on until the ...
4 votes
1 answer
854 views

How would you encode your input vector/matrix from a sequence of moves in game like tasks to train an AI? e.g. Chess AI?

I've seen data sets for classification / regressions tasks in domains such as credit default detection, object identification in an image, stock price prediction etc. All of these data sets could ...
4 votes
2 answers
178 views

What model to use for fully unbalanced data?

I am working on an anti-fraud project. In the project, we are trying to predict the fraud user in the out time data set. But the fraud user has a very low ratio, only 3%. We expect a model with a ...
1 vote
0 answers
29 views

Whats advantages does a Loop Network have over a Feed Forward Network?

I am interested to see what advantages a Loop Network (Feed Forward Network that takes its output as input, I think it's called an RNN, not sure). The only result I found was that it was extremely ...
3 votes
1 answer
128 views

How would one go about generating *sensible* responses to chat?

I have recently gone about and made a simple AI, one that gives responses to an input (albeit completely irrelevant and nonsensical ones), using Synaptic.js. Unfortunately, this is not the type of ...
1 vote
0 answers
24 views

Social network filtering for specific topic

I created and operate a social network for meeting new people. As a result of the recent FOSTA legislation, it’s imperative that I implement an automated system to prevent users from posting ...
0 votes
1 answer
313 views

AI Self-Destruct Button

Could you implement code into an AI that can't be modified? Like if you place a code that shuts-down the program/machine would they be able to rewrite/ reinterpret the ideas?
2 votes
0 answers
101 views

NLP proved against US legal texts

I'm new to AI development and am looking for a quality algorithm (potentially nlp?) implementation proved against US legal texts. Obviously some training would need to be done, but I've found little ...
4 votes
1 answer
159 views

What approach should I use to detect faces in video game footage?

I have set myself the challenge of detecting the locations of players/bots in videos of a well known first person shooter game (this is for a youtube series I'm planning on doing). I'm not sure which ...
1 vote
2 answers
3k views

Training an AI to play Starcraft 2 with superhuman level of performance?

I'm interested in working on challenging AI problems, and after reading this article (https://deepmind.com/blog/deepmind-and-blizzard-open-starcraft-ii-ai-research-environment/) by DeepMind and ...
5 votes
2 answers
2k views

What type of neural network would be most feasible for playing a realtime game?

For implementing a neural network algorithm that can play air hockey, I had two ideas for input, and I'm trying to figure out which design would be most viable. The output must be two analog values ...
1 vote
0 answers
93 views

Data extraction from medical reports

I am new in Machine Learning. I have taken a course in vision and we are required to do a project. I am thinking of data mining medical lab report images. My code must take an image and jpg file ...