# All Questions

4,758 questions
Filter by
Sorted by
Tagged with
18 views

### What are the exact meaning of “lower-order structure” and “higher-order structure” in this paper?

I recently read a paper on community detection in networks. In the paper EdMot: An Edge Enhancement Approach for Motif-aware Community Detection, the authors consider the "lower-order structure" of ...
9 views

### How does Transformer network learn to decide in single step?

I read this In Google AI blog: link: https://ai.googleblog.com/2017/08/transformer-novel-neural-network.html S1 : " the Transformer can learn to immediately attend to the word “river” and make this ...
18 views

### How to calculate multiobjective optimization cost for ordinary problems?

What I did: Created a population of 2D legged robots in a simulated environment. Found the best motor rotation values to make the robots move rightward, using an objective function with Differential ...
57 views

### What order should I learn about Neural Networks?

I'm interested in learning about Neural Networks and implementing them. I'm particularly interested in GANs and LSTM networks. I understand perceptrons and basic Neural Network configuration (sigmoid ...
33 views

### Unable to replicate Figure 2.1 from “Reinforcement Learning: An Introduction”

The author explains in 2.2 Action-Value Methods: To roughly assess the relative effectiveness of the greedy and $\varepsilon$-greedy methods, we compared them numerically on a suite of test ...
29 views

### Is there a database of images of entire people bodies?

I wonder if anyone knows a database (preferably free) of images of different classes of people (age, gender) but with entire bodies shown on the pictures taken from different angles (mostly front and ...
44 views

### Why is embedding important in NLP, and how does autoencoder work?

People say embedding is necessary in NLP because if using just the word indices, the efficiency is not high as similar words are supposed to be related to each other. However, I still don't truly get ...
30 views

### How to control the switches of a railway track with Artificial Intelligence?

Usually, it's very complicated to program a real time strategy game from scratch. Notable examples like Lemmings or Starcraft are software projects with a large amount of codelines. A much easier ...
16 views

### Intelligent reflecting surface

I wanted to know about Intelligent reflecting surface (IRS) technology. what is the application of IRS in wireless communication? what are the competitive advantages over existing technologies?
31 views

### Why does having a fixed policy change a Markov Decision Process (MDP) to a Markov Reward Process (MRP)?

If a policy is fixed, it is said that an MDP becomes an MRP. Why is this so? Aren't the transitions and rewards still parameterized by the action and current state? In other words, aren't the ...
56 views

### Why is having low variance important in offline policy evaluation of reinforcement learning?

Intuitively, I understand that having an unbiased estimate of a policy is important because being biased just means that our estimate is distant from the truth value. However, I don't understand ...
38 views

### Why do very deep non resnet architectures perform worse compared to shallower ones for the same iteration? Shouldn't they just train slower?

My understanding of the vanishing gradient problem in deep networks is that as backprop progresses through the layers the gradients become small, and thus training progresses slower. I'm having a hard ...
344 views

### What are the implications of the “No Free Lunch” theorem for machine learning?

The No Free Lunch (NFL) theorem states (see the paper Coevolutionary Free Lunches by David H. Wolpert and William G. Macready) any two algorithms are equivalent when their performance is averaged ...
34 views

46 views

### How to deal with large (or NaN) neural network's weights?

My weights go from being between 0 and 1 at initialisation to exploding into the tens of thousands in the next iteration. In the 3rd iteration they become so large that only arrays of nan values are ...
38 views

### GPU/TPU acceleration for neural networks with various network topologies

I was thinking about different neural network topologies for some applications. However, I am not sure how this would affect the efficiency of hardware acceleration using GPU/TPU/some other chip. If, ...
193 views

### What are all the different kinds of neural networks used for?

I found the following neural network cheat sheet (Cheat Sheets for AI, Neural Networks, Machine Learning, Deep Learning & Big Data). What are all these different kinds of neural networks used ...
110 views

### Is randomness necessary for AI?

Is randomness (either true randomness or simulated randomness) necessary for AI? If true, does it mean "intelligence comes from randomness"? If not, can a robot lacking the ability to generate random ...
44 views

### Puzzle solving AI?

I have a book containing lots of puzzles with instructions like: ...
127 views

### What kind of neural network architecture is suitable for variable length block-like time series data?

I'm not sure what this type of data is called, so I will give an example of the type of data I am working with: A city records its inflow and outflow of different types of vehicles every hour. More ...
7 views

### How is Average Recall (AR) calculated for an object detection model?

After looking around the internet (including this paper, I cannot seem to find a satisfactory explanation of the Average Recall (AR) metric. On the COCO website, it describes AR as: "the maximum ...
13 views

### Predict the next best action based on previous lists of actions

I have the following problem. There is a software that I've written some time ago. Users enter customer's data in the system and there is a limited number of things (actions) that they can do/add - ...
34 views

### How can we conclude that an optimization algorithm is better than another one

When we test a new optimization algorithm, what the process that we need to do?For example, do we need to run the algorithm several times, and pick a best performance,i.e., in terms of accuracy, f1 ...
17 views

### Better versions of LSTM

I know recurrent neural networks for example LSTM is one of them. After LSTM different variants of LSTM have come for example GRU. I don't know about newer RNN like LSTM and GRU, so I decided to ask ...