# Questions tagged [robotics]

For questions and clarifications about the use of AI/ML algorithms in the field of robotics.

50 questions
Filter by
Sorted by
Tagged with
19 views

### I want to apply reinforcement learning to a manipulator. Seeking advice!

I am a university student currently studying reinforcement learning. I am trying to apply RL to a manipulator for the first time and feel a bit overwhelmed, so I would greatly appreciate any advice ...
24 views

### Are PDDL and classical planners (e.g. FF) used in industry or consumer products?

I am learning classical planning techniques, and I know many examples of robots are in books. However, I am more curious about the real-world usage of these techniques. Are PDDL and classical planners ...
1 vote
1k views

### Given an axis-angle rotation vector, how can I find the unit rotation axis and angle?

I have a robotics assignment, which I am unable to solve. Given the axis-angle rotation vector $\Theta = (2, 2, 0)$, how can I calculate the unit vector of the rotation axis $k$ and the angle $\theta$?...
1 vote
26 views

### Why some papers focus on constructing large dataset from real robots, instead of simulations?

Recently, I have seen papers about large datasets for robotics such as DROID(https://droid-dataset.github.io/) or Open X-Embodiment(https://robotics-transformer-x.github.io/). As I see, the datasets ...
44 views

### RL simulation: Does the Gym-like RL training solution fits the real-world environments?

I am new to the RL community and I am working on projects about using RL to control robots like drones to fly in the scenes. I have been using Nvidia's Issac Gym for some time, but I have a question ...
12 views

### How to calibrate IMU for large scale deployments possibly using deep neural network

We were testing our visual SLAM algorithm on robots. We were getting poor performance. Then we calculated wite noise and random walk parameters (using kalibr) for the IMU and used it in our algorithm ...
1 vote
91 views

### Which type of Machine Learning is used in robots? [closed]

Which type of Machine Learning is used in robots? Is it supervised learning or unsupervised learning or Reinforcement learning? Especially the robots that were sent in space?
21 views

### Book suggestion about deploying real deep learning models in real world

Can you suggest books about deploying machine learning algorithms on robots, especially on real time stream? I don't know how to deal with latency and other challenges that real time inference/stream ...
45 views

### What is the current state of AI regarding features of Moravec's paradox, such as sensorimotor & perception skills?

Moravec's paradox is the observation in artificial intelligence and robotics that, contrary to traditional assumptions, reasoning requires very little computation, but sensorimotor and perception ...
670 views

### Is robotic process automation related to AI/ML?

I am trying to understand if robotic process automation (RPA) is a field that requires expertise in machine learning. Do the algorithms behind RPA use machine learning except for OCR?
1 vote
368 views

### Reinforcement Learning vs Supervised Learning [duplicate]

I have never tried reinforcement learning in my life. I'm planning to apply it in robotics. I have some experiences using supervised learning mainly deep learning. So, that's mean I will use neural ...
137 views

### What would the Valkyrie AI robot do on Mars?

I was reading that the Valkyrie robot was originally designed to 'carry out search and rescue missions'. However, there were some talks to send it to Mars to assist astronauts. What kind of specific ...
274 views

### Can I train an agent with DQN, avoiding obstacles and still finding the optimal path to finish the task?

The agent is supposed to visit specific locations (which is also different each time) and it may encounters obstacles. The goal is to visit those locations with the shortest path possible without ...
196 views

### Can DQN find optimal path while avoiding random obstacles?

Can an agent trained with a DQN algorithm in a grid world, avoid obstacles (randomly appearing during the run time) and still find the optimal path to finish a task? The agent is supposed to visit ...
294 views

### What are the limitations of hierarchical reinforcement learning?

Hierarchical Reinforcement Learning is suited to tackle many complex problems such as robotics manipulation. Sticking to this example, the basic idea is that instead of learning a sequence of robotic ...
1 vote
4k views

### What are examples of applications of the Fourier transform to AI?

The (discrete and continuous) Fourier transform (FT) is used in signal processing in order to convert a signal (or function) in a certain domain (e.g. the time domain) to another domain (e.g., ...
153 views

### How can genetic programming be used for path planning?

I have been reading quite a few papers, on genetic programming and its applications, in particular, chapter 10 of "Genetic Programming: An Introduction and Tutorial, with a Survey of Techniques ...
10k views

### Are the dialogs at Sophia's (the robot) appearings scripted?

I talk about the robot from: Hanson Robotics, which was granted the right to citizenship from Saudi Arabia. I have found the following articles: Your new friend is a humanoid robot Source: ...
388 views

### How to achieve recognition of postures and gestures?

I'd like to investigate the possibility of achieving similar recognition as it's in Honda's ASIMO robotp.22 which can interpret the positioning and movement of a hand, including postures and gestures ...
176 views

### Can supervised learning be used to solve the inverted pendulum problem?

I know that reinforcement learning has been used to solve the inverted pendulum problem. Can supervised learning be used to solve the inverted pendulum problem? For example, there could be an ...
2k views

### Which algorithm is used in the robot Sophia to understand and answers the questions?

Which algorithm is used in the robot Sophia to understand and answer the questions?
1 vote
267 views

### How can I calculate the shortest path between two 2d vector points in an environment with obstacles?

I have a 2D plane, with a fixed height and width of 10M. The plane has an agent (or robot) in the point $(1, 2.2)$, and an electric outlet in the point $(8.2, 9.1)$. The plane has a series of ...
185 views

### How does Atlas from Boston Dynamics have human-like movement?

Discussing the video More Parkour Atlas, a friend asked how the robot's movement was so similar to the one from a real human and wondering how this is achieved? To my knowledge, this is not something ...
866 views

### Is it possible to implement Asimov's Three Laws of Robotics?

Would it be possible to put Asimov's three Laws of Robotics into an AI? The three laws are: A robot (or, more accurately, an AI) cannot harm a human being, or through inaction allow a human being to ...
82 views

### Difficulty in agent's learning with increasing dimensions of continuous actions

I have been working on some RL project, where the policy is controlling the robot using its joint angles.Throughout the project I have noticed some phenomenon, which caught my attention. I have ...
17 views

### How do multiple coordinate systems help in capturing invariant features?

I've been reading this paper that formulates invariant task-parametrized HSMMs. The task parameters are represented in $F$ coordinate systems defined by $\{A_j,b_j\}_{j=1}^F$, where $A_j$ denotes the ...
1 vote
14 views

60 views

### How do I choose an appropriate fitness function and hyper-parameters to train a 7-DOF arm?

I am trying to train an ANN to control a 7 Degrees-Of-Freedom arm. It should reach a target avoiding a single obstacle. Given my modeling of the situation, my input layer is composed of 12 nodes: 5 ...
1 vote
111 views

### Robot Arm Deep Q Learning Actions

Hello I am new to reinforcement learning and robotics. So far I have an understanding of the concept on 2D world. You can make agent move one step in one direction. However, how do you define movement ...
649 views

### how to normalize the state space for articulated robot environments?

What is the common representation used for the state in articulated robot environments? My first guess is that it's a set of the angles of every joint. Is that correct? My question is motivated by the ...
1 vote
100 views

### Using Artificial Intelligence for Robot movement instead of regular Inverse Kinematics

I am currently working with classical roboticists who insist on inverse kinematics, and what I (perhaps mistakenly) call the old way of thinking about robots accomplishing tasks. Much of the ...
67 views

### SEIF motion update algorithm doubt

I want to implement Sparse Extended information slam. There is four step to implement it. The algorithm is available in Probabilistic Robotics Book at page 310, Table 12.3. In this algorithm line no:...
607 views

### How have robots developed and how sophisticated might they be in the future?

We all know how robots are getting more and sophisticated and more interesting What is the future of robotics in relation to AI, how and how will AI work with robotics in improving to affect our ...
621 views

### Reinforcement learning for robotic motion planning - Problem statement ideas

I am a first-semester grad student in Robotics and have taken a course on machine learning for robotics. I am completely new to machine learning. I am to select and execute a problem statement on my ...