Questions tagged [computer-vision]

For questions related to computer vision, which is an interdisciplinary scientific field (which can e.g. use image processing techniques) that deals with how computers can be made to gain high-level understanding from digital images or videos. For example, image recognition (that is, the identification of the type of objects in an image) is a computer vision problem.

Filter by
Sorted by
Tagged with
2
votes
0answers
18 views

What are the metrics to be used for unsupervised monocular depth estimation in computer vision?

I am currently replicating the results of this paper. In this paper they have not mentioned how they are evaluating the results as no ground truth is available for comparison. Same goes for other ...
1
vote
1answer
18 views

Is there a methodology for splitting up annotated orthophotos into smaller photos that retain the original bounding boxes?

I'm trying to train an object detection algorithm (i.e. YOLOv4 Scaled, Faster R-CNN) on data taken from large orthophotos. Let's say I have one class, and I label the entire orthophoto with bounding ...
0
votes
0answers
15 views

How to augment 2.5D keypoints?

I am currently working on 3D hand pose estimation. The idea is to first detect the 2.5D pose representation and then obtain 3D pose with the help of camera parameters. For some reason, I was trying to ...
2
votes
0answers
33 views

CNN leaf segmentation throught classification of edges how to improve

I am trying to design a CNN that can do pixel wise segmentation of edges leaves in dense foliage agriculture images. Such as these: On the basis of this article https://arxiv.org/pdf/1904.03124.pdf, ...
3
votes
1answer
58 views

How do you calculate KL divergence on a three-dimensional space for a Variational Autoencoder?

I'm trying to implement a variational auto-encoder (as seen in Section 3.1 here: https://arxiv.org/pdf/2004.06271.pdf). It differs from a traditional VAE because it encodes its input images to three-...
0
votes
0answers
16 views

Which F1-score is used for the semantic segmentation tasks?

I read some papers about state-of-the-art semantic segmentation models and in all of them, authors use for comparison F1-score metric, but they did not write whether they use the "micro" or &...
3
votes
1answer
51 views

How to treat (label and process) edge case inputs in machine learning?

In every computer vision project, I struggle with labeling guidelines for border cases. Benchmark datasets don't have this problem, because they are 'cleaned', but in real life unsure cases often ...
1
vote
0answers
30 views

How does the region proposal algorithm in R-CNN work? [duplicate]

I'm trying to understand R-CNN, but I'm a bit lost in the first stage (region proposal). Correct me if I'm wrong, but as far as I understand, there is an algorithm that proposes regions in the image ...
3
votes
0answers
16 views

How are Ground truth provided to each Pyramid map in RetinaNet or YOLOv3 Paper? How is the mapping of Feature Pyramids done to Ground Truth

SO the YOLO V3 and RetinaNet both uses the Feature pyramids which look something like this: (except b and e which have one ...
0
votes
0answers
20 views

Where can I find a progressively trained GAN's pretrained low-resolution models?

StyleGAN is trained progressively, meaning that it starts as a small network trained to produce 4x4 images, then a layer is added which doubles the resolution to 8x8, then 16x16, etc. The final result ...
0
votes
0answers
35 views

Can I use a CNN for template matching, so that there is robustness, as the background of the target image is not that good?

I have to extract part of a source image, then I have to check if it is similar or almost similar to any of the 10 target images, so that I can do further processing on that one specific target image, ...
1
vote
1answer
37 views

Object detection approaches without anchors and NMS

The Context From all of the problems I have worked with in computer vision, the most challenging one is the object detection. This is not because the problem itself is complex to understand or bad ...
1
vote
0answers
10 views

How to predict multiple set of coordinates (of bounding boxes) for signboards text localization through neural network?

I am creating a signboard translation application from scratch. I have images of signboards where there are multiple texts and I have the corresponding set of coordinates of bounding boxes for ...
0
votes
0answers
17 views

How does the embeddings work in vision transformer from paper?

I get the part from the paper where the image is split into P say 16x16 (smaller images) patches and then you have to ...
0
votes
0answers
13 views

Nonrealtime tracking for object detection (with or without deep features)

I've been doing a search for tracking systems based on bounding box for several days (like Sort, DeepSort, Motpy, ...). But neither is nonrealtime. My problem is based on the tracking of multiple ...
1
vote
0answers
12 views

How are the parameters $\alpha_i$ of hard attention trained?

I have a question about Show, Attend and Tell: Neural Image CaptionGeneration with Visual Attention paper by Xu. The basic mechanism of stochastic hard attention is that each pixel of the input image ...
1
vote
0answers
9 views

Aggregating 2D object detections into 3D object detections

I have a data set of 3D images with some bounding box annotations. The images are too large to train something like YOLO 3D (would run out of memory), so I instead created slices of the 3D images with ...
0
votes
0answers
16 views

Interpreting coordinates of the function from the image using Grid Lines

I have a very different kind of problem at hand. I have a function plotted on the grid lines as shown below Now, I need to get the x and y coordinates for this particular function at regular ...
1
vote
0answers
20 views

In the DeepView paper, do they use the same FCN for all depth slices AND all views?

I'm trying to replicate a paper from Google on view synthesis/lightfields from 2019: DeepView: View Synthesis with Learned Gradient Descent and this is the PDF. Basically the input to the neural ...
2
votes
0answers
36 views

What are the pros and cons of 3D CNN and 2D CNN combined with optical flow for action recognition?

For action recognition or similar tasks, one can either use 3D CNN or combine 2D CNN with optical flow. See this paper for details. Can someone tell the pros/cons of each, in terms of accuracy, cost ...
2
votes
0answers
31 views

How are nested bounding boxes handled in object detection (and in particular in the case of the SSD)?

The basic approach to non-maximum-suppression makes sense, but I am kind of confused about how you handle nested bounding boxes. Suppose you have two predicted boxes, with one completely enclosing ...
1
vote
1answer
45 views

Training a classifier on different datasets with different image conditions for different labels causes the model to infer using the background

I have an interesting problem related to training the model on two different datasets for the target feature on images taken on different conditions, which might affect the model's ability to ...
0
votes
0answers
24 views

Time series analysis using computer vision principles

I'm just starting to explore topics within computer vision and curious if there are any concepts in that area that could be applied to segmenting multivariate time series with the goal of grouping ...
2
votes
1answer
38 views

How does general image background removal AI work?

I'm well aware of the inner workings of CNN models for object detection, and although I've not worked on a semantic segmentation problem I can imagine how it works. With these types of models, we need ...
0
votes
0answers
23 views

How to build a commercial Image-Image search engine using LSH / Near Duplicate or some other algo on more than 20M images

TL;DR: HOW DO I APPLY LSH WITH A DEEP LEARNING MODEL TO BUILD A IMAGE-IMAGE SEARCH ENGINE ON >20M IMAGES? I want to build a system where I am helping my ...
1
vote
0answers
24 views

Reading Data from a Twilio Stream [closed]

I work for a video tutoring organisation that uses Twilio Video API to carry out the video class. I want to run the object detection and other computer vision models on the input stream. I am stuck at ...
1
vote
0answers
13 views

Is there a pre-trained network trained on RGB-D (4) channels? [closed]

The most used pre-trained networks for computer vision (e.g. ResNet50) are trained on 3 channels (RGB). At the same time, many cameras used in robotics return RGB-D outputs, that is including depth ...
1
vote
1answer
39 views

How to normalize for perceptual loss when training neural net from scratch?

Let's say we are training a new neural network from scratch. I calculate the mean and standard deviation of my dataset (assume I am training a fully convolutional neural net and my dataset is images) ...
0
votes
0answers
12 views

What are the best metrics for Multi-Object Tracking (MOT) evaluation and why?

I want to compare multiple computer vision Multi-Object Tracking (MOT) methods on my own dataset, so first I want to choose the best metrics for this task. I have carried out some research in ...
0
votes
0answers
11 views

Deep Unsupervised clustering on big data with no prior knowledge

I have around 3M BW images and I would like to organize them in as few clusters as possible in way which is meaningful for the dataset without any prior knowledge for this data, as they come from ...
1
vote
1answer
65 views

What is the difference between Attention Gate and CNN filters?

Attention models/gates are used to focus/pay attention to the important regions. According to this paper, the authors describe that a model with Attention Gate (AG) can be trained from scratch. Then ...
2
votes
2answers
162 views

How to calculate the distance between the camera and an object using Computer Vision?

I want to create a Deep Learning model that measures the distance between the camera and certain objects in an image. Is it possible? Please, let me know some resources related to this task.
1
vote
0answers
27 views

Is it possible to use self-supervised learning on different images for the pretext and downstream tasks?

I have just come across the idea of self-supervised learning. It seems that it is possible to get higher accuracies on downstream tasks when the network is trained on pretext tasks. Suppose that I ...
0
votes
1answer
23 views

Training a model to identify certain differences between images?

Newbie to CV here so sorry of this is basic. Here's the deal, I have a program that I run many times. and each run I produce a screenshot. I need to compare screenshots from N-1 and N runs and make ...
1
vote
2answers
63 views

Why is my Keras prediction always close to 100% for one image class?

I am using Keras (on top of TF 2.3) to train an image classifier. In some cases I have more than two classes, but often there are just two classes (either "good" or "bad"). I am ...
1
vote
0answers
18 views

Object Detection as a means of Anomaly Detection

Is it possible to train an Object Detector (e.g. SSD), to detect when something is not in the image. Imagine an assembly line that transports some objects. Each object needs to have 5 screws. If the ...
1
vote
0answers
31 views

Face detection and replacement in photos

I have 2 photos, and my goal is to detect the face in one and place it on the face of the person in the other photo- basically face detection and replacement. It's not deep fakes. It's more of a ...
1
vote
1answer
28 views

Why do we need to provide false labels to the discriminator on purpose to train GANs?

This is the tutorial that I used to learn about GANs. In this tutorial, it taught us to intentionally provide false labels to "fool" the discriminator, but does it make the discriminator ...
1
vote
1answer
37 views

How to compute dominant colors in an image?

I was trying Google Cloud's Vision API, and how the dominant colors part shows. I uploaded a sample image, and here is the results for the dominant colors. I realized it doesn't simply count pixel ...
0
votes
0answers
31 views

How does one measure image similarity using Radial Basis Kernel?

Here is the formula of a radial basis kernel $$ k\left(x_{i}, x_{j}\right)=\exp \left(-\frac{d\left(x_{i}, x_{j}\right)^{2}}{2 l^{2}}\right), $$ where $x'$ and $x$ are feature vectors. I have two very ...
1
vote
0answers
28 views

What is a “center loss”?

I have seen that a center loss is beneficial in computer vision, especially in face recognition. I have tried to understand this concept from the following material A Discriminative Feature Learning ...
0
votes
0answers
23 views

Generating data from a High-Res. RGB image for a CNN

Say I want to build a detection model that detects the existence of X or NO X. The only piece of information I have, though, is a high res. RGB image, say 100k (width) x ~1000 pixels (height). Let's ...
1
vote
0answers
12 views

Find object's location in an area using computer vision

I'm trying to see how to detect the location of a soccer ball in the field using the live camera. What are some ways to achieve this? 1- Assuming we have a fixed camera with a wide shot. How to find ...
1
vote
1answer
53 views

Why do we resize images before using them for object detection?

In object detection, we can resize images by keeping the ratio the same as the original image, which is often known as "letterbox" resize. My questions are Why do we need to resize images? ...
0
votes
0answers
40 views

Distinguishing between handwritten compound fraction and subtraction

I am working in a project named "Handwritten Math Evaluation". So what basically happens in this is that there are 11 classes of (0 - 9) and (+, -) each containing 50 clean handwritten ...
0
votes
0answers
48 views

Deep Learning based image restoration using multiple frames

Suppose we have a sequence of still images each of which has been contaminated by some particles(ex, dust/sand/smoke) making the images very poor in certain areas. What architecture would be best to ...
1
vote
1answer
40 views

Are there any known models/techniques to determine whether a person in a store is a customer or a store representative?

Are there any known models/techniques to determine whether a person in a store is a customer or a store representative? For example, customer representatives can wear uniforms and then one possible ...
1
vote
1answer
54 views

Are Markov Random Fields and Conditional Random Fields still used in computer vision?

Back before deep learning, there were a lot of different attempts at computer vision. Some involved Conditional Random Fields and Markov Random Fields, which were both computationally difficult and ...
1
vote
0answers
52 views

Computer vision - Can you put more weight on a specific part of the object?

Let's say I'm looking for any item that has a certain shape (outline) in a photo. but I can further classify it only according to particular features, that most of them are expected to be shown only ...
2
votes
2answers
230 views

What is the need for so many filters in a CNN?

Consider the following coding line related to CNNS Conv2D(64, (3,3), strides=(2, 2), padding='same') It is a convolution layer with filter size $3 \times 3$ and ...

1
2 3 4 5
8