Questions tagged [image-segmentation]
For questions related to image segmentation (in computer vision and related AI fields).
121
questions
0
votes
0
answers
15
views
Image segmentation with noisy labels
I have a dataset which consists of satellite images and their labels which are indicated by let say class 1 and 2. I want to perform image segmentation to detect pixels related to class 1 and 2. The ...
0
votes
2
answers
35
views
Should I define my problem as image segmentation or detection?
I have a problem and have to decide wether it's an object detection or object segmentation problem. I want to use Yolov8 for training. We already have hundrets of images but they aren't labeled yet. ...
0
votes
1
answer
85
views
How to accurately detect grid cell boundaries in Python image processing?
I'm working on a Python algorithm to detect individual cells of a grid passed by an image. Currently, I'm facing an issue where the values inside each cell are being selected as contours along with ...
0
votes
0
answers
21
views
When to know if I am "on the right track" for a CNN architecture
Context
Very new to CNNs and ML in general. I am building a simple binary image segmentation network for generating black and white image masks (white pixels = desired object; black pixels = all else)....
0
votes
0
answers
28
views
How can you add additional features/attributes while doing instance segmentation?
I want to do an instance segmentation of objects in images.
Usually I would stick to something like an Mask R CNN and let it run. However additionally to the image itself and the pre-labeled images, I ...
0
votes
1
answer
47
views
Binary instance segmentation - does the masks have to be complete
I am wondering if it is required or not that the masks used for binary instance segmentation are complete.
For instance, I want to find the buildings in aerial imagery. If my masks cover, let say ...
0
votes
1
answer
88
views
Image segmentation with varying resolution
I am looking to create a model that is able to perform binary segmentation of images with varying resolutions. For model should be able to classify tree or not tree regardless of the resolution of the ...
0
votes
1
answer
52
views
How to add engineered features to an image segmentation model
I have built a U-net model for image segmentation of 3-channel remote sensing images. I have a total of four classes; two of these classes look very similar and are hard to distinguish in the images ...
0
votes
0
answers
35
views
What is the best type of input for a 3D UNet?
I want to use 3D U-Net (or similar) network to create a 3D reconstruction of my microscopy data.
The original paper for the 3D U-Net (https://arxiv.org/abs/1606.06650) describes the implementation ...
0
votes
0
answers
39
views
Batch Normalization Layer is not learning the data semantics of a dataset comprised of datasets from different sources
I have built a dataset for image segmentation that is comprised of datasets from several different sources.
Almost all of my models have problems with learning the correct parameters of the ...
0
votes
0
answers
135
views
Use AI/Computer Vision to detect scene changes
I'm trying to use AI and computer vision techniques to identify scene changes for a camera. Something like this:
What are some approaches to do this? Any ideas?
The scene is static. Somewhere I saw a ...
0
votes
1
answer
26
views
Should I apply a min-max scale (range 0 to 1) before applying the normalisation or should I apply the z-score normalisation directly?
I want to implement a neural network in Pytorch for medical image segmentation. I should normalise my data.
Should I apply a min-max scale (range 0 to 1) before applying the normalisation or should I ...
0
votes
0
answers
58
views
What is the best approach to remove this additional container from the cropped image?
I'm working on a computer vision application in Python to analyze images of ice cream cuttings to measure the amount of variegate(ie. fruit syrup or fudge) compared to the base ice cream. My approach ...
0
votes
0
answers
32
views
how to preprocess satellite imagery for semantic segmentation?
I have to train binary semantic segmentation in Python(using Tenforflow, rasterio, geopandas, sh). And I have raster .tif images and vector .shp images which is mask. I know that I should divide each ...
0
votes
0
answers
168
views
Clustering bounding boxes to reduce image cutout overlap
Given an image and bounding boxes identified within this image, the objective is to group these bounding boxes in such as way that we can define a bigger bounding box of size NxN that will encompass ...
2
votes
1
answer
86
views
How can I tell a CNN to ignore nodata values in satellite images?
I'm trying to train an image segmentation model on satellite images. There are two main issues: first, not all of the images are the same size. My understanding is that by using a fully convolutional ...
0
votes
1
answer
174
views
Should softmax be in the model or in the loss function?
Suppose I have an image segmentation model with an output of [ 128, 128, 2 ], segmenting an input image into 2 parts.
Commonly, loss functions have the sigmoid or ...
1
vote
0
answers
28
views
Creating border around specific areas of images
I have some 1000+ image, containing data like this
Red area: Symbols
Grey area: Text describing the symbol
Note: I draw these red/grey boxes just for visualization only.
Each symbol is unique in this ...
2
votes
0
answers
79
views
How does one deal with images that are too large to fit in the GPU memory for doing ML image analysis?
How does one deal with images that are too large to fit in the GPU memory for doing ML image analysis?
I am interested in detecting small structures on images which are themselves many GB in size. ...
0
votes
0
answers
50
views
Document Processing using AI
Deal all
I want to Build a Document Processing AI Model
1-that Identify Document Elements
Like table, Text , List , Heading , etc.
2-Sort this element in correct way if I wan to dump this data as XML
...
0
votes
1
answer
3k
views
What's the difference between classification and segmentation in deep learning?
What's the difference between classification and segmentation in deep learning?
In particular, can the classification loss function be used for segmentation problems?
1
vote
0
answers
29
views
Latest status on stability of CNN architectures to noise and "clever hans" issues
I was working with CNN architectures for image segmentation a few years ago, and I remember there was a big concern about on the stability of the predicted masks due to the introduction of small ...
0
votes
1
answer
71
views
Segmentation of x-ray images to detect Covid-19
I’m currently working on covid detection project using x-rays. I applied K -means clustering algorithm (https://www.kaggle.com/code/naim99/image-classification-clustering-step-by-step?scriptVersionId=...
1
vote
1
answer
125
views
How does accuracy (for a single class of interest) of a segmentation network vary with increasing number of classes?
BACKGROUND: I have a real world problem of developing a U-net-like model for segmenting lung tumors in lung CT images.
On the one hand, I can make this a two class problem:
...
1
vote
1
answer
46
views
possible to combine multiple labeled objects as one object?
So I have labeled the entire skeletal muscles in detail. For example instead of just labeling shoulders I have labeled:
Rear Delt
Middle Delt
Front Delt
but now you want all of the delts to be ...
1
vote
2
answers
437
views
Are masks needed for images that don't contain the object of interest in (binary) Image Segmentation tasks?
Total Dataset :- 100 (on case level)
Training :- 76 cases (18000 slices)
Validation :- 19 cases (4000 slices)
Test :- 5 cases (2000 slices)
I have a dataset that consists of approx. Eighteen thousand ...
-1
votes
1
answer
74
views
Extract a document page from a photo
I am trying to extract a document as an image from another image. Let's say that we take a photo of a document on a surface. My ultimate goal is to be able to digitize this document but as an image, ...
0
votes
1
answer
95
views
How to incorporate domain knowledge into a semantic segmentation network?
I'm working on a semantic segmentation project, and want to add some domain knowledge to the system. I want to ensure that for segmentation, there can only be one group of pixels that are predicted as ...
0
votes
2
answers
681
views
Using pre-trained models on image dataset that is totally different for object detection?
I have been trying out various tutorials on object detection machine learning. All the tutorials so far have been to use a pre-trained model for practical reasons when detecting objects that the pre-...
0
votes
1
answer
33
views
Why instance segmentation architectures using reconstruction masks but not regression?
I'm wondering why many model architectures use binary mask reconstruction for segmentational CNNs, and not regression of mask polygon coordinates? Many object detectors use regression to find ...
0
votes
1
answer
92
views
Is batch size of 1 a valid choice for a very deep neural network with high memory requirement?
I am training a very deep neural network (Panoptic-DeepLab) with a ResNet34 backbone on Google Colab on CityScapes dataset for Panoptic Segmentation, and noticed that, with a big crop size, the batch ...
1
vote
0
answers
66
views
What considerations should I take to train my transformer model?
I want to train my vision transformer model on a benchmark for an image segmentation task: (LoveDA: A Remote Sensing Land-Cover Dataset for Domain Adaptive Semantic Segmentation) (GitHub), but I don't ...
1
vote
1
answer
48
views
How to identify and diferentiate several edge lines of an object?
I want to create an AI to detect and identify certain edge lines on my image. The input image is a locker key, and I want to know the exact position of certain edges.
Sample input image:
Sample ...
-1
votes
1
answer
171
views
Use of Mask in U Net for plant disease detection [closed]
I am using U-Net for plant disease detection. I am new to deep learning and computer vision.
Currently, we are feeding the masking images generated via open cv HSV format to detect colours from the ...
0
votes
1
answer
79
views
Is there way to segment an image without labeling/classification, as well as supervised learning?
Is there way to segment an image without labeling/classification, as well as supervised learning?
For an illustrative example, if one considers an image with a dog and a cup (we don't particularly ...
-1
votes
1
answer
491
views
What is exactly sparse annotation?
What is exactly sparse annotation? Is it different from labeling images?
I've been reading a paper about vessel segmentation and have some issues understanding this part.
0
votes
1
answer
70
views
Deep RL reward design for neuron centerline extraction task
As part of a bigger scope project, I'm training a RL agent that attempts to reconstruct, pixel by pixel, the trajectory of a neuron on a segmented image. To give a better insight on the task that I'm ...
1
vote
0
answers
292
views
Mask R-CNN: how is the inference done?
According to the Mask R-CNN paper and the picture below (taken from the paper), the mask branch is computed in parallel with the bbox classification and regression branches.
However in the paper they ...
1
vote
2
answers
927
views
Image segmentation when given masking information is incomplete
In my problem, there are about 5,000 training images and there are about 50~100 objects of identical type (or class) on average, per image. And for each training images, there is a partial mask ...
3
votes
1
answer
139
views
Custom Tensorflow loss function that disincentivizes all black pixels
I'm training a Tensorflow model that receives an image and segments the image into foreground and background. That is, if the input image is w x h x 3, then the ...
0
votes
0
answers
132
views
Why is the simplest U-Net architecture giving the best (but not good enough) results on a multi-class segmentation on microscopic data?
Currently, I'm trying to optimize a training process of a neural net to improve final results. The problem I'm dealing with is multiclass segmentation on microscopic data.
The paradox is that the best ...
1
vote
0
answers
257
views
Is there any way to remove background of an image fully with the help of post-processor techniques(like edge detector) after deep learning based model
I'm using a deep learning-based model (deep lab v3+ with xception as the backbone) for image segmentation and removing the background. The subject of the image will be a person. And my target is to ...
0
votes
1
answer
52
views
How to divide a segmented image into classes instances?
Is there a method/algorithm to generate instances of objects from image that was segmented by the use of any image segmentation models?
For example, I have an image with one class and it was segmented ...
0
votes
1
answer
47
views
Should I label static objects on video dataset?
I'm using nvidia Transfer Learning Toolkit to detect cars in some video frames.
I found some dataset (for example https://www.jpjodoin.com/urbantracker/dataset.html and https://www.kaggle.com/...
-1
votes
1
answer
144
views
How to re-train an AI model to have smaller input image size
I need a PyTorch Model which can do road segmentation on OAK-D camera.
The model provided requires Input Image Size: 896x512, which is too big for running on OAK-D camera. Thus I need to re-train it ...
1
vote
3
answers
454
views
Aside from dice score, what other good metrics are used to evaluate segmentation models?
I have a segmentation which outputs only one channel image (2 class segmentation). I have used dice score for most of the time, but now higher powers in my team want me to expand evaluation metrics ...
0
votes
1
answer
527
views
Dissection of a depth map
I am curious about how depth maps work. While searching I came across this website which contains some images and their depth maps. I took this depth map and tried to study it using a python pillow.
<...
0
votes
0
answers
33
views
What are the existing AI methods to approach 3D volumes of computed tomography?
I have a dataset which consists of computed tomography images (CT scans) of parts that contain pores and cracks. The sets for each part are of about 1100 * 1100 * 3000-ish resolution. Currently, I use ...
0
votes
0
answers
18
views
How to change a single object detection network to a multiple object detection network?
I have trained a CNN network to detect a circle and approximate its centre and radius in an image. What I want to do now is detect the centre and radius of all the circles if there are multiple ...
2
votes
1
answer
308
views
What does 'downsampling' and 'upsampling' mean in coarse-to-fine segmentation?
The paper here in section 2.1 Coarse-to-fine prediction:
To increase the field of view presented to the CNN and reduce the
redundancy among neighboring voxels, each image is downsampled by a factor ...