Questions tagged [datasets]

For questions related to sets of data and their use in AI.

Filter by
Sorted by
Tagged with
1
vote
0answers
29 views

How to use Before / After images to train a model

I am trying to create a model that can clean pictures of noise, blur, high luminosity etc, but I do not know how to do that. I have tried to search for it a lot, and I couldn't find anything that ...
2
votes
0answers
41 views

How can I compare EEG data with accelerometer data in 1 algorithm?

I have frequency EEG data from fall and non-fall events and I am trying to incorporate it with accelerometer data that was collected at the same time. One approach is, of course, to use two separate ...
1
vote
0answers
14 views

Hashing images detects false duplicates

Like I said in the title, I used a code I found to identify duplicate images however there are many false alarms. Can someone give me a link to some code I could use that really works? The problem ...
2
votes
0answers
96 views

Suggestion for finding the stable regions in spiral galaxy data?

I am working with a data set that consists of the actual pitch angle (given as PA(Y)) and the pitch angle at each radii (listed from 1 to 217). In the image below, ...
0
votes
3answers
140 views

How to correctly label images for multi-label classification?

I have images that contain lots of elements. Some I know, some I don't. I want to know if it's ok to only label those I do know. Let's take this image for example. I would label the green stuff and ...
1
vote
1answer
53 views

How exactly does MICE imputation combine multiple datasets into one?

I'm trying to understand Multiple Imputation with Chained Equation (MICE) imputation process (a statistical method for imputing missing data). I have read some articles and I have understood how the ...
1
vote
1answer
148 views

Ambulance dataset needed

Could I get a dataset that can classify ambulances? I have searched everywhere, but, couldn't seem to get hold of a set of annotated images for ambulances.
1
vote
0answers
27 views

Should I add some noise when the dataset is small?

I want to create a small dataset (about 10 classes and 20-30 images each), should I add some noise (wrong label sample) in the training, validation and test datasets, and why?
2
votes
1answer
65 views

How to perform binary classification when one class is more predominant than the other?

Assuming we have big $m \times n$ input dataset, with $m \times 1$ output vector. It's a classification problem with only two possible values: either $1$ or $0$. Now, the problem is that almost all ...
0
votes
1answer
61 views

Is there a way of automatically drawing bounding boxes around interested objects?

Given thousands of images, where some of the images contain target objects and others do not, is there an easy way of drawing bounding boxes on these target objects rather than relying on manual ...
1
vote
0answers
117 views

Is there an audio dataset with the corresponding phonemes in the audio?

I am looking for a dataset of clear audio, a corresponding transcript (optional), and most importantly a list of all the phonemes said in the audio, with the length of each phoneme and a mention of ...
1
vote
0answers
33 views

Are there free and easy-to-use annotation tools for 3D bounding boxes? [closed]

Are there free and easy-to-use annotation tools for 3D bounding boxes? There is a lot of annotation tools out there, but most of them only good for 2d boxes.
0
votes
1answer
272 views

Is it possible to use AI for detecting the volume of a cup

I was just wondering if it's possible to use Machine Learning to train a model from a dataset of images of cups with a given volume in the image and then use object detection to detect other cups and ...
4
votes
0answers
2k views

How many training data required for GAN?

I'm beginning to study and implement GAN to generate more dataset. I'll just try to experiment with state-of-the-art GAN models as described in here https://paperswithcode.com/sota/image-generation-on-...
4
votes
0answers
109 views

Are there any easy ways to create annotated training images for object detection?

For the purposes of object detection, are there any easy ways to create annotated training images? For example, if we have $10,000$ images and want to draw bounding boxes on 2 objects for each image, ...
1
vote
0answers
17 views

learning object recognition of primitive shapes through transfer learning problem

Question on transfer learning object classification (MobileNet_v2 with 75% number of parameters) with my own synthetic data: I made my own dataset of three shapes: triangles, rectangles and spheres. ...
2
votes
1answer
35 views

What does top N accuracy mean?

Places205-VGG, a CNN trained model for 205 scene categories of Places Database with 2.5 million images Places205 dataset has ...
4
votes
1answer
62 views

How could decision tree learning algorithms cope with imbalanced classes?

Decision trees and random forests may or not be more suited to solve supervised learning problems with imbalanced labels (or classes) in datasets. For example, see the article Using Random Forest to ...
2
votes
1answer
33 views

If an image contains two distinct objects, should I create a copy of this image with distinct labels for each copy?

Suppose we want to detect whether an object is one of the following classes: $\text{Object}_1, \text{Object}_2, \text{Object}_3$ and $\text{Person}$. Should the annotated images only contain bounding ...
1
vote
1answer
48 views

How can I merge two datasets? [closed]

I want to merge 2 data sets in one, but don't know the right approach to do it. The datasets are similar, the last column is the same - will or not them buy a product. In the first dataset, users who ...
2
votes
3answers
89 views

In adversarial machine learning, how does an attacker have access to the test and training dataset in order to poison it?

In the field of adversarial machine learning, machine learning models are vulnerable to attacks both on the test and training data set. However, how does the attacker get access to these datasets? How ...
2
votes
0answers
166 views

Is there a dataset for the detection of bomb explosions? [closed]

I would like to train a deep neural network to recognize bomb explosions. I was wondering if there is an open visual dataset for bomb explosion? Alternatively, if you know a good deep architecture or ...
1
vote
0answers
211 views

creating your own dataset similar to cityscapes format

I'm trying to train a neural network with my own dataset. The neural network can accept the cityscape format. Is there any application that can give mask/segmented image, instance image, label IDs ...
1
vote
2answers
294 views

TensorFlow 2.0 - Normalizing input to DNN (on structured data) [closed]

I have a structured dataset of around 100 gigs, and I am using DNN for classification in TF 2.0. Because of this huge dataset, I cannot load entire data in memory for training. So, I'll be reading ...
1
vote
2answers
132 views

Dataset for floating objects detection [closed]

I am looking for a dataset, which I could train a model to detect people/boats/surfboards, etc., from a drone view. Has anyone seen a dataset that could be useful for this purpose? I have some photos ...
1
vote
0answers
112 views

Colour palettes for COCO dataset

Is there any link or explanation on how to create Color palettes for coco dataset for segmentation. I see there is a link for cityscapes dataset https://gluon-cv.mxnet.io/_modules/gluoncv/utils/viz/...
2
votes
0answers
40 views

How to learn using DDPG in python solely using a timeseries datasets

I have a lengthy timeseries datasets which contains several variables (from sensors etc) to be classified as actions or states. Providing they are successfully done, I want to learn a control policy ...
4
votes
0answers
97 views

Are there datasets to solve differential equations in a supervised fashion? [closed]

Are there datasets to solve differential equations in a supervised fashion? More precisely, the input is a differential equation and the label should be the general solution to that differential ...
3
votes
0answers
39 views

Is there a database of images of entire people bodies?

I wonder if anyone knows a database (preferably free) of images of different classes of people (age, gender) but with entire bodies shown on the pictures taken from different angles (mostly front and ...
2
votes
1answer
51 views

Is it compulsary to normalize the dataset if doing so can negatively impact a Binary Logistic regression performance?

I am using raw data set with 4 feature variables (Total Cholesterol, Systolic Blood Pressure, Diastolic Blood Pressure, and Cigraeette count) to do a Binominal Classification (find stroke likelihood) ...
0
votes
1answer
83 views

Generate credit cards dataset for locating number region

Currently I'm working on a project for scanning credit card and text extraction from cards. So first of all I decided to preprocess my images with some filters like thresholding, dilation and some ...
1
vote
1answer
24 views

Train on big dataset (1mil + images)

I am in the process of collecting a huge dataset of Human poses captured images to create a model to classify poses. My question is how will I be able to train on this massive dataset? I have ...
2
votes
0answers
13 views

Mobile App Recommendation: How to get the rate of a specific user submit for a specific application

I have a mobile app recommendation project, so I need data set which has user-app matrix-rate. Actually, I want to know what rate does a specific user submit for a specific application. in other words,...
2
votes
0answers
25 views

Train detector : 300 images with 30 objects or 9000 images with one?

so I have this dataset of images of people sitting in a restaurant. I've annotated about 300 images with an average of 30 instances of "person" per image. Now I'm wondering if I should have annotated ...
3
votes
0answers
23 views

Can I use self-driving car's data set for left-hand drive cars which drive on the right lane for right-hand cars which drive on the left lane?

Can I use self-driving car's data set for left-hand drive cars which drive on the right lane for right-hand self-driving cars which drive on the left lane?
1
vote
0answers
64 views

What can be inferred about the training data from a trained neural network?

Suppose we trained a neural network on some training set that we call $X$. Given the neural network and the method of training(algorithm, hyperparameters etc.) can we infer anything about $X$. Now, ...
3
votes
1answer
65 views

Examples of time-varying graph-structured data in real world

I'm looking for examples of time-varying graph-structured data for time-varying graph CNNs. First, I came up with the idea of infection network. Is there anything more? If possible, I want data that ...
2
votes
1answer
57 views

How do I know if my dataset is ready for a machine learning model?

I am new in this area of Machine Learning and Neural Networks. Currently, I'm taking some courses on Udemy and reading a book about it, but I still have one big question regarding data pre-processing. ...
0
votes
1answer
57 views

Decide Number of input Parameters and Output Parameters - ANN

I have to create a Neural Network for regression purpose. Basically, I created a Model which predict next 5 values when we give past 6 values. I want to make a change in this neural network. For ...
2
votes
0answers
65 views

How to choose our data set wisely?

I have a couple of questions and I was wondering if you could answer them. I have a bunch of images of the cars, side view only. I want to train the model with those images. My objects of interest ...
1
vote
1answer
35 views

Further Normalization of Standardized data - ANN

I want to develop a regression model using the artificial neural network. For developing such a model I use standardised ( z-score normalised ) data. given below is the sample data set. Here MAX is ...
1
vote
1answer
17 views

Are absence of labels for classes of interest in a vision dataset a big problem?

I wish to be able to detect: pedestrians, cars, traffic lights I have two large datasets: - One contains instances and labels of all three classes. - The other contains instances of all three but ...
3
votes
2answers
91 views

Are there tools to help labelling images? [closed]

I need to manually classify thousands of pictures into discrete categories, say, where each picture is to be tagged either A, B, or C. Edit: I want to do this work myself, not outsource / crowdsource ...
1
vote
0answers
61 views

Generate QA dataset from large text corpus

I have a corpus of a domain data in form of 10-15 books pdf and some articles and my end-goal is to make a question-answering system particular to that domain. For that, I would need a dataset on Q/A ...
1
vote
0answers
126 views

Will balancing dataset of images for object detection for a single-shot OD (Yolov3-spp) by cropping lower the quality of the model?

I'm trying to work out an approach to balancing my dataset, which is a subset of a google openimages - some classes are represented orders of magnitude more than others and I am hesistant to simply ...
1
vote
3answers
240 views

Recognize pattern in dataset

I'm currently working on a group project where we need to find a pattern in a given dataset. The dataset is a collection of X, Y, Z values of a gyroscope from someone who is walking. If you plot these ...
1
vote
3answers
55 views

Are there tools to help clean a large dataset so that it only contains faces?

I have a fairly large dataset consisting of different images with and without persons that I want to use for a project. The problem is that I only want the pictures that contain faces, and it is best ...
1
vote
2answers
125 views

How to manage large amounts of image data for training?

Right now, I am trying to synthesize training images for a CNN and due to the nature of the application, there is a finite number of sample images to learn from. From other research, I expect to be ...
3
votes
2answers
188 views

How to fix time dimension in time varying data-sets using deep learning model for classification?

Dataset Description I am working on famous ABIDE Autism Datasets. The dataset is very big in a sense that it has more than 1000 subjects containing half of them as autisitic and other half as ...
1
vote
0answers
39 views

String matching algorithm for product recognition

I'm building a web application that collects schema.org data from different webshops as Amazon, Shopify, etc. It collects data every 6h and shows the current and lowest price. It is used for ...