Questions tagged [datasets]
For questions related to sets of data and their use in AI.
114
questions
3
votes
0answers
47 views
Are there datasets to solve differential equations in a supervised fashion?
Are there datasets to solve differential equations in a supervised fashion?
More precisely, the input is a differential equation and the label should be the general solution to that differential ...
3
votes
0answers
29 views
Is there a database of images of entire people bodies?
I wonder if anyone knows a database (preferably free) of images of different classes of people (age, gender) but with entire bodies shown on the pictures taken from different angles (mostly front and ...
0
votes
0answers
9 views
What is best dataset for person reidentification?
There are many datasets for person reidentification. I want to train a robust person re-identification neural network. Therefore I want to ask about best person re-identification dataset.
0
votes
0answers
9 views
what is the best dataset (or combination of datasets) for training a person detector?
I want to train a person detector for MOTChallenge dataset, but I want to avoid using the dataset as training set for my detector.
Therefore, I want to use another dataset or combination of several ...
0
votes
0answers
10 views
How much data is needed to train a deep learning model to detect instance masks?
I am trying to get an idea of how much data is needed to train a deep convolutional neural network to detect instance masks from images. I am interested in both papers that have been written on the ...
1
vote
0answers
28 views
Indian Traffic Sign Dataset
I am looking for the Indian Dataset of traffic signs. There is a dataset developed recently IDD: A Dataset for Exploring Problems of Autonomous Navigation in Unconstrained Environments which contains ...
0
votes
0answers
10 views
Is there any reason to believe a ml pipeline that works on dataset A will work on dataset B where both have similar meta features?
I’m working on generating an automl pipeline(a combination of data cleaning and transformation algorithms applied to a dataset then generate a model) that works on a new dataset by looking for past ...
2
votes
1answer
28 views
Is it compulsary to normalize the dataset if doing so can negatively impact a Binary Logistic regression performance?
I am using raw data set with 4 feature variables (Total Cholesterol, Systolic Blood Pressure, Diastolic Blood Pressure, and Cigraeette count) to do a Binominal Classification (find stroke likelihood) ...
0
votes
1answer
44 views
Generate credit cards dataset for locating number region
Currently I'm working on a project for scanning credit card and text extraction from cards. So first of all I decided to preprocess my images with some filters like thresholding, dilation and some ...
1
vote
1answer
19 views
Train on big dataset (1mil + images)
I am in the process of collecting a huge dataset of Human poses captured images to create a model to classify poses.
My question is how will I be able to train on this massive dataset? I have ...
1
vote
0answers
8 views
Mobile App Recommendation: How to get the rate of a specific user submit for a specific application
I have a mobile app recommendation project, so I need data set which has user-app matrix-rate. Actually, I want to know what rate does a specific user submit for a specific application. in other words,...
1
vote
0answers
19 views
Train detector : 300 images with 30 objects or 9000 images with one?
so I have this dataset of images of people sitting in a restaurant.
I've annotated about 300 images with an average of 30 instances of "person" per image.
Now I'm wondering if I should have annotated ...
2
votes
0answers
21 views
Can I use self-driving car's data set for left-hand drive cars which drive on the right lane for right-hand cars which drive on the left lane?
Can I use self-driving car's data set for left-hand drive cars which drive on the right lane for right-hand self-driving cars which drive on the left lane?
1
vote
0answers
61 views
What can be inferred about the training data from a trained neural network?
Suppose we trained a neural network on some training set that we call $X$.
Given the neural network and the method of training(algorithm, hyperparameters etc.) can we infer anything about $X$.
Now, ...
2
votes
1answer
49 views
Examples of time-varying graph-structured data in real world
I'm looking for examples of time-varying graph-structured data for time-varying graph CNNs. First, I came up with the idea of infection network. Is there anything more? If possible, I want data that ...
2
votes
1answer
45 views
How do I know if my dataset is ready for a machine learning model?
I am new in this area of Machine Learning and Neural Networks. Currently, I'm taking some courses on Udemy and reading a book about it, but I still have one big question regarding data pre-processing.
...
0
votes
1answer
34 views
Decide Number of input Parameters and Output Parameters - ANN
I have to create a Neural Network for regression purpose. Basically, I created a Model which predict next 5 values when we give past 6 values.
I want to make a change in this neural network. For ...
2
votes
0answers
60 views
How to choose our data set wisely?
I have a couple of questions and I was wondering if you could answer them.
I have a bunch of images of the cars, side view only. I want to train the model with those images. My objects of interest ...
1
vote
1answer
25 views
Further Normalization of Standardized data - ANN
I want to develop a regression model using the artificial neural network. For developing such a model I use standardised ( z-score normalised ) data.
given below is the sample data set. Here MAX is ...
0
votes
1answer
14 views
Are absence of labels for classes of interest in a vision dataset a big problem?
I wish to be able to detect: pedestrians, cars, traffic lights
I have two large datasets:
- One contains instances and labels of all three classes.
- The other contains instances of all three but ...
3
votes
2answers
60 views
Are there tools to help labelling images?
I need to manually classify thousands of pictures into discrete categories, say, where each picture is to be tagged either A, B, or C.
Edit: I want to do this work myself, not outsource / crowdsource ...
1
vote
0answers
29 views
Generate QA dataset from large text corpus
I have a corpus of a domain data in form of 10-15 books pdf and some articles and my end-goal is to make a question-answering system particular to that domain.
For that, I would need a dataset on Q/A ...
0
votes
0answers
38 views
Will balancing dataset of images for object detection for a single-shot OD (Yolov3-spp) by cropping lower the quality of the model?
I'm trying to work out an approach to balancing my dataset, which is a subset of a google openimages - some classes are represented orders of magnitude more than others and I am hesistant to simply ...
0
votes
2answers
56 views
Recognize pattern in dataset
I'm currently working on a group project where we need to find a pattern in a given dataset. The dataset is a collection of X, Y, Z values of a gyroscope from someone who is walking. If you plot these ...
1
vote
2answers
35 views
Are there tools to help clean a large dataset so that it only contains faces?
I have a fairly large dataset consisting of different images with and without persons that I want to use for a project.
The problem is that I only want the pictures that contain faces, and it is best ...
0
votes
2answers
64 views
How to manage large amounts of image data for training?
Right now, I am trying to synthesize training images for a CNN and due to the nature of the application, there is a finite number of sample images to learn from.
From other research, I expect to be ...
0
votes
0answers
36 views
Can't create datasets and load images in COCO annotator
I'm trying to annotate images with COCO key points for pose estimation using https://github.com/jsbroks/coco-annotator. As described in the Installation section I cloned the repo. I installed Docker ...
2
votes
2answers
101 views
How to fix time dimension in time varying data-sets using deep learning model for classification?
Dataset Description
I am working on famous ABIDE Autism Datasets. The dataset is very big in a sense that it has more than 1000 subjects containing half of them as autisitic and other half as ...
1
vote
0answers
33 views
String matching algorithm for product recognition
I'm building a web application that collects schema.org data from different webshops as Amazon, Shopify, etc. It collects data every 6h and shows the current and lowest price. It is used for ...
2
votes
0answers
38 views
Difference between retraining on different portions of data and training initially on larger data set
I have a large data set that doesn't fit in memory and would have to use something like Keras's model.fit_generator if I would like to train the model on all of the ...
1
vote
1answer
25 views
What data formats/pipelining are best to store and wrangle data which contains both text and float vectors?
Often in NLP project the data points contain both text and float embeddings, and it's very tricky to deal with. CSVs take up a ton of memory and are slow to load. But most the other data formats seem ...
0
votes
0answers
18 views
Size of dataset for feature vector with rare event
I'm doing a model to detect duplicate in my database (there is a lot of features that can be different but mean same object in the end)
So I have my feature vector for my duplicate dataset which ...
1
vote
1answer
36 views
Do we train a logistic regression model using a dataset that is 3 times bigger than the validation dataset?
Suppose we have a data set $X$ that is split as $X_{\text{train}}$, $X_{\text{val}}$ and $X_{\text{test}}$ and the outcome variable is binary. Let's say we train three different models (logistic ...
1
vote
0answers
117 views
Deep Learning for radio signal classification with DeepSig dataset
I want to see if I can make my Software Defined Radio, SDR, to classify unknown radio signals with the help of an artificial neural network. That is, my SDR outputs a sequence of complex numbers (IQ-...
2
votes
1answer
406 views
How to detect LEGO bricks by using a deep learning approach?
In my thesis I dealt with the question how a computer can recognize LEGO bricks. With multiple object detection, I chose a deep learning approach. I also looked at an existing training set of LEGO ...
2
votes
0answers
28 views
What methods are there to generate artificial training examples based on existing training examples?
I have a small dataset (117 training examples) and many features (4005). Each of the training examples is binary labeled (healthy / diseased). Each feature represents the connectivity between two ...
0
votes
0answers
15 views
Consecutive frames can be discarded when training an SSD/YOLO?
Let's say I have a number of videos, and I want to train an SSD/YOLO (or FRCNN) to detect objects. In the case of a large amount of videos, there will be a lot of frames extracted and transferred to ...
0
votes
0answers
36 views
Is there a RNN that can predict the next substitute in a floorball match?
Floorball is a type of floor hockey. During the game, substitutions can be made.
The team is also allowed to change players any time in the game; usually, they change the whole team. Individual ...
0
votes
1answer
25 views
transform Location data into int which will be used as input to ML model
I have features like state, city and location. Currently i am inserting this in respective tables in DB and tranform it using its primary key.
eg. country,state,city = IN,Maharastra,Pune = 2,5,10 (...
1
vote
2answers
2k views
What is non-Euclidean data?
What is non-Euclidean data? Where does this type of data arises? Apparently, graphs and manifolds are non-Euclidean data. Why exactly is that the case? What is the difference between non-Euclidean and ...
1
vote
2answers
28 views
What features should a dataset to predict monthly retail sales for a motorcycle spare parts shop have?
I am making an AI model to predict monthly retail sales of a motor cycle spare parts shop, for that to be possible I have to first create a dataset. The problem I am facing is what features should the ...
0
votes
0answers
29 views
identifying pattern in datasets
i am new to machine learning. i'm trying to identify driving pattern through accelerometer and gyroscope sensor. i have been collecting the data of both the sensors and have been storing them in .csv ...
0
votes
0answers
25 views
NLP Task Proposal: I spy with my little eye
I order to build better artifical agents (AA) we need the right tasks and data to train on. The task I have in mind is the well-know game "I spy with my little eye", where agent A has to guess the ...
0
votes
0answers
40 views
How to use data from range of values <-1,1> in neural networks
I'd like to ask you how to use data from range <-1,1> in neural networks to have the best results? I came up with three scenarios:
Use it as it is and check if activation functions work with <-...
0
votes
1answer
169 views
Parameters to calculate affluence in localities of Metro city
I have to calculate the affluence in localities of Metro city. To calculate affluence, I am considering a parameter per capita income.
Where I can get a dataset of it? What are other parameters I ...
3
votes
0answers
48 views
How to train CNN such it eliminate dependent features and focuses on independent ones?
How we should train a CNN model when training dataset contains only limited number of cases, and the trained model is supposed to predict class (label) for several other cases, which has not seen ...
2
votes
2answers
363 views
Using GAN's to generate dataset for CNN training
I'm doing bachaleor thesis on traffic sign detection using single shot detector called YOLO. These single shot detectors can perform detection of objects in image and so they have specific way of ...
1
vote
0answers
35 views
how to estimate which item is bought most using AI
Problem: Maintaining the products is a big task for a retailer. If we can estimate using AI to predict which products will sell the most, we can maintain sufficient stocks of the product without ...
1
vote
0answers
150 views
What are some of the drawbacks of one-shot learning?
One-shot learning seems to work really well in many application domains. Are there any major (or even minor) drawbacks of using one-shot learning? Does it have flaws that could prevent it from being ...
0
votes
1answer
731 views
When training an object detection network for one class, should I include empty images in the dataset?
I fine tuned MobileNetSSD for object detection using a dataset with just one class (~4000 images). All the training images include at least one bounding box related to that class (no empty images). By ...
