Questions tagged [datasets]
For questions related to sets of data and their use in AI.
0
votes
2answers
34 views
Recognize pattern in dataset
I'm currently working on a group project where we need to find a pattern in a given dataset. The dataset is a collection of X, Y, Z values of a gyroscope from someone who is walking. If you plot these ...
0
votes
2answers
22 views
Tool to help clean Dataset to only contain Faces
Hi I'm a Student and trying to get a start in AI.
I have a fairly large dataset consisting of different Images with and without Persons that I want to use for a Project.
The Problem is that i only ...
0
votes
1answer
22 views
How to manage large amounts of image data for Training?
Right now I am trying to synthesize training images for a CNN and due to the nature of the application, there is a finite number of sample images to learn from.
From other research, I expect to be ...
0
votes
0answers
7 views
Can't create datasets and load images in COCO annotator
I'm trying to annotate images with COCO key points for pose estimation using https://github.com/jsbroks/coco-annotator. As described in the Installation section I cloned the repo. I installed Docker ...
2
votes
2answers
85 views
How to fix time dimension in time varying data-sets using deep learning model for classification?
Dataset Description
I am working on famous ABIDE Autism Datasets. The dataset is very big in a sense that it has more than 1000 subjects containing half of them as autisitic and other half as ...
1
vote
0answers
31 views
String matching algorithm for product recognition
I'm building a web application that collects schema.org data from different webshops as Amazon, Shopify, etc. It collects data every 6h and shows the current and lowest price. It is used for ...
-3
votes
0answers
31 views
How long does it take to train MNIST data set with a simple Neural Network
I have created a simple feed forward Neural Network library in Java - and I need a benchmark to compare and troubleshoot my library.
Computer specs:
AMD Ryzen 7 2700X Eight-Core Processor
RAM 16....
2
votes
0answers
35 views
Difference between retraining on different portions of data and training initially on larger data set
I have a large data set that doesn't fit in memory and would have to use something like Keras's model.fit_generator if I would like to train the model on all of the ...
1
vote
1answer
25 views
What data formats/pipelining are best to store and wrangle data which contains both text and float vectors?
Often in NLP project the data points contain both text and float embeddings, and it's very tricky to deal with. CSVs take up a ton of memory and are slow to load. But most the other data formats seem ...
0
votes
0answers
17 views
Size of dataset for feature vector with rare event
I'm doing a model to detect duplicate in my database (there is a lot of features that can be different but mean same object in the end)
So I have my feature vector for my duplicate dataset which ...
1
vote
1answer
24 views
Do we train a logistic regression model using a dataset that is 3 times bigger than the validation dataset?
Suppose we have a data set $X$ that is split as $X_{\text{train}}$, $X_{\text{val}}$ and $X_{\text{test}}$ and the outcome variable is binary. Let's say we train three different models (logistic ...
1
vote
0answers
28 views
Deep Learning for radio signal classification with DeepSig dataset
I want to see if I can make my Software Defined Radio, SDR, to classify unknown radio signals with the help of an artificial neural network. That is, my SDR outputs a sequence of complex numbers (IQ-...
1
vote
1answer
75 views
How to detect LEGO bricks by using a deep learning approach?
In my thesis I dealt with the question how a computer can recognize LEGO bricks. With multiple object detection, I chose a deep learning approach. I also looked at an existing training set of LEGO ...
1
vote
0answers
25 views
What methods are there to generate artificial training examples based on existing training examples?
I have a small dataset (117 training examples) and many features (4005). Each of the training examples is binary labeled (healthy / diseased). Each feature represents the connectivity between two ...
0
votes
0answers
11 views
Consecutive frames can be discarded when training an SSD/YOLO?
Let's say I have a number of videos, and I want to train an SSD/YOLO (or FRCNN) to detect objects. In the case of a large amount of videos, there will be a lot of frames extracted and transferred to ...
0
votes
0answers
33 views
Is there a RNN that can predict the next substitute in a floorball match?
Floorball is a type of floor hockey. During the game, substitutions can be made.
The team is also allowed to change players any time in the game; usually, they change the whole team. Individual ...
0
votes
1answer
23 views
transform Location data into int which will be used as input to ML model
I have features like state, city and location. Currently i am inserting this in respective tables in DB and tranform it using its primary key.
eg. country,state,city = IN,Maharastra,Pune = 2,5,10 (...
1
vote
2answers
379 views
What is non-Euclidean data?
What is non-Euclidean data? Where does this type of data arises? Apparently, graphs and manifolds are non-Euclidean data. Why exactly is that the case? What is the difference between non-Euclidean and ...
1
vote
2answers
27 views
What features should a dataset to predict monthly retail sales for a motorcycle spare parts shop have?
I am making an AI model to predict monthly retail sales of a motor cycle spare parts shop, for that to be possible I have to first create a dataset. The problem I am facing is what features should the ...
0
votes
0answers
22 views
identifying pattern in datasets
i am new to machine learning. i'm trying to identify driving pattern through accelerometer and gyroscope sensor. i have been collecting the data of both the sensors and have been storing them in .csv ...
0
votes
0answers
24 views
NLP Task Proposal: I spy with my little eye
I order to build better artifical agents (AA) we need the right tasks and data to train on. The task I have in mind is the well-know game "I spy with my little eye", where agent A has to guess the ...
0
votes
0answers
39 views
How to use data from range of values <-1,1> in neural networks
I'd like to ask you how to use data from range <-1,1> in neural networks to have the best results? I came up with three scenarios:
Use it as it is and check if activation functions work with <-...
0
votes
1answer
63 views
Parameters to calculate affluence in localities of Metro city
I have to calculate the affluence in localities of Metro city. To calculate affluence, I am considering a parameter per capita income.
Where I can get a dataset of it? What are other parameters I ...
3
votes
0answers
39 views
How to train CNN such it eliminate dependent features and focuses on independent ones?
How we should train a CNN model when training dataset contains only limited number of cases, and the trained model is supposed to predict class (label) for several other cases, which has not seen ...
2
votes
2answers
191 views
Using GAN's to generate dataset for CNN training
I'm doing bachaleor thesis on traffic sign detection using single shot detector called YOLO. These single shot detectors can perform detection of objects in image and so they have specific way of ...
1
vote
0answers
34 views
how to estimate which item is bought most using AI
Problem: Maintaining the products is a big task for a retailer. If we can estimate using AI to predict which products will sell the most, we can maintain sufficient stocks of the product without ...
1
vote
0answers
64 views
What are some of the drawbacks of one-shot learning?
One-shot learning seems to work really well in many application domains. Are there any major (or even minor) drawbacks of using one-shot learning? Does it have flaws that could prevent it from being ...
0
votes
1answer
337 views
When training an object detection network for one class, should I include empty images in the dataset?
I fine tuned MobileNetSSD for object detection using a dataset with just one class (~4000 images). All the training images include at least one bounding box related to that class (no empty images). By ...
3
votes
2answers
78 views
Structure in data
Consider some image classification problem. Conceptually, we then have some high dimensional space where all the images can be represented as points, and having large enough labeled data set we can ...
0
votes
2answers
72 views
Where can I find a dataset of IQ questions and answers?
Specifically, I am looking for a dataset that is concerned with pattern recognition. I could find no such dataset on Kaggle, and Google has been of little help.
1
vote
0answers
28 views
How to preprocess a modified dataset so that a fitted CNN makes correct predictions on an un-modified version of the dataset?
for a school project I have been given a dataset containing images of plants and weeds. The goal is to detect when there is a weed in the pictures. The training and validation sets have already been ...
0
votes
1answer
33 views
Doubts at basic step of learning problem
Question: Express each of the following tasks in the framework of learning from data by specifying the input space X, output space Y, target function f:X->Y and the specifics of the data set that we ...
-1
votes
1answer
51 views
How to perform PCA in the validation/test set?
I was using PCA in my whole dataset (and after split to training, validation and test), but after some researchs I found out that is wrong way to do. Then I have few questions:
-Are there some ...
1
vote
1answer
31 views
Searching for dataset in specifix context for NLP, sentiment analysis
I would like to create an NPC engine for games which are in a fantasy context like Lord of the Rings, Warcraft, Skyrim, Dragon Age etc.
This engine should be able to determine the polarity of the ...
2
votes
1answer
129 views
Best way to create an image dataset for CNN
I am creating a dataset made of many images which are created by preprocessing a long time series. Each image is an array of (128,128) and the there are four classes. I would like to build a dataset ...
0
votes
0answers
35 views
Usefulness of Data augmentation for non-overfitting network [NLP]
(Maybe related : Usefulness of Dropout for non-overfitting network)
My neural network does not overfit.
Using Data augmentation in a non-overfitting network can increase its accuracy ?
Note : I'm ...
1
vote
0answers
15 views
input annotations quality check for large scale image data
while dealing with image data at very large scale, there are different sources where data is coming from. Often, we do not have any control over quality of labels/ annotations. I already do use ...
2
votes
0answers
30 views
People Counting Video Analytics: data acquisition parameters
I am interested in understanding how to choose data-acquisition parameters for the subject matter:
Frame Resolution
Frame rates (FPS)
The goal is to have 'enough' (preferably the minimal) resolution ...
1
vote
0answers
30 views
Preset Intent list
I'm trying to build a chat analysis that could identify the intent of check price.
Has any kind of preset intent list to train my chatbot already been done ?
Data: A data set for "check price" ...
1
vote
1answer
69 views
Is 1mb an acceptable memory size for images being trained in a CNN?
I am using Tensorflow CNN to build an image classification/prediction model. Currently all the images in the dataset are each about 1mb in size.
Most examples out there use very small images.
The ...
2
votes
1answer
66 views
Which evaluation methods can I use for image segmentation?
I implemented an image segmentation pipeline and I trained it on the DICOM dataset. I compared the results of the model with manual segmentation to find the accuracy. Is there other methods for ...
4
votes
3answers
2k views
Traffic signs dataset
I'm looking for annotated dataset of traffic signs. I was able to find Belgium, German and many more traffic signs datasets. The only problem is these datasets contain only cropped images, like this:
...
3
votes
1answer
44 views
Python API for publicly available datasets
In my daily machine learning / deep learning workflow, I often want to interact with a dataset in my code.
Specifically, I would like to be able to load some module / package which can
make sure that ...
1
vote
1answer
65 views
Why would giving my AI more data make it perform worse?
So I trained an AI to generate shakespeare, which it did somewhat well. I used this 10,000 character sample.
Next I tried to get it to generate limericks using these 100,000 limericks. It generated ...
3
votes
2answers
44 views
Is a binary attribute type the same as binomial attribute type?
I am not sure if I can use the words binomial and binary and boolean as synonyms to describe a data attribute of a data set which has two values (yes or no). Are there any differences in the meaning ...
3
votes
1answer
78 views
Use cross-validation to train after model selection
I have been recently reading about model selection algorithms (for example to decide which value of the regularisation parameter or what size of a neural network to use, broadly hyper-parameters). ...
5
votes
1answer
184 views
What happens to the training data after your machine learning model has been trained?
I am completely new to all this, for the life of me I can't find the answer to this question anywhere on Google.
What happens after you have used machine learning to train your model? What happens to ...
1
vote
1answer
19 views
Which features of a data set can be used for market campaigning using propensity scores?
A dataset contains so many fields in which there is both relevant and irrelevant field. If we want to do a market campaigning using propensity scoring, which fields of the data set are relevant?
How ...
1
vote
0answers
42 views
YOLO - How much is the position of the object relevant in learning?
I have the following question about You Only Look Once (YOLO) algorithm, for object recognition in CNNs.
I have to develop a neural network to recognize web components in web applications - for ...
4
votes
1answer
101 views
Algorithm For Making Balanced Weapons In A Game?
I am trying to make balanced weapon pairs. So there are five stats per weapon, and I am simulating a number of combats (1000) with different stats randomized, and counting the win, lose, and draw of ...
