Questions tagged [datasets]

For questions related to sets of data and their use in AI.

Filter by
Sorted by
Tagged with
3
votes
1answer
56 views

How to do machine translation with no labeled data?

Can it be possible to train a neural network with no parallel bilingual data?
3
votes
1answer
66 views

Examples of time-varying graph-structured data in real world

I'm looking for examples of time-varying graph-structured data for time-varying graph CNNs. First, I came up with the idea of infection network. Is there anything more? If possible, I want data that ...
3
votes
1answer
55 views

Automatic image classification

I'm a complete newbie to NNs, and I need your advice. I have a set of images of symbols, and my goal is to categorize and divide them into groups of symbols that look alike. Without teaching NN ...
3
votes
2answers
97 views

How can I predict the true label for data with incomplete features based on the trained model with data with more features?

Suppose I have a model that was trained with a dataset that contains the features (f1, f2, f3, f4, f5, f6). However, my test dataset does not contain all features ...
3
votes
2answers
305 views

Is a binary attribute type the same as binomial attribute type?

I am not sure if I can use the words binomial and binary and boolean as synonyms to describe a data attribute of a data set which has two values (yes or no). Are there any differences in the meaning ...
3
votes
1answer
99 views

Is there a way to predict points on a map?

I have a data set with historical information of some events (let's say event A and event B),these events describe the discovery of land mines, the coordinates of the event and the date of the event; ...
3
votes
0answers
39 views

Is there a database of images of entire people bodies?

I wonder if anyone knows a database (preferably free) of images of different classes of people (age, gender) but with entire bodies shown on the pictures taken from different angles (mostly front and ...
3
votes
0answers
23 views

Can I use self-driving car's data set for left-hand drive cars which drive on the right lane for right-hand cars which drive on the left lane?

Can I use self-driving car's data set for left-hand drive cars which drive on the right lane for right-hand self-driving cars which drive on the left lane?
3
votes
2answers
190 views

How to fix time dimension in time varying data-sets using deep learning model for classification?

Dataset Description I am working on famous ABIDE Autism Datasets. The dataset is very big in a sense that it has more than 1000 subjects containing half of them as autisitic and other half as ...
3
votes
0answers
60 views

How to train CNN such it eliminate dependent features and focuses on independent ones?

How we should train a CNN model when training dataset contains only limited number of cases, and the trained model is supposed to predict class (label) for several other cases, which has not seen ...
3
votes
1answer
209 views

Best way to create an image dataset for CNN

I am creating a dataset made of many images which are created by preprocessing a long time series. Each image is an array of (128,128) and the there are four classes. I would like to build a dataset ...
3
votes
2answers
546 views

Data-set values feature scaling: sigmoid vs tanh

As many papers point out, for better learning curve of a NN, it is better for a data-set to be normalized in a way such that values match a Gaussian curve. Does this process of feature normalization ...
3
votes
0answers
67 views

How exactly does a validation data-set work work in machine learning? [closed]

With typical machine learning you would usually use a training data-set to create a model of some kind, and a testing data-set to then test the newly created model. For something like linear ...
2
votes
3answers
3k views

Small size datasets for object detection, segmentation and localization [closed]

I am looking for a small size dataset on which I can implement object detection, object segmentation and object localization. Can anyone suggest me a dataset less than 5GB? Or do I need to know ...
2
votes
1answer
67 views

Would it be possible to determine the dataset a neural network was trained on?

Let's say we have a neural network that was trained with a dataset $D$ to solve some task. Would it be possible to "reverse-engineer" this neural network and get a vague idea of the dataset $...
2
votes
2answers
106 views

What are the possible social consequences of training neural networks with artificially generated data?

Machine learning models and, in particular, neural networks are trained with data often collected from the real world, such as images of real people. Meanwhile, neural networks (such as GANs) are also ...
2
votes
1answer
672 views

How to generate labels for self-supervised training?

I've been reading a lot lately about self-supervised learning and I didn't understand very well how to generate the desired label for a given image. Let's say that I have an image classification task, ...
2
votes
2answers
30 views

Why can't we combine both training and validation data, given that both types of data are used for developing the model?

Sorry if I sound confused. I read that data to be fed to a machine are divided into training, validation and test data. Both training and validation data are used for developing the model. Test data ...
2
votes
1answer
81 views

How robust are deep networks to class imbalance?

Before deep learning, I worked with machine learning problems where the data had a large class imbalance (30:1 or worse ratios). At that time, all the classifiers struggled, even after under-sampling ...
2
votes
1answer
124 views

Is this dataset with only two features suitable for clustering with k-means?

I am working with the K-means clustering algorithm for unsupervised learning. Is the following dataset suitable for the k-means clustering task or not? Why or why not? The dataset has only two ...
2
votes
2answers
77 views

What are standard datasets for fully connected neural networks?

I am looking for datasets that are used as a testing standard in the fully connected neural networks (FCNN). For example, in the image recognition and CNN, CIFAR datasets are used in most of the ...
2
votes
1answer
36 views

What does top N accuracy mean?

Places205-VGG, a CNN trained model for 205 scene categories of Places Database with 2.5 million images Places205 dataset has ...
2
votes
1answer
33 views

If an image contains two distinct objects, should I create a copy of this image with distinct labels for each copy?

Suppose we want to detect whether an object is one of the following classes: $\text{Object}_1, \text{Object}_2, \text{Object}_3$ and $\text{Person}$. Should the annotated images only contain bounding ...
2
votes
1answer
57 views

How do I know if my dataset is ready for a machine learning model?

I am new in this area of Machine Learning and Neural Networks. Currently, I'm taking some courses on Udemy and reading a book about it, but I still have one big question regarding data pre-processing. ...
2
votes
1answer
215 views

Is a dataset of roughly 700 sentences of an average length of 15 words enough for text classification?

I'm building a customer assistant chatbot in Python. So, I am modelling this problem as a text classification task. I have available more or less 7 hundred sentences of an average length of 15 words (...
2
votes
1answer
134 views

Why isn't the Credit Card Fraud Detection dataset from Kaggle already balanced?

I am working on a credit card fraud detection problem using autoencoders. I have a question regarding the dataset I'll be using. I've downloaded the dataset for the above problem from Kaggle, which ...
2
votes
1answer
44 views

On which data evaluate an object detection model ? (similar or real life data ?)

I'm training an object detection model (SSD300) to detect and classify body poses in thermal images. Even I have more than 2k different poses, but the background does not change much (I have only 5 ...
2
votes
3answers
91 views

In adversarial machine learning, how does an attacker have access to the test and training dataset in order to poison it?

In the field of adversarial machine learning, machine learning models are vulnerable to attacks both on the test and training data set. However, how does the attacker get access to these datasets? How ...
2
votes
0answers
38 views

Identifying rotating and resizing letters with background noise

I'm trying to complete a captcha, and here is what it looks like: Between captchas the calligraphy of the letters is the same, but the letters may be resized and rotated. And the background noise (...
2
votes
0answers
66 views

In few-shot classification, should I use my custom dataset as the validation dataset and mini-ImageNet as the training dataset?

I am new to few-shot learning, and I wanted to get a hands-on understanding of it, using Reptile algorithm, applied to my custom dataset. My custom dataset has 30 categories, with 5 images per ...
2
votes
0answers
43 views

How can I formulate a prediction problem (given labeled data) as an RL problem and solve it with Q-learning?

One of my friends sent me a problem he was working on lately, and I couldn't help but I wonder how could it be solved using Q-learning. The statement is as follows: Given the following datasets, the ...
2
votes
0answers
26 views

How does sampling works in case of imbalanced image datasets?

I am solving a problem of image classification of the image dataset for 3 classes. Dataset is highly imbalanced. How will sampling (either over- or under-sampling) work in that case? Should I remove (...
2
votes
0answers
42 views

Why is ANFIS important in general?

I am actually working with the iris dataset from sklearn and try to understand the ANFIS-Package for python. But that does not really matter! I have a more general question. During thinking about ...
2
votes
1answer
101 views

How are weights for weighted x-entropy loss on imbalanced data calculated?

I am trying to build a classifier which should be trained with the cross entropy loss. The training data is highly class-imbalanced. To tackle this, I've gone through the advice of the tensorflow docs ...
2
votes
0answers
23 views

Will structured knowledge bases continue to be used in question answering with the likes of BERT gaining popularity?

This may come across as an open and opinion-based question, I definitely want to hear expert opinions on the subject, but I am also looking for references to materials that I can read deeply. One of ...
2
votes
0answers
31 views

Boston Housing Current Best Model

I'm currently looking for a standard data-set to test some new regression models I've been developing on, and the "Boston Housing Prices" data-set seemed to stand out, since it's very standard. ...
2
votes
0answers
33 views

Labeling for multilabel image classification

with a friend of mine, we got in an argument over how to label images for multi-label. Note: Groups of a species and the species of catfish is important to recognize. The labels are: 'I': an ...
2
votes
0answers
41 views

How can I compare EEG data with accelerometer data in 1 algorithm?

I have frequency EEG data from fall and non-fall events and I am trying to incorporate it with accelerometer data that was collected at the same time. One approach is, of course, to use two separate ...
2
votes
0answers
96 views

Suggestion for finding the stable regions in spiral galaxy data?

I am working with a data set that consists of the actual pitch angle (given as PA(Y)) and the pitch angle at each radii (listed from 1 to 217). In the image below, ...
2
votes
1answer
65 views

How to perform binary classification when one class is more predominant than the other?

Assuming we have big $m \times n$ input dataset, with $m \times 1$ output vector. It's a classification problem with only two possible values: either $1$ or $0$. Now, the problem is that almost all ...
2
votes
0answers
170 views

Is there a dataset for the detection of bomb explosions? [closed]

I would like to train a deep neural network to recognize bomb explosions. I was wondering if there is an open visual dataset for bomb explosion? Alternatively, if you know a good deep architecture or ...
2
votes
0answers
42 views

How to learn using DDPG in python solely using a timeseries datasets

I have a lengthy timeseries datasets which contains several variables (from sensors etc) to be classified as actions or states. Providing they are successfully done, I want to learn a control policy ...
2
votes
1answer
51 views

Is it compulsary to normalize the dataset if doing so can negatively impact a Binary Logistic regression performance?

I am using raw data set with 4 feature variables (Total Cholesterol, Systolic Blood Pressure, Diastolic Blood Pressure, and Cigraeette count) to do a Binominal Classification (find stroke likelihood) ...
2
votes
0answers
13 views

Mobile App Recommendation: How to get the rate of a specific user submit for a specific application

I have a mobile app recommendation project, so I need data set which has user-app matrix-rate. Actually, I want to know what rate does a specific user submit for a specific application. in other words,...
2
votes
0answers
25 views

Train detector : 300 images with 30 objects or 9000 images with one?

so I have this dataset of images of people sitting in a restaurant. I've annotated about 300 images with an average of 30 instances of "person" per image. Now I'm wondering if I should have annotated ...
2
votes
0answers
65 views

How to choose our data set wisely?

I have a couple of questions and I was wondering if you could answer them. I have a bunch of images of the cars, side view only. I want to train the model with those images. My objects of interest ...
2
votes
0answers
43 views

Difference between retraining on different portions of data and training initially on larger data set

I have a large data set that doesn't fit in memory and would have to use something like Keras's model.fit_generator if I would like to train the model on all of the ...
2
votes
0answers
496 views

Deep Learning for radio signal classification with DeepSig dataset

I want to see if I can make my Software Defined Radio, SDR, to classify unknown radio signals with the help of an artificial neural network. That is, my SDR outputs a sequence of complex numbers (IQ-...
2
votes
0answers
34 views

What methods are there to generate artificial training examples based on existing training examples?

I have a small dataset (117 training examples) and many features (4005). Each of the training examples is binary labeled (healthy / diseased). Each feature represents the connectivity between two ...
2
votes
0answers
43 views

Searching for dataset in specifix context for NLP, sentiment analysis

I would like to create an NPC engine for games that are in a fantasy context like Lord of the Rings, Warcraft, Skyrim, Dragon Age, etc. This engine should be able to determine the polarity of the ...