# Questions tagged [datasets]

For questions related to sets of data and their use in AI.

177 questions
Filter by
Sorted by
Tagged with
8 views

### Where are some good online covid 19 genetic datasets? [closed]

I want to carry out some research with covid19 genetic datasets that include people infected by corona virus and people that aren't infected by it. Does anybody know any good ones? My main purpose is ...
17 views

### How does sampling works in case of imbalanced image datasets?

I am solving a problem of image classification of the image dataset for 3 classes. Dataset is highly imbalanced. How will sampling (either over- or under-sampling) work in that case? Should I remove (...
28 views

### Is this dataset with only two features suitable for clustering with k-means?

I am working with the K-means clustering algorithm for unsupervised learning. Is the following dataset suitable for the k-means clustering task or not? Why or why not? The dataset has only two ...
83 views

### How to fill missing values in a dataset where some properties can be inputs and outputs?

I have a dataset with missing values, I would like to use machine learning methods to fill. In more detail, there are $n$ individuals, for which up to 10 properties are provided, all numerical. The ...
10 views

### Why is ANFIS important in general?

I am actually working with the iris dataset from sklearn and try to understand the ANFIS-Package for python. But that does not really matter! I have a more general question. During thinking about ...
15 views

### How can raw data from a motion sensor (like an IMU) reduced to the main points of the data

How can I reduce the caputured movement data of a person in a way, that I have filtered the main features of the movement. Or how can I detect pattern/ main features in that data set? I captured some ...
7 views

### How to train-test split and cross-validate in surprise? [migrated]

I wrote the following code below which works: ...
9 views

### When training NN, how do data loaders work on large datasets? [migrated]

How do you normally organize large data-sets for easy loading when training Neural Networks? I have a largeish data-set which cannot fit into memory, it consists of 200,000 samples, with 10k samples ...
5 views

### What are the best datasets available for music information retrieval?

I am interested in doing some work in classification problems in music information retrieval. I know that there are some formats of datasets (such as MIDI, Spectrogram, Piano-roll, MusicXML, etc.) for ...
14 views

### dataset structure for context aware task-oriented dialogue systems

I have been reading papers on Dialog State Tracking and Intent Detection and Slot Filling for building a simple ...
30 views

### How can I approximate a function that determines the priority of objects?

I am facing the following supervised learning problem: An object is fully characterized by its position in $R^n$. There are $m$ objects. There are fully observable (i.e. their positions are always ...
18 views

### How are weights for weighted x-entropy loss on imbalanced data calculated?

I am trying to build a classifier which should be trained with the cross entropy loss. The training data is highly class-imbalanced. To tackle this, I've gone through the advice of the tensorflow docs ...
51 views

### What are standard datasets for fully connected neural networks?

I am looking for datasets that are used as a testing standard in the fully connected neural networks (FCNN). For example, in the image recognition and CNN, CIFAR datasets are used in most of the ...
64 views

### How can I cluster this data frame with several features and observations?

How can I cluster the data frame below with several features and observations? And how would I go about determining the quality of those clusters? Is k-NN appropriate for this? ...
18 views

### Are there any training datasets using standard font text rather than hand written ones?

Are there any training datasets using standard font text rather than handwritten ones? I tried using the MNIST handwritten one on font based chars, but it didn't work well.
69 views

### What is the meaning of test data set in naive bayes classifier or decision trees?

What is the benefit of a test data set, especially for naive bayes estimator or decision tree construction? When using a naive bayes classifier the probabilities are a fact. As far as I know there is ...
42 views

### What are “proxy data sets” in machine learning?

The paper Assessment of Deep Generative Models for High-Resolution Synthetic Retinal Image Generation of Age-Related Macular Degeneration uses the term "proxy data sets" in this way To develop DL ...
93 views

### Why do we need both the validation set and test set?

I know that this has been asked a hundred times before, however, I was not able to find a question (and an answer) which actually answered what I wanted to know, respectively, which explained it in a ...
25 views

### What does it mean to have epochs=30 in Keras' fit method given certain data?

I have read a lot of information about several notions, like batch_size, epochs, iterations, but because of explanation was without numerical examples and I am not native speaker, I have some kind of ...
15 views

### Will structured knowledge bases continue to be used in question answering with the likes of BERT gaining popularity?

This may come across as an open and opinion-based question, I definitely want to hear expert opinions on the subject but I am also looking for references to materials that I can read deeply. One of ...
20 views

### Boston Housing Current Best Model

I'm currently looking for a standard data-set to test some new regression models I've been developing on, and the "Boston Housing Prices" data-set seemed to stand out, since it's very standard. ...
46 views

### How should I select the features for predicting diseases?

My aim is to create a trained model for predicting diseases. Now diseases are classified based on the following criteria in general: Causes of the Disease Pathogenesis (the mechanism by which the ...
70 views

### Validation loss is lower than Training loss

I am training a classifier to identify 24 hand signs of American Sign Language. I created a custom dataset by recording videos in different backgrounds for each of the signs and later converted the ...
47 views

### Are sentences from the same document independent and identically distributed?

I am trying to build an LSTM model to generate Shakspeare-like poems. I have data set $\{s_1, s_2, \dots, s_m \}$, which are sentences of Shakespeare poems, and each sentence contains words \$\{w_1, ...
49 views

### Image dataset for pomegranate plant disease

I am implementing a project on pomegranate plant disease in Machine learning. I want a dataset of all kind images of a healthy and unhealthy part of the pomegranate plant. I got a dataset from ...
63 views

### Can you let specific data impact a neural network more than other data?

I have a lot of empty values in my dataset, so I want to let my neural network 'learn more' on the rows that have no empty values because these rows are of higher importance. Is there a way to do ...
49 views

### Is a basic neural network architecture better with small datasets?

I'm currently trying to predict 1 output value with 52 input values. The problem is that I only have around 100 rows of data that I can use. Will I get more accurate results when I use a small ...
88 views

### Is there a possibility that there is no relationship between some inputs and outputs?

I'm doing machine learning projects. I took a look at many datasets I worked with, mostly there are already famous datasets that everyone uses. Let's say I decided to make my own dataset. Is there a ...
37 views

### Using three image datasets with different image sizes to train a CNN

I've just started with AI and CNN networks. I have two NIFTI images dataset, one with (240, 240) dimensions and the other one with (256, 132). Each dataset is front a different hospital and machine. ...
29 views

### How to do machine translation with no labeled data?

Can it be possible to train a neural network with no parallel bilingual data?
34 views

### Is it legal to construct a public image database (for deep learning) with images from the internet? [closed]

I am trying to put together a public agricultural image database of corn and soybeans, to train convolutional neural networks. The main method of image collection will be through taking pictures of ...
30 views

### Weird border artifacts when training a CNN

I've been trying to use this DeepLabv3+ implementation with my dataset (~1000 annotated images of the same box, out of the same video sequence): https://github.com/srihari-humbarwadi/...
14 views

### augmentation, cross-validation, test evaluation

I have, say, a (balanced) data-set with 2k images for binary classification. What I have done is that randomly divided the data-set into 5 folds; copy-pasted all 5-fold data-set to have 5 exact ...
40 views

### On which data evaluate an object detection model ? (similar or real life data ?)

I'm training an object detection model (SSD300) to detect and classify body poses in thermal images. Even I have more than 2k different poses, but the background does not change much (I have only 5 ...
163 views

### Small size datasets for object detection, segmentation and localization

I am looking for a small size dataset on which I can implement object detection, object segmentation and object localization. Can anyone suggest me a dataset less than 5GB? Or do I need to know ...
25 views

### Labeling for multilabel image classification

with a friend of mine, we got in an argument over how to label images for multi-label. Note: Groups of a species and the species of catfish is important to recognize. The labels are: 'I': an ...
33 views

### Where can I upload a large photo database for public access? [closed]

I am applying for a grant, and one of the tasks we are seeking funding for is to make a large image database publicly available for users to train artificial intelligence (convolutional neural network)...
12 views

### EEG and Accelerometer Neural Network

I have frequency EEG data from fall and non-fall events and I am trying to incorporate it with accelerometer data that was collected at the same time. One approach is, of course, to use two separate ...
22 views

### How to use Before / After images to train a model

I am trying to create a model that can clean pictures of noise, blur, high luminosity etc, but I do not know how to do that. I have tried to search for it a lot, and I couldn't find anything that ...
35 views

### How can I compare EEG data with accelerometer data in 1 algorithm?

I have frequency EEG data from fall and non-fall events and I am trying to incorporate it with accelerometer data that was collected at the same time. One approach is, of course, to use two separate ...
8 views

### Hashing images detects false duplicates

Like I said in the title, I used a code I found to identify duplicate images however there are many false alarms. Can someone give me a link to some code I could use that really works? The problem ...
89 views

### Suggestion for finding the stable regions in spiral galaxy data?

I am working with a data set that consists of the actual pitch angle (given as PA(Y)) and the pitch angle at each radii (listed from 1 to 217). In the image below, ...
59 views

### How to correctly label images for multi-label classification?

I have images that contain lots of elements. Some I know, some I don't. I want to know if it's ok to only label those I do know. Let's take this image for example. I would label the green stuff and ...
16 views

### Ambulance dataset needed

Could I get a dataset that can classify ambulances? I have searched everywhere, but, couldn't seem to get hold of a set of annotated images for ambulances.
24 views

### Should I add some noise when the dataset is small?

I want to create a small dataset (about 10 classes and 20-30 images each), should I add some noise (wrong label sample) in the training, validation and test datasets, and why?
48 views

### Is there an audio dataset with the corresponding phonemes in the audio?

I am looking for a dataset of clear audio, a corresponding transcript (optional), and most importantly a list of all the phonemes said in the audio, with the length of each phoneme and a mention of ...
27 views

### Are there free and easy-to-use annotation tools for 3D bounding boxes?

Are there free and easy-to-use annotation tools for 3D bounding boxes? There is a lot of annotation tools out there, but most of them only good for 2d boxes.
35 views

### Is it possible to use AI for detecting the volume of a cup

I was just wondering if it's possible to use Machine Learning to train a model from a dataset of images of cups with a given volume in the image and then use object detection to detect other cups and ...