Questions tagged [datasets]

For questions related to sets of data and their use in AI.

Filter by
Sorted by
Tagged with
2
votes
0answers
45 views

Shifting training data

I want to create a neural network and train it on some data, however I want to be able to create a new model without retraining it from the start. An example, I have 1000 data points in my training ...
6
votes
3answers
284 views

Has anybody tried unsupervised deep learning from youtube videos?

YouTube has a huge amount of videos, many of which also containing various spoken languages. This would presumably provide something like the data that a "challenged" baby would experience - "...
4
votes
1answer
37 views

Looking to build, compile, and/or find dataset for serial-parallelized code examples

I'm looking to perform two tasks: Train a classifier to classify code as serial or parallel Train a generative algorithm to generate parallel code from serial For the first task a simple scraper ...
3
votes
4answers
162 views

If we want to classify something as either a cat/dog or neither, do we need 2 or 3 classes?

Suppose one trains a CNN to determine if something was either a cat/dog or neither (2 classes), would it be a good idea to assign all cats and dogs to one class and everything else to another? Or ...
1
vote
1answer
77 views

How to make training data for AI

Right now I'm planning to make a DNN for classifying taste of crystals with their molecular structure which include information like no of atoms mass of each atoms atomic no of atoms. How should I ...
2
votes
0answers
142 views

Classification Learning - Normalization of time series and live usage

UPDATE: The tables look messed up so i put them on pastebin for better visibility. https://pastebin.com/gDX28uVF I am using Neural Network with different learning types (for example Standard ...
0
votes
2answers
77 views

A way to give more weight to particular data?

Let us for these purposes say with are working with any feed forward neural network. Let us also say, that we know beforehand that certain portion of our dataset arsignificantly more impactful or ...
5
votes
1answer
103 views

Find anomalies from records of categorical data

I have a data-set with $m$ observations and $p$ categorical variables (nominal), each variable $X_1, X_2,\dots, X_p$ has several different possible values. Ultimately, I am looking for a way to find ...
4
votes
1answer
121 views

What are some concrete steps to deal with the vanishing gradient problem?

I am training an ANN for classification between 3 classes. The ANN has an input layer, one hidden layer and a 3 node output layer. The problem I am facing is that the output being produced by the 3 ...
3
votes
2answers
539 views

Data-set values feature scaling: sigmoid vs tanh

As many papers point out, for better learning curve of a NN, it is better for a data-set to be normalized in a way such that values match a Gaussian curve. Does this process of feature normalization ...
1
vote
1answer
1k views

Human Height estimation using person detection techniques

I have a pedestrian dataset and would like to estimate human height in a video survillance using person detection techniques like YOLO Darknet or SSD (Single Shot Detectors). Would this technique work?...
2
votes
2answers
105 views

What are the possible social consequences of training neural networks with artificially generated data?

Machine learning models and, in particular, neural networks are trained with data often collected from the real world, such as images of real people. Meanwhile, neural networks (such as GANs) are also ...
5
votes
2answers
624 views

What is the effect of mislabeled training data?

Collecting and labeling training data for supervised learning tasks is incredibly time-consuming and costly. For instance, let's say you wrote a script that went on Google images and got you 5000 ...
0
votes
1answer
41 views

Recommendation system based on content type

I am new to this field and would like to know that for what kind of data types other than images, recommendation system can be created using machine learning. Suppose for contents like audio or video, ...
4
votes
1answer
416 views

Is there any free dataset of source code along with natural language description? [closed]

I am currently working on my MSc thesis, where I try to automatically convert description of an algorithm in natural language to source code in Python (the algorithms are quite simple, like revert an ...
5
votes
2answers
2k views

Does the quality of training images affect the accuracy of the neural network?

I just got into AI few months ago. I noticed most of the images in training datasets are usually low quality( almost pixelated). Does the quality of training images affect the accuracy of the neural ...
11
votes
4answers
236 views

How do I select the relevant features of the data?

Recently I was working on a problem to do some cost analysis of my expenditure for some particular resource. I usually make some manual decisions from the analysis and plan accordingly. I have a big ...
4
votes
3answers
191 views

Would this relatively small dataset be enough to train a CNN?

Scenario: I am trying to create a dataset with images of choice for different animal classes. I am going to train those images for classification using CNN. Problem: Let's assume I somehow don't have ...
2
votes
0answers
151 views

Preprocessing of training dataset for machine learning

I'm developing a log analyzer to predict and find errors in an equipment. Each logged data contains the following format: ...
3
votes
2answers
361 views

How to generate a dataset for question answering from books (like Facebook's bAbI)?

I wanted to train a chatbot for answering questions from books. I am trying to use Dynamic Memory Networks to do so. How can I generate a data set, as Facebook did in the case of bAbI tasks, so that ...
5
votes
1answer
106 views

How can one find / collect data for, and come up with ideas for, using Deep Learning / AI to improve one's everyday life?

I can see a lot of tutorials and examples about using TensorFlow and other free, open-source AI/ML/DL frameworks on enterprise level where enough data was collected for such AI solutions. How can one ...
8
votes
2answers
325 views

What are examples of techniques to prevent bias in artificial intelligence systems?

I recently read an article about how artificial intelligence replicates human stereotypes when applied to biased datasets. What are examples of techniques to prevent bias (and stereotypes) in ...
1
vote
1answer
402 views

Does neuroevolution require a labelled dataset?

A neuroevolution algorithm, such as DXNN, can be used to refine the topology and weights of an artificial neural network (ANN). The GA will require a fitness function, which means you need labeled ...
4
votes
1answer
1k views

Dataset containing images of varying dimensions and orientations

I am new to deep learning. I have a dataset of images of varying dimensions of a certain object. A few images of the object are also in varying orientations. The objective is to learn the features ...
6
votes
4answers
732 views

What are some datasets to train an MLP on simple tasks? [closed]

I have implemented an MLP. Now, I want to train it to solve simple tasks. Are there any data sets to train the MLP on simple tasks, that is, tasks with a small number of inputs and outputs? I ...
0
votes
2answers
451 views

Training network to detect spelling mistakes

I would like to know what kind of dataset I need (to prepare) for training the network to recognize the spelling mistakes in individual words for English text. Given the large database of words, ...
1
vote
2answers
982 views

In LSTM text generation can low amount of training data be compensated?

I'm playing with an LSTM to generate text. In particular, this one: https://raw.githubusercontent.com/fchollet/keras/master/examples/lstm_text_generation.py It works on quite a big demo text set ...
-3
votes
1answer
256 views

How many neurons would a network have after a training of 100k small images?

Is there any way to estimate how big the neural network would be after training session of 100,000 unlabeled images for unsupervised learning (like in STL-10 dataset: 96x96 pixels and color)? Not the ...
3
votes
0answers
67 views

How exactly does a validation data-set work work in machine learning? [closed]

With typical machine learning you would usually use a training data-set to create a model of some kind, and a testing data-set to then test the newly created model. For something like linear ...
4
votes
4answers
143 views

How to classify language as friendly or aggressive with AI?

Just for the purpose of learning I'd like to classify the likeliness of a tweet being in aggressive language or not. I was wondering how to approach the problem. I guess I need first train my neural ...

1 2 3 4
5