Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange
Join us in building a kind, collaborative learning community via our updated Code of Conduct.

This tag is to be used in cases of doubts regarding applications or programs based on categorization like fraud detection, market segmentation (predicting whether or not a customer will respond to a promotion), etc.

3
votes
1answer
32 views

K-means using only certain dataframe columns

I'm using the k-means algorithm from the scikit-learn library, and the values I want to cluster are in a pandas dataframe with 3 columns: ID ...
2
votes
0answers
41 views

Loss function for Hierarchical Multi-label classification

I am looking to try different loss functions for a hierarchical multi-label classification problem. So far, I have been training different models or submodels like multilayer perceptron ( MLP )branch ...
2
votes
1answer
21 views

What's an appropriate algorithm for classification with categorical features?

My input data consists of a series of 8 integers. Each integer is a discrete token, rather than a relative numeric value (i.e. '1' and '2' are as distinct as are '1' and '100'). The output is a ...
0
votes
2answers
40 views

What kind of problem is “email text extraction”?

I need to retrieve just the text from emails. The emails can be in HTML format, and can contain huge signatures, disclaimer legalese, and broken HTML from dozens of forwards and replies. But, I only ...
4
votes
2answers
44 views

Why are documents kept separated when training a text classifier?

Most of bibliography consider text classification as the classification of documents. When using bag of words and bayesian classification, they usually use the statistic TFIDF, where TF normalizes the ...
0
votes
0answers
23 views

NLP for semantic retrieval

I want to use NLP for semantic retrieval. I am new to this field. Can anyone suggest toolkit or tutorial to learn and implement NLP from scratch.
1
vote
0answers
23 views

small multinomial Naive Bayes text classification probabilities

When applying multinomial Naive Bayes text classification I get very small probabilities(around 10e-48) so there's no way for me to know which classes are valid ...
2
votes
1answer
37 views

The use of classification algorithms nowdays

What is the utility today of traditional machine learning algorithms such as classification algorithms with the trend of deep learning? I mean can we still use the classification algorithms for some ...
2
votes
2answers
50 views

Finding the right questions to increase accuracy in classification

Lets say I have a list of 100k medical cases from my hospital, each row = patient with symptoms (such as fever , funny smell, pain etc.. ) and my labels are medical conditions such as Head trauma, ...
4
votes
3answers
65 views

What kind of neural network architecture do I use to classify images into one hundred thousand classes?

I have an image dataset where objects may belong to one of the hundred thousand classes. I want to know what kind of neural network architecture should I use in order to achieve this.
2
votes
1answer
64 views

Machine Learning - Is selected models combination good?

I've selected more than 10 discriminative (Classification) models, each wrapped with a BaggingClassifier object, optimized with a GridSearchCV, and all of them placed within a VotingClassifier object. ...
2
votes
1answer
35 views

If use the weights from previous iteration of a k-fold cross validation to seed a neural network classifier would I be overfitting?

As is done traditionally, I used k-fold cross validation to select and optimize the hyper parameters of my neural network classifier. When it was time to store the final model for future predictions, ...
2
votes
2answers
68 views

Question classification according to chapters

I have a corpus, say an instruction manual. The text in this manual is grouped into chapters and each chapter is split up into sections. For example, Chapter 1/Section 1, Chapter 1/Section 2 and so on....
1
vote
1answer
14 views

Decision tree: more than 2 classes, how to represent elements that are in a class vs ones that aren't?

I'm building a decision tree and would like to separate (for example) the elements that are in class 0 from those in classes 1 and 2, case in point: ...
1
vote
2answers
63 views

Classifying non-labeled data with high dimensionality

Disclaimer: I am a novice in the world of machine learning, so please excuse my ignorance. My dataset consists of things like age, days since last visit, etc. This information is medical related. ...
1
vote
0answers
48 views

How to implement AI/ML to classify various types of files

I am working on a task that requires me to classify a large amount of mixed files on a backup drive (more than 10 TB with more than 32 million files) based on content. The included file types are ...
2
votes
3answers
110 views

Can this problem be solved by AI?

I am looking in to building a kind of troubleshooting web application. It would be a form that starts with a first question. Depending on the answer, you get a follow up question and so on until the ...
0
votes
0answers
31 views

Formulating a relationship between Strings

I was asked about a problem today at work and while it is not an area of expertise I am intrigued by it. The concept is given a delimited file with the first (single) row containing column names ...
2
votes
0answers
70 views

Supervised K-means clustering doesn't appear to work

I have a data set containing actions taken by customers (view a product, add a product to cart, purchase product), the product bought (if any) and times of said actions and I am attempting to use K-...
0
votes
0answers
13 views

Blackbox Classification Network help

I am new to neural networks so I am sorry if the following task, I require help with, seems silly. Each test sample has input of 30 real values, some of the values may also be unknown(NaN). We dont ...
1
vote
1answer
40 views

How to refine K-means clustering on a data set?

I'm working with a data set where the data is stored in a string such as AxByCyA where A, B ...
0
votes
0answers
36 views

Why aren't neural network classifiers incentivised to just display the average of training labels?

I've been following 3Blue1Brown's neural network tutorial series and have been working on making a neural network classifier based on what I've learned. After writing all the code and debugging, I ...
2
votes
1answer
44 views

Is it possible to classify songs by genres based on spectrograms?

Is it possible to categories songs based on their spectrograms using image recognition or would there need to more features? I was thinking that the spectrograms might also run into problems with EDM ...
0
votes
0answers
23 views

Retraining a trained model in real-time

I have a trained CNN model which is 95% Accurate. It classifies, a family and a group of friends who are eating in a restaurant. I made two folders inside the Training and Testing set with the images ...
3
votes
2answers
41 views

Two data classes for a convolutional neural network, can one have a LOT more images for training than the other?

I have two classes in the training set: one that has images with a feature and the other of images without that feature. Can there be a LOT more images with "no feature" so I can fit in all possible ...
4
votes
1answer
27 views

Looking to build, compile, and/or find dataset for serial-parallelized code examples

I'm looking to perform two tasks: Train a classifier to classify code as serial or parallel Train a generative algorithm to generate parallel code from serial For the first task a simple scraper ...
1
vote
0answers
55 views

Fuzzy confusion matrix for fuzzy classifier

Let us suppose I have a NxN matrix and I want to classify in M classes each entry of the matrix using a fuzzy classifier. The ...
1
vote
0answers
27 views

Learning from events. Supervised, Unsupervised or MDP?

I have a large set of simulation logs for a market simulation of which I want to learn from. The market includes: customers products (subscriptions) The customers choose products and then stick with ...
0
votes
1answer
55 views

How to make training data for AI

Right now I'm planning to make a DNN for classifying taste of crystals with their molecular structure which include information like no of atoms mass of each atoms atomic no of atoms. How should I ...
-1
votes
1answer
31 views

Decision tree classifier

I have seen weka j48 classifier, I want to build a classifier similar to it but I don't know how to go about it. Can anyone advice me on how to create a classifier algorithm for decision tree?
2
votes
1answer
48 views

Facial recognition and classifying unknowns with neural networks

As far as I understand, neural networks aren't good at classifying 'unknowns', i.e. objects that do not belong to a learned class. But how do face detection/recognition approaches usually determine ...
1
vote
0answers
18 views

Feature Selection algorithm for a high featured data

I have a cancer patient database from mass spectrometry on patients which consists of more than half million features. My task is to apply a feature selection algorithm to extract the most relevant ...
1
vote
0answers
28 views

Improving learning rate for classification task

I am trying to perform classification task using Keras and tensorflow. However, the learning converges after achieving an accuracy of 57%. All my inputs and outputs are categorical data. Am I using ...
2
votes
1answer
125 views

Training a Yes/No NN for Image Classes

I am fairly a newbie to Neural Networks. I wanted to ask if it is possible to train a NN to identify only one type object? For instance, a table from a large set of images, where the NN should be ...
4
votes
1answer
75 views

Methods to tell if a question can be answered from a paragraph

I'm working on a project related to machine Q&A, using the SQuAD dataset. I've implemented a neural-net solution for finding answers in the provided context paragraph, but the system (obviously) ...
-1
votes
2answers
71 views

Bayesian decision function

How to prove and what is the mathematical condition in terms of probability that a MEASURABLE FUNCTION is a bayesian decision function ? Can you give an example with standard or weighted binary ...
0
votes
1answer
42 views

Is there any research on neural networks with multiple outputs for hierarchical label classification?

I had this idea of training for example a CNN on images, and having output branches at several of its intermediate layers. The early layers' output branch might then predict high-level class of ...
4
votes
1answer
107 views

How do I statistically evaluate a ML model?

I have a model that predicts sentiment of tweets. Are there any standard procedures to evaluate such a model in terms of its output? I could sample the output, work out which are correctly predicted ...
5
votes
3answers
86 views

Is it better to make neural network to have hierchical output?

i'm quite new to neural network and i recently built neural network for number classification in vehicle license plate. It has 3 layers: 1 input layer for 16*24(382 neurons) number image with 150 dpi ,...
3
votes
1answer
64 views

Can I combine two classifiers that make different kinds of errors to get a better classifier?

I have a dataset with 2,23,586 samples out of which i used 60% for training and 40% for testing. I used 5 classifiers individually, SVM, LR, decision tree, random forest and boosted decision trees. ...
0
votes
0answers
30 views

Steps to optimize SVM

I am using Spark to run an SVM model. I'm trying to optimize it but I just want to make sure I am doing all that is needed. First I do k fold cross validation which optimizes the parameters: ...
3
votes
1answer
43 views

Creating a classifier for simpler classifiers trained on few training samples

Suppose I have a classification problem with a stream of training-samples constantly arriving over time. I cannot keep all training-samples in memory, but I still want to train a classifier that will ...
2
votes
1answer
541 views

How to implement an “unknown” class in NN classification?

For example I need to detect classes for MNIST data. But I want to have not 10 classes for digits but also I want to have 11th class "not a digit". So that any letter (except "O" of course:) ), any ...
1
vote
0answers
101 views

Search minimum value with learning machine algorithm

I was wondering if its possible to classify or learn to estimate the minimum value in a table if the values are integer and represented 32 bits, and we can input all variable at the same moment like ...
0
votes
0answers
19 views

Which threshold should I use for SVM?

I am using Spark to run an SVM model. I don't have to set threshold for it to run. It's output has results for thresholds of 0 and 1. What are the procedures for deciding what is the 'best' threshold ...
4
votes
3answers
435 views

Classifier that minimizes false positive error

I have a two-class classification problem, where false positive error has a very big cost compared to the false negative-error. Is there a way to design a classifier for such problems (preferably with ...
2
votes
1answer
41 views

Naive Bayes explanation of the rule

On books and documents explaining the Naive Bayes generative algorithm I always find the following equation: argmaxy p(y|x) = argmaxy (p(x|y)*p(y)/p(x)) ≈ argmaxy (p(x|y)*p(y)) What I don't ...
5
votes
2answers
336 views

Deep Learning – Classification or Regression Approach?

I am fairly new to deep learning in general and I am currently facing a problem I want to solve using neural networks and I am unsure if it is a classification or regression problem. I am aware that ...
2
votes
2answers
251 views

Perceptron learning algorithm: different accuracies for different training methods

So, my question is a bit theoretical. I have been trying to implement a perceptron based classifier with outputs 1 and 0 depending on the category. I have used 2 methods: The ...
1
vote
1answer
56 views

Is there a way to classify sounds

To classify images we are using the tensorflow incection v3 NN. Is there a similar approach to classify sounds? As for example to be able to recognize the person who is talking or classify a general ...