# Tag Info

5

There are various dataset available such as Pascal VOC dataset: You can perform all your task with these. size of the dataset is as follows ADE20K Semantic Segmentation Dataset: you can perform only segmentation here COCO dataset: This is rich dataset but a size larger then 5 GB so you can try downloading using google colab in your drive and then make ...

5

The difference between the validation and test set in my opinion should be explained in this way: the validation set is meant to be used multiple times. the test set is meant to be used only once. I think that the misunderstanding here arise because machine learning is mostly taught focusing only on a specific part of a large pipeline, which is the model ...

4

I will give a more thorough answer. There are 2 problems you might face. 1) Your neural net (in this case convolutional neural net) cannot physically accept images of different resolutions. This is usually the case if one has Fully-Connected layers, however if the network is Fully-Convolutional then it should be able to accept images of any dimension. ...

3

I do not know a specific tool that meets all the mentioned requirements. However, a long time ago, I had to do a very similar task of labeling tons of images into 10 classes. This is how I did this: Used a very basic clustering tool to cluster images into clusters (I set the number of clusters larger than 10 as I new some classes have very different ...

3

There are a few tools that you can use to annotate (or label) data. For example, labelme or Labelbox. Have a look at this question for more alternatives.

3

Of course, it's possible to define a problem where there is no relationship between input $x$ and output $y$. In general, if the mutual information between $x$ and $y$ is zero (i.e. $x$ and $y$ are statistically independent) then the best prediction you can do is independent of $x$. The task of machine learning is to learn a distribution $q(y|x)$ that is as ...

3

Yes, you can weight the loss function for each example, so that instead of your cost function being $$J = \sum_i \mathcal{L}(y_i, \hat{y}_i)$$ It will be $$J = \sum_i w_i\mathcal{L}(y_i, \hat{y}_i)$$ Where $i$ iterates over your data set, $\mathcal{L}$ is the loss function you are using, $y_i$ is ground truth for each example and $\hat{y}_i$ is ...

3

The sentences coming from the same document, author, etc., are unlikely to be independent, that is, the occurrence of a sentence $s_i$ in a certain document $d$ is likely correlated with the occurrence of another sentence $s_j$. If they are not independent, they can also not be independent and identically distributed (which is a stronger condition). The same ...

3

In computer science, if you say "A is a proxy for B", then it means that "A replaces B" (temporarily or not), or that "A is used as an intermediary for B". The term "proxy" usually refers to a server, i.e. there are the so-called proxy servers, which intuitively do the same thing (i.e. they are used as intermediaries). The following picture is worth more ...

2

I believe that the idea is to have a similar ratio of fraud/"normal transaction" as to the ones that bank encounter on real life. If you balance it you will probably have a lot of false positive once you apply your solution to real world's data and, if that may be fine for you to play with, it's not what a bank would like as they can't block too much of the ...

2

Look at Google's Open Image Dataset @ https://storage.googleapis.com/openimages/web/index.html They provide image-level labels, object bounding boxes, object segmentation masks, and visual relationships. Here is the link for the traffic signs dataset.

2

You can take a look at traffic data for example if you follow link1, link2 you can find 3 publicly available traffic datasets which are already preprocessed. You cold also look at air quality datasets offered by the government link3

2

Before jumping to modeling, there are a few tasks a data scientist (or ML/AI practitioner) must do: Ideation (or hypothesizing): Before applying any modeling approach, we need to ask the right questions. We must clearly mention our assumptions and declare how we want to measure the effectiveness of the pipeline. Note that, some tools/algorithms might not ...

2

This should be possible given the fact that ANNs have the ability to do the feature engineering and feature selection tasks by themselves. This means that given a lesser number of input parameters, the model will be able to generate and select additional features by itself. You will obviously not be able to understand or model these features manually. The ...

2

It depends on what is your ultimate goal. If your goal is to simply classify the object in the image, having more complex output won't help. Simpler output representation yields better result. If your goal is to detect the bounding box, output the bounding box. There is no need for a more complex output feature. If you use a segmentation method for bounding ...

2

Perhaps you can check this dataset out: http://www.aiskyeye.com/ The VisDrone2019 dataset is collected by the AISKYEYE team at Lab of Machine Learning and Data Mining , Tianjin University, China. The benchmark dataset consists of 288 video clips formed by 261,908 frames and 10,209 static images, captured by various drone-mounted cameras, covering ...

2

I am assuming the question you are asking is how to prevent over-fitting on the maximum accuracy. Your graph does show that your model over-fits. There is a couple of different methods to prevent over-fitting from happening. You can specify training to stop after a certain amount of epochs. In your case it seems to be 2 or 3 epochs. Take care as a new ...

2

This could be possible, providing you have the right dataset to train it on. The volume of a cup consist of width, height and depth. You can probably detect all three of those given the bounding box or the pixels of the cup. However detecting the dimensions of an object require a reference object, like a penny or your finger and you have to specify the ...

2

It is explained in this CrossValidated post. Top1 accuracy means the best guess (class with highest probability) is the correct result 58.9% of the time, while top5 accuracy means the correct result is in the top 5 best guesses (5 classes with highest probabilities) 87.7% of the time.

2

Decision Tree learners, on their own, are not a good way to deal with imbalanced data. The most commonly used algorithms, by default, make no attempt to address this problem. If you look carefully at the three sources you post, you will find that they actually all agree on this point. Two of the sources actually propose methods of addressing this ...

2

You should use both classes together. Let's say you use the method you proposed. Then they will be contradicting each other as one teaches the network to recognize people, not objects and the other teaches the network to recognizes objects not person. There is no need for seperation of the two classes, unless you are making two seperate classifier. Hope I ...

2

You can't label things you don't know. The goal of labeling is to label the things you want the classifier to learn so that when you run it in inference mode you can discover what is in your data (new data that you didn't use for training, validating, or testing). It is not a good idea to label small objects like the 'blue water' unless it is important to ...

2

In this paper: Unsupervised Machine Translation Using Monolingual Corpora Only the authors proposed a novel method. Intuitively it is an autoencoder, but the Start Of Sentence token is set to be the language type. One other advanced method is to use the pre-training model. In this paper: Cross-lingual Language Model Pretraining researchers proposed an ...

2

Simply stated, you use your validation set to regularize your model for unseen data. Test data is completely unseen data, on which you evaluate your model. Various validation strategies are used to improve your model to perform for unseen data. So strategies like k-fold cross-validation are used. Also, the validation set helps you in tuning your ...

2

A typical clustering algorithm is k-means (and not k-NN, i.e. k-nearest neighbours, which is primarily used for classification). There are other clustering algorithms, such as hierarchical clustering algorithms. sklearn provides functions that implement k-means (and an example), hierarchical clustering algorithms, and other clustering algorithms. To assess ...

2

One problem with clustering algorithms is that they will typically find you a solution, ie they will split your data set into clusters, but it will find you a structure even if there isn't one. Your data looks like it could consist of about 5 to 7 clusters, but it could equally well just be 2 or only 1. What you need to do after the clustering is to assess ...

1

If you want to evaluate on real thermal image dataset, you can use this one. Thermal Image dataset is mAP a relevant metric when I want to show result to a client ? (e.g a client doesn't understand if I tell him "my model has a mAP=0.7") Mean Average Precision is the relevant metric but it's more technical. You can start explaining with False Positives ...

1

NDDS is a UE4 plugin from NVIDIA to empower computer vision researchers to export high -quality synthetic images with metadata. NDDS supports images, segmentation, depth, object pose, bounding box, keypoints, and custom stencils. In addition to the expo rter, the plugin includes different components for generating highly randomized images. This randomization ...

1

Do you have to upload the images as image files (PNG, etc.)? If you can also upload the images in data format, then Kaggle might be a good solution. You can upload datasets there and share them publicly for data scientists to explore them, you can even add a sample notebook. I have done this with some image data myself which I used for a GAN. If the data ...

1

I think what you are actually talking about is semantic segmentation (where you label pixels individually). There is a difference in theses tasks like Classification, Detection or Semantic Segmentation. Classification refers to the task of giving a (usually) single label to the whole image, e.g. cat. But as you already noticed this does not nececerraly ...

Only top voted, non community-wiki answers of a minimum length are eligible