Questions tagged [named-entity-recognition]
The named-entity-recognition tag has no usage guidance.
18
questions
0
votes
0
answers
17
views
AI for text extraction and text recognition
Starting from text I'd like to be able to identify specific informations.
Example :
Input texts : "The invoice number is 18", "Inv : 75", "Inv N. : 84"
Identified invoice ...
- 101
0
votes
0
answers
10
views
What is the correct way to do BIO notation for labelling in named entity recognition?
I'm trying to understand, what is the correct approach for labelling for NER.
Some sources state:
use BIO notation, which differentiates the beginning (B) and the
inside (I) of entities
...
- 101
0
votes
2
answers
109
views
How much labelling is required for NER with SpaCy?
I have transaction data and I would like to extract the merchant from the transaction description. I am new to this but I just came across Named Entity Recognition and SpaCy. I have hundreds of ...
0
votes
0
answers
14
views
How might I extend named entity recognition to recognise sentence or phrases as belonging to certain classes, such as commentary, opinion etc?
Suppose I have a news report such as
THE ARCE BATTALION COMMAND HAS REPORTED THAT ABOUT 50 PEASANTS OF VARIOUS AGES HAVE BEEN KIDNAPPED BY TERRORISTS OF THE FARABUNDO MARTI NATIONAL LIBERATION FRONT [...
- 251
0
votes
0
answers
24
views
Identify Merchants from Transaction Dataset
I have a transaction dataset, each transaction is in an unstructured format. The objective is to identify merchant from each transaction. If we look it from NER point of view, there would be problem ...
0
votes
1
answer
690
views
Does BERT freeze the entire model body when it does fine-tuning?
Recently, I came across the BERT model. I did some research and tried some implementations.
I wanted to tackle a NER task, so I chose the BertForSequenceClassifications provided by HuggingFace.
...
- 1
0
votes
1
answer
30
views
Extracting keywords from messages
I'm starting a project where I want to extract keywords from given messages. The keywords are for example something like: "hard disk", "watch" or other technical components. I'm ...
- 1
2
votes
1
answer
98
views
Which AI techniques are there that combine multiple models to make sense of data at different stages?
I have been working to design a system that uses multiple machine learning models to make sense of data that is dynamically webscraped. Each AI would handle a specific task, for example:
An AI model ...
- 23
2
votes
0
answers
67
views
Extracting "hidden" costs from financial statements using NLP
I'm designing a NLP model to extract various kinds of "hidden" expenses from 10-K and 10-Q financial statements. I've come up with about 7 different expense categories (restructuring costs, ...
- 21
0
votes
1
answer
39
views
How to train a sequence labeling model with annotations from three annotators?
I have a dataset of movie reviews annotated by 3 persons. The following example contains one sentence with corresponding annotations from 3 different persons.
...
- 3
4
votes
1
answer
3k
views
How to understand 'losses' in Spacy's custom NER training engine?
From the tid-bits, I understand of neural networks (NN), the Loss function is the difference between predicted output and expected output of the NN. I am following this tutorial, the losses are ...
- 157
0
votes
1
answer
135
views
Should we use a pre-trained model or a blank model for custom entity training of NER in spacy?
Further to my last question, I am training a custom entity of FOODITEM to be recognized by Spacy's Name Entity Recognition engine. I am following tutorials online, following is the advise given in ...
- 157
1
vote
0
answers
141
views
How can I use this Reformer to extract entities from a new sentence?
I have been looking at the NER example with Trax in this notebook. However, the notebook only gives an example for training the model. I can't find any examples of how to use this model to extract ...
- 121
1
vote
0
answers
44
views
Determining if an entity in free text is 'present' or 'absent'; what is this called in NLP?
I'm processing a semi-structured scientific document and trying to extract some specific concepts. I've actually made quite good progress without machine-learning so far, but I got to a block of true ...
- 111
-1
votes
1
answer
164
views
Do we have to use the IOB format on labels in the NER dataset? If so, why?
Do we have to use the IOB format on labels in the NER dataset (such as B-PERSON, I-PERSON, etc.) instead of using the usual format (PERSON, ORGANIZATION, etc.)? If so, why? How will it affect the ...
2
votes
1
answer
104
views
Is it possible to create a named entity recognition system without using POS tagging in the corpus?
Is it possible to create a named entity recognition system without using POS tagging in the corpus?
2
votes
2
answers
331
views
What are the main ideas behind NER?
Named entity recognition (NER), also known as entity chunking/extraction, is a popular technique used in information extraction to identify and segment the named entities and classify or categorize ...
- 1,193
1
vote
0
answers
28
views
Are there any good resources (preferably books) about techniques used for entity extraction?
Given some natural language sentences like
I would like to talk to Mr. Smith
I would like to extract entities, like the person "Smith".
I know that frameworks, which are capable of doing ...
- 61