I have not studied machine learning or AI really, but my job sometimes requires me to automate stuff. Right now the requirement I have, seems to be under AI domain, but I am not sure about terminologies or how to go about it. I will really appreciate if someone can guide me about the direction I need to start from.
(PS: This question might not belong on this SE, in that case please direct me to suitable SE)
What I'm required to do is find references on web about a certain situation. As an example I'll use "Music", so I have to make a system which will search around the web (Google and Twitter mainly) to see if there is any news/mention/event related to Music that occurred today, if so how many references (i.e. how big of a deal it is making).
It is not the generic term music which is expected in the output, but the names of Musicians, i.e. in Music this and this Artist appeared this many times.
I have to give the number of references, and also provide the references in output so that one can read them in detail.
The challenges are
- One event can be covered by many websites, and there can be one main website that published the original story with full details, while others just spread the word around in summarized way.
How do you filter references to pick the most suitable one, to show in results to the system's user, because I can not give user ~50 references to manually read through, I have to give like 1-2 suitable reference
- I need to give the name of the artist. One site will have many words, how do I know which word is actually the artist's name? One option can be to have a pre compiled list of specific artists and just search for them individually. But this way, I can be missing new artists.
The challenges I have, must have been addressed by some existing algorithm or mechanism, I'll appreciate if someone can let me know what kind of algo etc I need to refer to or study to get the task done.