I need a word database to train from. I found a word2vec JS word vector database, but I need a method to teach it which words go in which patterns.

Please note that I am not asking to have you recommend a database, just asking for some qualities that I should look for in a database.

I want it to be able to run at a notice, and not take 10-ish minutes to set up.

I am using Word2Vec word vectors, provided in JSON form by Anthony Liu. I am using the 1000 word list.


What are some qualities I should look for in a word database to train from?

  • 1
    $\begingroup$ Welcome to AI... oh wait, never mind ;) $\endgroup$ – DukeZhou Apr 23 '18 at 21:25
  • $\begingroup$ It is not clear what the purpose of the "word database" is here. But in order to suggest what might be relevant data sources, we need to know more about the purpose of the end system. $\endgroup$ – Neil Slater Nov 22 '18 at 11:42
  • 2
    $\begingroup$ What do you need it for? $\endgroup$ – Martin Thoma Nov 22 '18 at 12:42
  • $\begingroup$ @MartinThoma The project I was using it in was a bot that would attempt to learn the english language. It would manually train based on. $\endgroup$ – FreezePhoenix Nov 25 '18 at 0:50
  • $\begingroup$ What training procedure do you use? $\endgroup$ – Martin Thoma Nov 25 '18 at 5:49

Depending on the type of your application (e.g., Text Mining, Named Entity Recognition, Clustering, Classification, Summarization, Sentiment Analysis, Concept Linkage ...) you should pay attention to different aspects, such as data types (e.g., Sequential, Text, Univariate, Multivariate, ...), attribute types, number of attributes, number of instances, etc. These techniques perform differently depending on the domain, requirements, data quality and so forth.

Maybe if you could give more information about your problem we would be able to provide you with a more specific answer.

| improve this answer | |
  • $\begingroup$ I'm looking for a database to train a word recognization AI on that would respond with a semi-relevant response. $\endgroup$ – FreezePhoenix Aug 24 '18 at 11:19
  • 4
    $\begingroup$ There is way too little information to give a good answer $\endgroup$ – Martin Thoma Nov 22 '18 at 12:43

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.