Word Similarity and Word Analogy
-
Based on the
wordsim-240andwordsim-296, chinese word similarity script. -
Based on the
analogy.txt, chinese word analogy script. -
English word embedding evaluation(en_embedding_similarity)
Requirement
- python:
3.6.1
English word embedding evaluation Usage
- About how to evaluate the english word embedding, see en-embedding-similarity-README for details.
Word Similarity Usage
Word Similarity Accuracy:
if you want to evaluate your similarity file:
python word_similarity.py --vector embed_path --similarity similar_file
if you want to evaluate on default file (wordsim-240 and wordsim-296)
python word_similarity.py --vector embed_path
Find Top 10 similar words:
python find_wordSimilarity.py --vector embed_path
Word Analogy Usage
Word Analogy Accuracy:
if you want to evaluate your analogy file:
python word_analogy.py --vector embed_path --analogy analogy_file
if you want to evaluate on default file (analogy.txt that from chen)
python word_analogy.py --vector embed_path
Find the closest analogy:
python find_wordAnalogy.py --vector embed_path
Word Similarity Output
1、Rho Score
2、 Top 10 similar words
Enter word >> 男人
女人, 中年男人, 女孩, 敢爱敢恨, 爱管闲事, 失婚, 男士们, 少妇, 女们, 憨直
Enter word >> 中国
大陆, 内地, 我国, 华中地区, 中国民间文艺家协会, 江浙沪, 华南地区, 中国政府, 中医药学会, 中华人民共和国
- output top ten, the most similar In the front
Word Analogy Output
1、Word Analogy Accuracy:
Category: city
Total count: 175
Accuracy: 0.8
Mean rank: 4.942857142857143
Category: family
Total count: 272
Accuracy: 0.5661764705882353
Mean rank: 21.47426470588235
Category: capital
Total count: 677
Accuracy: 0.7562776957163959
Mean rank: 2.224519940915805
Total acc: 0.7170818505338078
Total mean rank: 7.306049822064057
Total number: 1124
2、Find the closest analogy
Enter three word >> 男人 女人 男孩
[男人 - 女人] is like [男孩 - 女孩]
Enter three word >> 北京 上海 纽约
[北京 - 上海] is like [纽约 - 布鲁克林]
Question
-
if you have any question, you can open a issue or email bamtercelboo@{gmail.com, 163.com}.
-
if you have any good suggestions, you can PR or email me.