NLTK 和语言检测

问题描述

如何使用 NLTK 检测文本是用什么语言编写的?

How do I detect what language a text is written in using NLTK?

我看到的例子使用了 nltk.detect，但是当我在我的 mac 上安装它时，我找不到这个包.

The examples I've seen use nltk.detect, but when I've installed it on my mac, I cannot find this package.

推荐答案

您是否遇到过以下代码片段?

Have you come across the following code snippet?

english_vocab = set(w.lower() for w in nltk.corpus.words.words())
text_vocab = set(w.lower() for w in text if w.lower().isalpha())
unusual = text_vocab.difference(english_vocab)

来自 http://groups.google.com/group/nltk-users/browse_thread/thread/a5f52af2cbc4cfeb?pli=1&safe=active

或者下面的演示文件?

https://web.archive.org/web/20120202055535/http://code.google.com/p/nltk/source/browse/trunk/nltk_contrib/nltk_contrib/misc/langid.py

这篇关于NLTK 和语言检测的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持！