wyj95anan的博客

from textblob import TextBlob import pandas as pd #报错Resource averaged_perceptron_tagger not found. Please use the NLTK Downloade的解决方法 import nltk nltk.download('averaged_perceptron_tagger') #读入数据 Idea=pd.read_csv(r"E:\1.csv",encoding="utf-8") i=len(Ide.

本文使用python的gensim通过tf-idf计算文本相似性。 相似度计算部分参考：https://www.jianshu.com/p/edf666d3995f 1）导入相关包 import jieba.posseg as pseg import codecs from gensim import corpora, models, similarities import pandas as pd import re import string from nltk.corpus import stopwo

可读性计算方法参考： https://python.ctolib.com/cdimascio-py-readability-metrics.html 可读性计算方法有 The Flesch Reading Ease formula Flesch-Kincaid Grade Level The Fog Scale (Gunning FOG Formula) The SMOG Index Automated Readability Index The Coleman-Liau Index Linsear Wri

信息熵：信息熵越大，信息越多，与以前的消息相比，措辞越独特，信息熵越高 参考： 信息熵求解部分：https://www.jianshu.com/p/468e2af86d59 导入包 import numpy as np import pandas as pd import nltk import re import string from nltk.corpus import stopwords from nltk.tokenize import word_tokenize from nltk.stem.p