用Soundex, python替换单词

问题描述 投票:3回答:2

我有一个句子列表,基本上我的目的是将所有不同形式的介词 "oppo,nr,off,abv,behnd "替换为正确的拼写 "opposite,near,over,behind "等等。这些单词的声母代码是相同的,所以我需要建立一个表达式来逐字逐句地遍历这个列表,如果声母相同,就用正确的拼法来替换。

例如:['Jack was standing nr the tree' , 'they were abv everything he planned' , 'Just stand opp the counter' , 'Go twrds the gas station'] 。

所以我需要把单词nr,abv,oppo和twrds替换成它们的全称形式。我需要对这个列表进行迭代......这是我的声母算法。

import string

allChar = string.uppercase + string.lowercase
charToSoundex = string.maketrans(allChar, "91239129922455912623919292" * 2)

def soundex(source):
    "convert string to Soundex equivalent"

    # Soundex requirements:
    # source string must be at least 1 character
    # and must consist entirely of letters
    if (not source) or (not source.isalpha()):
    return "0000"

    # Soundex algorithm:
    # 1. make first character uppercase
    # 2. translate all other characters to Soundex digits
    digits = source[0].upper() + source[1:].translate(charToSoundex)

    # 3. remove consecutive duplicates
    digits2 = digits[0]
    for d in digits[1:]:
        if digits2[-1] != d:
           digits2 += d

    # 4. remove all "9"s
    # 5. pad end with "0"s to 4 characters
    return (digits2.replace('9', '') + '000')[:4]

if __name__ == '__main__':
   import sys
   if sys.argv[1:]:
      print soundex(sys.argv[1])
   else:
    from timeit import Timer
    names = ('Woo', 'Pilgrim', 'Flingjingwaller')
    for name in names:
        statement = "soundex('%s')" % name
        t = Timer(statement, "from __main__ import soundex")
        print name.ljust(15), soundex(name), min(t.repeat())

我是一个新手,所以万一有其他的方法,你可以建议,这将是感激......谢谢。

python nltk soundex metaphone
2个回答
0
投票

我将使用enchant模块。

import enchant
d = enchant.Dict("en_US")

phrase = ['Jack was standing nr the tree' ,
'they were abv everything he planned' ,
'Just stand opp the counter' ,
'Go twrds the gas station']

output = []
for section in phrase:
    sect = ''
    for word in section.split():
        if d.check(word):
            sect += word + ' '
        else:
            for correct_word in d.suggest(word):
                if soundex(correct_word) == soundex(word):
                    sect +=  correct_word + ' '
    output.append(sect[:-1])
© www.soinside.com 2019 - 2024. All rights reserved.