令牌归一化python

Question

我需要将令牌（例如“不”）转换为小写。如果令牌末尾有否定符号，则应将其删除。

我确实走了这么远，但这是错误的。我该如何进行？

def normalize(token):

    list = ["Doesn't", "Don't"]

    if token in list:

     print(list.lower())

    print(list.replace("n't", ""))

    return list

    print("Doesn't")

Answer 1

这符合您的要求吗？

def normalize(token):
    token = token.lower()
    if token[-3:] == "n't":
        return token[:-3]
    else:
        return token

输出：

>>> normalize("Doesn't")
'does'
>>> normalize("Don't")
'do'