在尝试使用pdfminer.six提取文本时,如何修复“UnicodeDecodeError”?

问题描述 投票:1回答:1

当使用通过latest version from git安装的pdfminer(pip install git+https://github.com/pdfminer/pdfminer.six.git)时,我得到一个UnicodeEncodeError:

Traceback (most recent call last):
  File "pdfminer_sample3.py", line 34, in <module>
    print(convert_pdf_to_txt("samples/numbers-test-document.pdf"))
  File "pdfminer_sample3.py", line 27, in convert_pdf_to_txt
    text = retstr.getvalue()
  File "/usr/lib/python2.7/StringIO.py", line 271, in getvalue
    self.buf += ''.join(self.buflist)
UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in position 0: ordinal not in range(128)

我该如何解决这个问题?

脚本

#!/usr/bin/env python

from pdfminer.pdfinterp import PDFResourceManager, PDFPageInterpreter
from pdfminer.converter import TextConverter
from pdfminer.layout import LAParams
from pdfminer.pdfpage import PDFPage
from StringIO import StringIO
import codecs

def convert_pdf_to_txt(path):
    rsrcmgr = PDFResourceManager()
    retstr = StringIO()
    codec = 'utf-8'
    laparams = LAParams()
    device = TextConverter(rsrcmgr, retstr, codec=codec, laparams=laparams)

    fp = file(path, 'rb')
    interpreter = PDFPageInterpreter(rsrcmgr, device)
    password = ""
    maxpages = 0
    caching = True
    pagenos = set()

    for page in PDFPage.get_pages(fp, pagenos,
                                  maxpages=maxpages,
                                  password=password,
                                  caching=caching,
                                  check_extractable=True):
        interpreter.process_page(page)

    text = retstr.getvalue()

    fp.close()
    device.close()
    retstr.close()
    return text

print(convert_pdf_to_txt("samples/numbers-test-document.pdf"))

示例pdf

https://www.dropbox.com/s/khjfr63o82fa5yn/numbers-test-document.pdf?dl=0

python pdf python-unicode pdfminer
1个回答
5
投票

from StringIO import StringIO替换from io import BytesIO

retstr = StringIO()取代retstr = BytesIO()

© www.soinside.com 2019 - 2024. All rights reserved.