使用 Beautiful Soup 时出现错误“AttributeError: 'NoneType' object has no attribute 'contents'”

问题描述 投票:0回答:0

我用不同的标准运行这部分代码,它给了我一个

AttributeError
.

surl_list = []
for i in range(1, 21):
    surl = 'https://www.zillow.com/' + city +'rentals/' + str(i) + '_p/'
    surl_list.append(surl)

headers = {
    "User-Agent": "Mozilla/5.0 (Windows NT 10.0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.135 Safari/537.36 Edge/12.10136"
}

sdata_list = []

for surl in surl_list:
    soup = BeautifulSoup(requests.get(surl, headers=headers).content, "html.parser")
    sdata = json.loads(
        soup.select_one("script[data-zrr-shared-data-key]")
        .contents[0]
        .strip("!<>-")
    )
    sdata_list += sdata["cat1"]["searchResults"]["listResults"]

我试过只运行部分并且它确实运行,但不是直接运行。

python web-scraping beautifulsoup anaconda spyder
© www.soinside.com 2019 - 2024. All rights reserved.