从网站的项目列表中提取所有链接

问题描述 投票:0回答:0

我试图使用Python从该网站提取所有壁画链接:https://streetartcities.com/cities/losangeles/artworks。但我的代码无法正常工作并给我一个空的输出。我不知道该网站是否包含 JavaScript 或其他编程语言。谁能简要解释一下这个问题并帮助我调试我的代码?谢谢!

from requests_html import HTMLSession
import warnings

warnings.filterwarnings("ignore", category=DeprecationWarning) ## ignore the Deprecation warning message

s = HTMLSession()

def get_mural_links(page):
    url = f'https://streetartcities.com/cities/losangeles/artworks/{page}'
    links = []
    r = s.get(url)

    grid = r.html.find('div.p-5 div.grid.mt-4.grid-cols-2.md\:grid-cols-3.gap-3')
    for item in grid:
        links.append(item.find('a', first=True).attrs['href'])
    return links

print(get_mural_links(1))
python web-scraping programming-languages
© www.soinside.com 2019 - 2024. All rights reserved.