我正在尝试从以下位置抓取每个产品的品牌、名称、图片 URL：https://www.mecca.com.au/skin-care/
我在抓取图像 URL 时遇到问题，因为没有 href
例如产品页面之一：https://www.mecca.com.au/tatcha/indigo-cleansing-balm/I-059912.html?cgpath=skincare
<picture class="css-1azgcry-container" id="image-reponsive-container" data-testid="imageReponsiveContainer">
<img class="" title="Tatcha - Indigo Cleansing Balm" alt="Tatcha - Indigo Cleansing Balm" src="https://www.mecca.com.au/on/demandware.static/-/Sites- mecca-online-catalog/default/dw0a0707d8/product/tatcha/hr/i-059912-indigo- cleansing-balm-7-1-940.jpg" data-testid="imageReponsiveImg"></picture>我只想提取 src=
之后的图像 URL这是我的代码：
import requests
from bs4 import BeautifulSoup
url = "https://www.mecca.com.au/skin-care/"
params = {"start": "0", "sz": "36", "format": "ajax"}
for params["start"] in range(0, 36 * 5, 36):
productlinks = []
cataloguelist = []
soup = BeautifulSoup(requests.get('https://www.mecca.com.au/skin-care/', params=params).content, "html.parser")
products = soup.find_all('div', class_="grid-product-info")
for item in products:
for link in item.find_all('a', href=True):
productlinks.append(url + link['href'])
for link in productlinks:
response = requests.get(link)
soup = BeautifulSoup(response.content, "html.parser")
brand = soup.find('a', class_='css-1p371np-size5-size5-sansSerif-sansSerif-brandNameLink').text
name = soup.find('span', class_='css-1noela6-paragraph-paragraph-sansSerif-sansSerif-productName').text
### This is where I'm struggling, I tried 'picture', class_='css-1azgcry-container' as well
image = soup.find('picture', attrs={'css-1azgcry-container', 'img', 'alt', 'src'})
print(brand, name, image)感谢您的帮助！
在您的代码中，如果您要打印（图像），您将看到 HTML：
<picture class="css-1azgcry-container" data-testid="imageReponsiveContainer" id="image-reponsive-container"><img alt="MECCA COSMETICA - Renewing Gel Cleanser" class="" data-testid="imageReponsiveImg" src="https://www.mecca.com.au/on/demandware.static/-/Sites-mecca-online-catalog/default/dwf0d61029/product/mecca/hr/i-061159-renewing-gel-cleanser-1-940.jpg" title="MECCA COSMETICA - Renewing Gel Cleanser"/></picture>
这基本上意味着您需要更深入地挖掘一层。最好的方法是获取 id（
id="image-reponsive-container)代替：
image = soup.find('picture', attrs={'css-1azgcry-container', 'img', 'alt', 'src'})
用途：
image = soup.find(id='image-reponsive-container').find('img').get('src')
或者更好的是 CSS 选择器：
image = soup.select_one('#image-reponsive-container > img')['src']