如何根据所需格式修改BeautifulSoup的get_text函数?

问题描述 投票:0回答:1

我想抓取this网页。我正在使用BeautifulSoup。

url="https://www.blockchain.com/btc/block/00000000000000000011898368c395f1c35d56ea9109d439256d935a4fe7d656" 
page=requests.get(url)
soup=BeautifulSoup(page.text,'html.parser')
block_details=soup.find(class_="hnfgic-0 jlMXIC")
print block_details.get_text()

输出为:

Hash00000000000000000011898368c395f1c35d56ea9109d439256d935a4fe7d656Confirmations8Timestamp2019-11-21 17:52Height604806MinerSlushPoolNumber of Transactions2,003Difficulty12,973,235,968,799.78Merkle root49ee8cb431ef3e613fdc9ac3146335d1a608a0e6afb5cf9ab44c9ddc51acfbe9Version0x20000000Bits387,297,854Weight3,993,364 WUSize1,355,728 bytesNonce849,455,972Transaction Volume4560.73542334 BTCBlock Reward12.50000000 BTCFee Reward0.19346486 BTC

但是我希望输出为:

Hash
00000000000000000011898368c395f1c35d56ea9109d439256d935a4fe7d656
Confirmations
8
Timestamp
2019-11-21 17:52
Height
604806
.
.
.

我打算将此字符串与strsplit函数一起使用。因此,两个文本之间的结尾行分隔符将帮助我使用strsplit("\n")区分字符串。请帮助。

编辑:Selenium的.text函数生成我想要的输出,但是我想使用BeautifulSoup进行修复。

html text beautifulsoup screen-scraping strsplit
1个回答
0
投票

您可以将separator='\n'参数添加到get_text()方法:

import requests
from bs4 import BeautifulSoup

url="https://www.blockchain.com/btc/block/00000000000000000011898368c395f1c35d56ea9109d439256d935a4fe7d656"
page=requests.get(url)
soup=BeautifulSoup(page.text,'html.parser')
block_details=soup.find(class_="hnfgic-0 jlMXIC")
print(block_details.get_text(separator='\n'))  # <-- note the separator parameter

打印:

Hash
00000000000000000011898368c395f1c35d56ea9109d439256d935a4fe7d656
Confirmations
13
Timestamp
2019-11-21 17:52
Height
604806
Miner
SlushPool
Number of Transactions
2,003
Difficulty
12,973,235,968,799.78
Merkle root
49ee8cb431ef3e613fdc9ac3146335d1a608a0e6afb5cf9ab44c9ddc51acfbe9
Version
0x20000000
Bits
387,297,854
Weight
3,993,364 WU
Size
1,355,728 bytes
Nonce
849,455,972
Transaction Volume
4560.73542334 BTC
Block Reward
12.50000000 BTC
Fee Reward
0.19346486 BTC
© www.soinside.com 2019 - 2024. All rights reserved.