我想使用漂亮的汤来解析其中包含表格数据的HTML文档。我正在为此做一些NLP。
表格单元格可能只有数字,或者可能是文本重的。因此,在执行汤.get_text()之前,我希望根据以下条件更改表格数据的内容。
条件:如果单元格中有两个以上的单词(我们可以将数字视为一个单词),则仅保留它,否则将单元格内容更改为空字符串。
<code to change table data based on condition>
soup = BeautifulSoup(html)
text = soup.get_text()
这里是我尝试过的东西。
tables = soup.find_all('table')
for table in tables:
table_body = table.find('tbody')
rows = table_body.find_all('tr')
for row in rows:
cols = row.find_all('td')
for ele in cols:
if len(ele.text.split(' ')<3):
ele.text = ''
但是,我们无法设置ele.text,因此会引发错误。
这是带有表的简单HTML结构
<!DOCTYPE html>
<html>
<head>
<title>HTML Tables</title>
</head>
<body>
<table border = "1">
<tr>
<td><p><span>Row 1, Column 1, This should be kept because it has more than two tokens</span></p></td>
<td><p><span>not kept</span></p></td>
</tr>
<tr>
<td><p><span>Row 2, Column 1, should be kept</span></p></td>
<td><p><span>Row 2, Column 2, should be kept</span></p></td>
</tr>
</table>
</body>
</html>
一旦找到元素,然后使用ele.string.replace_with("")
基于您的示例html
html='''<html>
<head>
<title>HTML Tables</title>
</head>
<body>
<table border = "1">
<tr>
<td><p><span>Row 1, Column 1, This should be kept because it has more than two tokens</span></p></td>
<td><p><span>not kept</span></p></td>
</tr>
<tr>
<td><p><span>Row 2, Column 1, should be kept</span></p></td>
<td><p><span>Row 2, Column 2, should be kept</span></p></td>
</tr>
</table>
</body>
</html>'''
soup=BeautifulSoup(html,'html.parser')
tables = soup.find_all('table')
for table in tables:
rows = table.find_all('tr')
for row in rows:
cols = row.find_all('td')
for ele in cols:
if len(ele.text.split(' '))<3:
ele.string.replace_with("")
print(soup)
输出:
<html>
<head>
<title>HTML Tables</title>
</head>
<body>
<table border="1">
<tr>
<td><p><span>Row 1, Column 1, This should be kept because it has more than two tokens</span></p></td>
<td><p><span></span></p></td>
</tr>
<tr>
<td><p><span>Row 2, Column 1, should be kept</span></p></td>
<td><p><span>Row 2, Column 2, should be kept</span></p></td>
</tr>
</table>
</body>
</html>