我正在尝试解决工作项目的第一个网络抓取问题，但在提取我需要的信息时遇到了问题。我怀疑这与包含javascript的页面有关。我已经对这个问题做了一些研究，我相信我的下一步可能涉及使用 RSelenium 包，但在深入研究该解决方案之前，我宁愿看看是否有一个更简单的解决方案。
我正在尝试从此页面“https://le.utah.gov/DynaBill/BillList?session=2024GS”
抓取信息我需要页面上列出的所有账单的相同信息。我提供了第一个法案的示例以供参考。我需要法案编号（H.B. 1 Substitute）、简称（公共教育基本预算修正案）、赞助者（Rep. Pulsipher, S.）、最后更新（2024 年 3 月 21 日星期四上午 9:35），以及链接（https://le.utah.gov/~2024/bills/static/HB0001.html）。
我尝试使用 rvest 选择包含所需信息的单个 HTML 元素，但经过无数次尝试和错误来找到正确的元素后，我运行了下面的代码，发现生成的文本缺少我需要的信息。
library("rvest")
url <- "https://le.utah.gov/DynaBill/BillList?session=2024GS"
page <- read_html(url)
html_text(page)
不过我有点困惑，因为当我检查页面时，我可以识别以下元素以及我需要的所有信息：
<a href="/~2024/bills/static/HB0001.html" class="nlink" target="_blank">H.B. 1 Substitute</a>我使用 R 的经验有限，几乎没有此类应用程序的经验，因此我将非常感谢任何反馈。
将展开的
html如果您需要自动单击部分切换，RSelenium 可能是一种不错的选择。
library(rvest)
# url <- "https://le.utah.gov/DynaBill/BillList"
read_html("list of Bills.html") |>
html_element("#rHB00") |>
html_text()
#> [1] "H.B. 1 Substitute -- Public Education Base Budget Amendments (Rep. Pulsipher, S.)Last Update: Thu, Mar 21, 2024 9:35 AMH.B. 2 -- New Fiscal Year Supplemental Appropriations Act (Rep. Peterson, V.)Last Update: Fri, Mar 22, 2024 10:10 AMH.B. 3 -- Appropriations Adjustments (Rep. Peterson, V.)Last Update: Fri, Mar 22, 2024 10:11 AMH.B. 5 -- Natural Resources, Agriculture, and Environmental Quality Base Budget (Rep. Barlow, S.)Last Update: Mon, Feb 5, 2024 11:01 AMH.B. 6 -- Executive Offices and Criminal Justice Base Budget (Rep. Burton, J.)Last Update: Tue, Feb 6, 2024 2:25 PMH.B. 7 -- Social Services Base Budget (Rep. Ward, R.)Last Update: Mon, Feb 5, 2024 11:03 AMH.B. 8 -- State Agency Fees and Internal Service Fund Rate Authorization and Appropriations (Rep. Spendlove, R.)Last Update: Thu, Mar 21, 2024 9:39 AMH.B. 10 -- Public Fund Amendments (Rep. Walter, N.)Last Update: Tue, Mar 19, 2024 4:23 PMH.B. 11 Second Substitute -- Water Efficient Landscaping Requirements (Rep. Owens, D.)Last Update: Wed, Mar 13, 2024 12:04 PMH.B. 12 -- Tax Incentive Revisions (Rep. Dunnigan, J.)Last Update: Tue, Mar 19, 2024 11:40 AMH.B. 13 Substitute -- Infrastructure Financing Districts (Rep. Dunnigan, J.)Last Update: Tue, Mar 19, 2024 4:23 PMH.B. 14 -- School Threat Penalty Amendments (Rep. Wilcox, R.)Last Update: Wed, Mar 13, 2024 2:00 PMH.B. 15 Third Substitute -- Criminal Code Recodification and Cross References (Rep. Gwynn, M.)Last Update: Thu, Mar 14, 2024 9:57 AMH.B. 16 Third Substitute -- Sexual Offenses Amendments (Rep. Hawkins, J.)Last Update: Thu, Mar 14, 2024 10:22 AMH.B. 17 -- Sales and Use Tax Revisions (Rep. Eliason, S.)Last Update: Sat, Mar 2, 2024 2:35 AMH.B. 18 Substitute -- Tax Withholding Amendments (Rep. Bolinder, B.)Last Update: Sat, Mar 2, 2024 2:35 AMH.B. 19 -- Higher Education Financial Aid Amendments (Rep. Peterson, V.)Last Update: Wed, Mar 13, 2024 1:11 PMH.B. 20 Substitute -- Parental Rights Amendments (Rep. Birkeland, K.)Last Update: Thu, Mar 14, 2024 10:31 AMH.B. 21 Substitute -- Criminal Accounts Receivable Amendments (Rep. Wheatley, M.)Last Update: Tue, Mar 19, 2024 4:24 PMH.B. 22 -- Concurrent Enrollment Revisions (Rep. Peterson, V.)Last Update: Wed, Mar 13, 2024 2:03 PMH.B. 23 -- Division of Outdoor Recreation Advisory Council Sunset Extension (Rep. Brooks, W.)Last Update: Tue, Mar 19, 2024 11:42 AMH.B. 24 -- Uniform Real Property Transfer on Death Act Amendments (Rep. Musselman, C.R.)Last Update: Tue, Mar 19, 2024 4:25 PMH.B. 25 -- Electronic Notarization Amendments (Rep. Musselman, C.R.)Last Update: Tue, Mar 19, 2024 4:26 PMH.B. 26 Substitute -- Correctional Facility Amendments (Rep. Burton, J.)Last Update: Thu, Mar 14, 2024 10:32 AMH.B. 27 Substitute -- Criminal Code Amendments (Rep. Gwynn, M.)Last Update: Sat, Mar 2, 2024 2:35 AMH.B. 28 -- Emergency Responder Voting Amendments (Rep. Lesser, R.)Last Update: Sat, Mar 2, 2024 2:35 AMH.B. 29 Second Substitute -- Sensitive Material Review Amendments (Rep. Ivory, K.)Last Update: Tue, Mar 19, 2024 11:43 AMH.B. 30 Third Substitute -- Road Rage Amendments (Rep. Cutler, P.)Last Update: Tue, Mar 19, 2024 11:44 AMH.B. 31 Third Substitute -- Agritourism Amendments (Rep. Albrecht, C.)Last Update: Wed, Mar 13, 2024 2:07 PMH.B. 32 -- Short-term Rental Modifications (Rep. Barlow, S.)Last Update: Fri, Mar 15, 2024 1:41 PMH.B. 33 Substitute -- Cigarette and Tobacco Amendments (Rep. Elison, J.)Last Update: Wed, Feb 21, 2024 6:29 PMH.B. 34 -- Tax Refund Claim Amendments (Rep. Eliason, S.)Last Update: Fri, Mar 15, 2024 1:42 PMH.B. 35 -- Metro Township Modifications (Rep. Teuscher, J.)Last Update: Thu, Mar 21, 2024 9:43 AMH.B. 36 Third Substitute -- Open and Public Meetings Act Amendments (Rep. Dunnigan, J.)Last Update: Tue, Mar 19, 2024 4:27 PMH.B. 37 Substitute -- Joint Tenancy Presumption Amendments (Rep. Musselman, C.R.)Last Update: Thu, Mar 14, 2024 10:38 AMH.B. 38 Substitute -- Psychotropic Medication Oversight Pilot Program Amendments (Rep. Eliason, S.)Last Update: Fri, Mar 15, 2024 1:43 PMH.B. 39 -- Massage Therapy Practice Act Amendments (Rep. Maloy, A. Cory)Last Update: Tue, Mar 19, 2024 4:28 PMH.B. 40 Substitute -- Division of Consumer Protection Amendments (Rep. Maloy, A. Cory)Last Update: Thu, Mar 14, 2024 10:48 AMH.B. 41 Second Substitute -- Health Data Authority Amendments (Rep. Lesser, R.)Last Update: Fri, Mar 15, 2024 1:44 PMH.B. 42 -- Water Rights Publication Amendments (Rep. Briscoe, J.)Last Update: Wed, Mar 13, 2024 2:08 PMH.B. 43 Substitute -- Charitable Solicitations Act Amendments (Rep. Maloy, A. Cory)Last Update: Thu, Mar 14, 2024 10:50 AMH.B. 44 Substitute -- Social Work Licensure Compact (Rep. Hollins, S.)Last Update: Thu, Mar 14, 2024 10:54 AMH.B. 45 -- Safeut and School Safety Commission Amendments (Rep. Eliason, S.)Last Update: Wed, Mar 13, 2024 2:34 PMH.B. 46 -- Veterans and Military Affairs Commission Amendments (Rep. Burton, J.)Last Update: Tue, Mar 19, 2024 11:45 AMH.B. 47 Second Substitute -- Utah Seismic Safety Commission Amendments (Rep. Peterson, T.)Last Update: Sat, Mar 2, 2024 2:35 AMH.B. 48 Substitute -- Utah Energy Act Amendments (Rep. Jack, C.)Last Update: Wed, Mar 13, 2024 2:10 PMH.B. 49 Substitute -- Justice Court Reform Task Force Sunset Extension (Rep. Abbott, N.)Last Update: Sat, Mar 2, 2024 2:35 AM"
创建于 2024-04-02，使用 reprex v2.1.0