我在vba中编写了一个脚本,在发出代理请求后从网站上删除了第一篇文章。我在我的vba脚本中发出http请求时使用了代理(代理列表),以查看总帖子的长度。成功发送请求后,脚本应解析第一个帖子和正在使用的代理并退出循环。
有时脚本以正确的方式工作,但是大多数情况下脚本需要很长时间才能完成操作,即使我在发送请求之前已经定义了
timeout
。在这一点上,我非常怀疑我是否能以正确的方式填写timeout
参数。我期望的是脚本会等到那个时间进行任何响应,否则会抛出timeout
错误并转到下一个请求。
我到目前为止写的:
Sub HandleTimeOut()
Dim Http As New ServerXMLHTTP60, Html As New HTMLDocument
Dim elem As Object, proxyList As Variant, oProxy As Variant
proxyList = [{"50.246.120.125:8080","198.204.253.115:3128","98.172.142.99:8080","207.188.231.141:8080"}]
For Each oProxy In proxyList
With Http
.Open "GET", "https://stackoverflow.com/questions/tagged/web-scraping", True
.setRequestHeader "User-Agent", "Mozilla/5.0"
.setProxy 2, oProxy
.setTimeouts 600000, 600000, 15000, 15000
On Error Resume Next
.send
While .readyState < 4: DoEvents: Wend
Html.body.innerHTML = .responseText
Set elem = Html.querySelectorAll(".summary .question-hyperlink")
On Error GoTo 0
End With
If elem.Length > 0 Then
[A1] = oProxy
[B1] = elem(0).innerText
Exit For
End If
Next oProxy
End Sub
将timeout
设置为5秒的正确方法是什么?
.Open "GET", "https://stackoverflow.com/questions/tagged/web-scraping", True
应该
.Open "GET", "https://stackoverflow.com/questions/tagged/web-scraping", False