ArangoDB 读取超时（读取超时=60）

Question

我有一个问题。我通过

ArangoDB enterprise:3.8.6

使用

Docker

。但不幸的是我的查询花费的时间比

30s

更长。 当失败时，错误是

arangodb HTTPConnectionPool(host='127.0.0.1', port=8529): Read timed out. (read timeout=60)

。

• 我的收藏大约有 4GB 大，约 1.2 mio - 收藏中有 900k 个文档。

如何才能获得包含所有文档的完整集合而不出现任何错误？

Python 代码（在我的机器上本地运行）

from arango import ArangoClient

# Initialize the ArangoDB client.
client = ArangoClient()

# Connect to database as  user.
db = client.db(<db>, username=<username>, password=<password>)

cursor = db.aql.execute(f'FOR doc IN students RETURN doc', batch_size=10000)
result = [doc for doc in cursor]

print(result[0])

[OUT]
arangodb HTTPConnectionPool(host='127.0.0.1', port=8529): Read timed out. (read timeout=60)

ArangoDB 的 docker-compose.yml

version: '3.7'

services:
  database:
    container_name: database__arangodb
    image: arangodb/enterprise:3.8.6
    environment:
      - ARANGO_LICENSE_KEY=<key>
      - ARANGO_ROOT_PASSWORD=root
      - ARANGO_CONNECT_TIMEOUT=300
      - ARANGO_READ_TIMEOUT=600
    ports:
      - 8529:8529
    volumes:
      - C:/Users/dataset:/var/lib/arangodb3

我尝试了什么

cursor = db.aql.execute('FOR doc IN <Collection> RETURN doc', stream=True)
while cursor.has_more(): # Fetch until nothing is left on the server.
    cursor.fetch()
while not cursor.empty(): # Pop until nothing is left on the cursor.
    cursor.pop()

[OUT] CursorNextError: [HTTP 404][ERR 1600] cursor not found

# A N D 
cursor = db.aql.execute('FOR doc IN <Collection> RETURN doc', stream=True, ttl=3600)
collection =  [doc for doc in cursor]
[OUT] nothing # Runs, runs and runs for more than 1 1/2 hours

什么有效但是仅适用于 100 个文档

# And that worked
cursor = db.aql.execute(f'FOR doc IN <Collection> LIMIT 100 RETURN doc', stream=True)
collection =  [doc for doc in cursor]

Answer 1

您可以通过使用 Arango 的自定义 HTTP 客户端来增加 HTTP 客户端的超时。

默认设置为 here 为 60 秒。

from arango.http import HTTPClient


class MyCustomHTTPClient(HTTPClient):
    REQUEST_TIMEOUT = 1000 # Set the timeout you want in seconds here


# Pass an instance of your custom HTTP client to Arango:
client = ArangoClient(
    http_client=MyCustomHTTPClient()
)

Answer 2

我遇到了与 Shai Ben-Dor 在评论中所写的相同的问题/解决方案。

以上似乎不再有效。

HTTPClient

是一个抽象基类，现在需要您定义

send_request

和

create_session

。但是有

DefaultHTTPClient

接受

request_timeout

作为参数。

from arango.http import DefaultHTTPClient


client = ArangoClient(
    http_client=DefaultHTTPClient(request_timeout=...)
)