Vertex AI 笔记本的计划执行返回错误:“2:未知错误。:无法提交计划”

问题描述 投票:0回答:1

我正在使用 GCP 的 Vertex AI Workbench 在托管笔记本中开发 ML 代码。无论是交互运行还是由执行器通过笔记本的 Web 界面使用

Type: "One-time execution"
运行时,笔记本执行都可以正常工作。

另一方面,每当我选择

Type: "Schedule-based recurring executions"
并单击
SUBMIT
时,它会挂起大约 30 秒,并显示消息“正在提交计划”,然后失败并出现以下错误:

2: Unknown Error.: Unable to submit schedule

两种情况下执行的所有参数都是相同的。

我相信我在这里遗漏了一些非常明显的东西,但在文档或其他任何地方都找不到任何有用的东西。

编辑:

这是错误的完整日志,我也觉得没有帮助:

{
  "protoPayload": {
    "@type": "type.googleapis.com/google.cloud.audit.AuditLog",
    "status": {
      "code": 2,
      "message": "Error 0: googleapi: Error 503: The service is currently unavailable.\nDetails:\n[\n  {\n    \"@type\": \"type.googleapis.com/google.rpc.DebugInfo\",\n    \"detail\": \"[ORIGINAL ERROR] RPC::DEADLINE_EXCEEDED: Deadline exceeded while waiting for channels to become available, and/or be able to accept RPCs. Channel count = 0. Queue size = 0. Deadline=28.992677276s; Extensible Stubs capped the outgoing deadline: see go/stubs-longest-allowed-deadline; \\ncom.google.net.rpc3.RpcException: DEADLINE_EXCEEDED: Deadline exceeded while waiting for channels to become available, and/or be able to accept RPCs. Channel count = 0. Queue size = 0. Deadline=28.992677276s; Extensible Stubs capped the outgoing deadline: see go/stubs-longest-allowed-deadline; \\n\\tat com.google.apphosting.admin.mixer.actions.CreateApplicationAction.checkRpcPresentStatus(CreateApplicationAction.java:194)\\n\\tSuppressed: com.google.common.labs.concurrent.LabsFutures$LabeledExecutionException: GraphFuture{key=@com.google.apphosting.admin.mixer.actions.CreateApplicationAction$CreateReturnMessage com.google.protobuf.Message} failed: com.google.net.rpc3.RpcException: DEADLINE_EXCEEDED: Deadline exceeded while waiting for channels to become available, and/or be able to accept RPCs. Channel count = 0. Queue size = 0. Deadline=28.992677276s; Extensible Stubs capped the outgoing deadline: see go/stubs-longest-allowed-deadline; \\n\"\n  }\n]\n, backendError"
    },
    "authenticationInfo": {
      "principalEmail": "[email protected]",
      "serviceAccountDelegationInfo": [
        {
          "firstPartyPrincipal": {
            "principalEmail": "[email protected]"
          }
        }
      ]
    },
    "requestMetadata": {
      "requestAttributes": {},
      "destinationAttributes": {}
    },
    "serviceName": "notebooks.googleapis.com",
    "methodName": "google.cloud.notebooks.v1.NotebookService.CreateSchedule",
    "resourceName": "projects/MY-PROJECT/locations/europe-west4/schedules/test_rnn_aria__1673534440196",
    "resourceLocation": {
      "currentLocations": [
        "europe-west4"
      ]
    }
  },
  "insertId": "184n01ud3oul",
  "resource": {
    "type": "audited_resource",
    "labels": {
      "method": "google.cloud.notebooks.v1.NotebookService.CreateSchedule",
      "service": "notebooks.googleapis.com",
      "project_id": "MY-PROJECT"
    }
  },
  "timestamp": "2023-01-12T14:42:42.563449708Z",
  "severity": "ERROR",
  "logName": "projects/MY-PROJECT/logs/cloudaudit.googleapis.com%2Factivity",
  "operation": {
    "id": "projects/MY-PROJECT/locations/europe-west4/operations/operation-XXXXXXXXXX",
    "producer": "notebooks.googleapis.com",
    "last": true
  },
  "receiveTimestamp": "2023-01-12T14:42:43.526355300Z"
}

感谢您的帮助!

google-cloud-platform google-cloud-ml google-cloud-vertex-ai
1个回答
0
投票

姗姗来迟的更新,希望它能帮助其他人解决这个难以捉摸的问题。

Google 的官方答复是“笔记本调度不再是焦点”,他们建议改用 Vertex Pipelines。

我想这是一种礼貌的说法,“我们正在停用该功能,并且我们不会费心警告用户,直到他们的东西停止工作”。

© www.soinside.com 2019 - 2024. All rights reserved.