使用 sails.js 将图像转换和更新到 AWS s3 时出错

Question

我正在尝试使用 sails.js 转换并上传 1000 多个图像到 aws s3

我正在使用 aws-cli 通过 url 获取图像，并在使用graphicsmagick 处理后上传回存储桶。

一段时间后我收到下面提到的错误

{"level":"error",
"message":"Error uploading data:  RequestTimeTooSkewed: The difference between the request time and the current time is too large.
at Request.extractError (/home/images/api/node_modules/aws-sdk/lib/services/s3.js:327:35)
at Request.callListeners (/home/images/api/node_modules/aws-sdk/lib/sequential_executor.js:105:20)
at Request.emit (/home/images/api/node_modules/aws-sdk/lib/sequential_executor.js:77:10)
at Request.emit (/home/images/api/node_modules/aws-sdk/lib/request.js:595:14)
at Request.transition (/home/images/api/node_modules/aws-sdk/lib/request.js:21:10)
at AcceptorStateMachine.runTo (/home/images/api/node_modules/aws-sdk/lib/state_machine.js:14:12)
at /home/images/api/node_modules/aws-sdk/lib/state_machine.js:26:10
at Request.<anonymous> (/home/images/api/node_modules/aws-sdk/lib/request.js:37:9)
at Request.<anonymous> (/home/images/api/node_modules/aws-sdk/lib/request.js:597:12)
at Request.callListeners (/home/images/api/node_modules/aws-sdk/lib/sequential_executor.js:115:18)
at Request.emit (/home/images/api/node_modules/aws-sdk/lib/sequential_executor.js:77:10)
at Request.emit (/home/images/api/node_modules/aws-sdk/lib/request.js:595:14)
at Request.transition (/home/images/api/node_modules/aws-sdk/lib/request.js:21:10)
at AcceptorStateMachine.runTo (/home/images/api/node_modules/aws-sdk/lib/state_machine.js:14:12)
at /home/images/api/node_modules/aws-sdk/lib/state_machine.js:26:10
at Request.<anonymous> (/home/images/api/node_modules/aws-sdk/lib/request.js:37:9) { [RequestTimeTooSkewed: The difference between the request time and the current time is too large.]
message: 'The difference between the request time and the current time is too large.',
code: 'RequestTimeTooSkewed',
region: null,
time: Thu Nov 12 2015 16:05:21 GMT+0000 (UTC),
statusCode: 403,
retryable: false,
retryDelay: 30 }",
"timestamp":"2015-11-12T16:05:21.626Z"}

我在 aws ec2 上运行此代码 主目录中有 200GB 磁盘空间

$ free -m

             total       used       free     shared    buffers     cached
Mem:          3951        444       3507          5         20        290
-/+ buffers/cache:        132       3819
Swap:            0          0          0


$ free mem

             total       used       free     shared    buffers     cached
Mem:          3951        444       3507          5         20        290
-/+ buffers/cache:        132       3819
Swap:            0          0          0

任何建议都是值得赞赏的。

谢谢

Answer 1

大量并行上传可能会导致此错误，因为 HTTP 请求已准备好（带有时间戳），然后排队并逐渐发送。最终，时间戳与当前时间不同步，导致出现时钟偏差错误。请参阅完整的解释和解决方案此处。