Sagemaker 管道 - 从管道中弹出 X，因为它将被覆盖

Question

自从将 sagemaker 升级到

2.173+

后，日志有点吵。在评估 Sagemaker Pipeline 时，我看到了很多

WARNING:sagemaker.workflow.utilities:Popping out 'ProcessingJobName' from the pipeline definition by default since it will be overridden at pipeline execution time. Please utilize the PipelineDefinitionConfig to persist this field in the pipeline definition if desired.
WARNING:sagemaker.workflow.utilities:Popping out 'ProcessingJobName' from the pipeline definition by default since it will be overridden at pipeline execution time. Please utilize the PipelineDefinitionConfig to persist this field in the pipeline definition if desired.
WARNING:sagemaker.workflow.utilities:Popping out 'TrainingJobName' from the pipeline definition by default since it will be overridden at pipeline execution time. Please utilize the PipelineDefinitionConfig to persist this field in the pipeline definition if desired.
WARNING:sagemaker.workflow._utils:Popping out 'CertifyForMarketplace' from the pipeline definition since it will be overridden in pipeline execution time.
WARNING:sagemaker.workflow.utilities:Popping out 'ModelPackageName' from the pipeline definition by default since it will be overridden at pipeline execution time. Please utilize the PipelineDefinitionConfig to persist this field in the pipeline definition if desired.

重点是

Please utilize the PipelineDefinitionConfig to persist this field in the pipeline definition if desired

。但是，我在

documentation

中找不到如何实际使用该 PipelineDefinitionConfig，也找不到 github 上的任何示例。

有任何参考如何解决这些警告而不只是抑制它们吗？

Answer 1

管道的访问管理文档有更全面的解释：

默认情况下，作业前缀处于关闭状态。要选择此功能，请使用 PipelineDefinitionConfig 的 use_custom_job_prefix 选项，如以下代码片段所示：

# Create a definition configuration and toggle on custom prefixing
definition_config = PipelineDefinitionConfig(use_custom_job_prefix=True);

# Create a pipeline with a custom prefix
 pipeline = Pipeline(
     name="MyJobPrefixedPipeline",
     parameters=[...]
     steps=[...]
     pipeline_definition_config=definition_config
)

这些警告似乎纯粹是提供信息的。您可以选择使用上面的示例添加作业前缀以使它们消失，或者只是忽略它们。