从 Lambda 函数或 Sagemaker Lifecycle Config 运行 .ipynb 文件

Question

启动 Sagemaker 实例时的

ipynb 文件。 目前状态是： Cloudwatch（成功）-> Lambda（成功）-> Sagemaker 实例（成功）-> 运行特定笔记本（失败）

1.我尝试使用“Sagemaker Lifecycle”配置和代码

jupyter nbconvert --execute prediction-12hr.ipynb --ExecutePreprocessor.kernel_name=conda_tensorflow_p36

但出现错误

[NbConvertApp] Converting notebook prediction-12hr.ipynb to html [NbConvertApp] Executing notebook with kernel: conda_tensorflow_p36
...
raise NoSuchKernel(kernel_name) jupyter_client.kernelspec.NoSuchKernel: No such kernel named conda_tensorflow_p36

跑步时

`!conda env list'
conda environments:

base * /home/ec2-user/anaconda3
JupyterSystemEnv /home/ec2-user/anaconda3/envs/JupyterSystemEnv
chainer_p27 /home/ec2-user/anaconda3/envs/chainer_p27
chainer_p36 /home/ec2-user/anaconda3/envs/chainer_p36
mxnet_p27 /home/ec2-user/anaconda3/envs/mxnet_p27
mxnet_p36 /home/ec2-user/anaconda3/envs/mxnet_p36
python2 /home/ec2-user/anaconda3/envs/python2
python3 /home/ec2-user/anaconda3/envs/python3
pytorch_p27 /home/ec2-user/anaconda3/envs/pytorch_p27
pytorch_p36 /home/ec2-user/anaconda3/envs/pytorch_p36
tensorflow_p27 /home/ec2-user/anaconda3/envs/tensorflow_p27
tensorflow_p36 /home/ec2-user/anaconda3/envs/tensorflow_p36

Also tried injecting a python/bash code to run the instance startup, pausing the start-up code to wait untill conda instance is setup by sagemaker.
Still no luck

有人可以建议一个以任何可能的方式运行 .ipynb 文件的计划吗？

Answer 1

尝试激活笔记本所依赖的相关Python virtualenv。

source /home/ec2-user/anaconda3/envs/tensorflow_p36/bin/activate
jupyter nbconvert --execute ...

了解更多如何激活virtualenv？

Answer 2

已经很久了，但我仍然找不到类似问题的答案。经过一番尝试和错误后，这对我有用：

第一：

source activate /home/ec2-user/anaconda3

然后：

conda activate /home/ec2-user/andaconda3/envs/tensorflow2_p310

然后当你运行 nbconvert 时，只需包含

--ExecutePreprocessor.kernel_name=python3

Answer 3

您可以尝试激活tensorflow_p36 env并在该环境中执行笔记本文件吗？这样你就不必指定内核。

source activate tensorflow_p36
jupyter nbconvert --execute prediction-12hr.ipynb