如何在 Azure Synapse Notebook Spark 集群 (pyspark) 中安装 Python 库

Question

我在 Azure Synapse Notebook 中安装 Python 库时遇到问题。我尝试使用 %pip... 和 !pip... 安装两个库“holidays”和“fugue”，我什至尝试使用 .WHL 文件，但没有任何效果。集群没有任何限制。错误是：

WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'ConnectTimeoutError(<pip._vendor.urllib3.connection.HTTPSConnection object at 0x7f29776c5240>, 'Connection to pypi.org timed out. (connect timeout=15)')': /simple/fugue/ WARNING: Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'ConnectTimeoutError(<pip._vendor.urllib3.connection.HTTPSConnection object at 0x7f29776c4ca0>, 'Connection to pypi.org timed out. (connect timeout=15)')': /simple/fugue/ WARNING: Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'ConnectTimeoutError(<pip._vendor.urllib3.connection.HTTPSConnection object at 0x7f29776c47c0>, 'Connection to pypi.org timed out. (connect timeout=15)')': /simple/fugue/ WARNING: Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'ConnectTimeoutError(<pip._vendor.urllib3.connection.HTTPSConnection object at 0x7f29776c7250>, 'Connection to pypi.org timed out. (connect timeout=15)')': /simple/fugue/ WARNING: Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'ConnectTimeoutError(<pip._vendor.urllib3.connection.HTTPSConnection object at 0x7f29776c4130>, 'Connection to pypi.org timed out. (connect timeout=15)')': /simple/fugue/ ERROR: Could not find a version that satisfies the requirement fugue (from versions: none) ERROR: No matching distribution found for fugue Note: you may need to restart the kernel to use updated packages. Warning: PySpark kernel has been restarted to use updated packages.

有什么问题吗？

提前致谢

我尝试过

%pip install fugue

和

!pip install fugue

、.whl 文件。

Answer 1

您可以使用以下命令：

pip install holidays

pip install fugue

结果：

参考资料：

• 神游0.9.0
• 假期0.48

此外，还可以详细了解在 Azure Synapse Analytics 中管理 Apache Spark 池的库。

这是在 Azure Synapse 中添加自定义 Python 库的 Stack Overflow 链接。