[IBM Analytics Engine-如果我通过Ambari配置作为高级选项的一部分,则集群创建失败

问题描述 投票:0回答:1

我在IBM Cloud上使用Analytics Engine,并尝试通过高级配置选项中的Ambari配置,如下所示。

    "ambari_config": {
        "hardware_config": "default",
        "software_package": "ae-1.2-hive-spark",
        "num_compute_nodes": 1,
        "advanced_options": {
            "ambari_config": {
                "spark2-defaults": {
                    "spark.dynamicAllocation.minExecutors": 1,
                    "spark.shuffle.service.enabled": true,
                    "spark.dynamicAllocation.maxExecutors": 2,
                    "spark.dynamicAllocation.enabled": true
                }
            }
        }
    }
}```


I am following this documentation to pass the above configuration 

https://cloud.ibm.com/docs/services/AnalyticsEngine?topic=AnalyticsEngine-advanced-provisioning-options

After multiple retires i see that each time my cluster request is failing. 

apache-spark ibm-cloud analytics-engine
1个回答
0
投票

审查请求后,我发现我为我的请求两次传递了ambari_config属性,但我不接受

对我有用的有效json看起来像这样

{
    "hardware_config": "default",
    "software_package": "ae-1.2-hive-spark",
    "num_compute_nodes": 1,
    "advanced_options": {
        "ambari_config": {
            "spark2-defaults": {
                "spark.dynamicAllocation.minExecutors": 1,
                "spark.shuffle.service.enabled": true,
                "spark.dynamicAllocation.maxExecutors": 2,
                "spark.dynamicAllocation.enabled": true
            }
        }
    }
}
© www.soinside.com 2019 - 2024. All rights reserved.