我正在尝试将 Spring Cloud DataFlow 实例从 2.9.4 更新到 2.11.2，但在部署到 PCF (Pivotal CloudFoundry) 环境期间遇到错误。我完全不确定该怎么做，所以我希望这里有人能有一个想法。
我正在通过自定义清单进行部署，因为我们有自定义配置要求，据我们所知，使用 PCF 市场中的 SCDF 无法满足这些要求。具体来说，这归结为禁用流，但完整的自定义清单是：
applications:
- name: scdf-server
buildpacks:
- java_buildpack_latest
path: spring-cloud-dataflow-server-2.11.2.jar
routes:
- route: https://our-scdf-route.some-pcf-host.com
health-check-type: http
health-check-http-endpoint: /management/health
memory: 2G
disk_quota: 2G
instances: 1
timeout: 180
services:
- postgres-database
- config-service
env:
LANG: en_US.utf8
LC_ALL: en_US.utf8
SPRING_APPLICATION_NAME: scdf-server
SPRING_PROFILES_ACTIVE: cloud
JAVA_OPTS: '-Duser.timezone=Europe/Amsterdam'
BP_JVM_VERSION: -jdk17
JBP_CONFIG_OPEN_JDK_JRE: '{ jre: { version: 17.+ } }'
JBP_CONFIG_SPRING_AUTO_RECONFIGURATION: '{enabled: false}'
SPRING_CLOUD_DATAFLOW_FEATURES_STREAMS_ENABLED: false
SPRING_CLOUD_SKIPPER_SERVER_ENABLE_LOCAL_PLATFORM: false
SPRING_DATASOURCE_HIKARI_MAXIMUM_POOL_SIZE: 6
SPRING_DATASOURCE_HIKARI_MINIMUM_IDLE: 1
# Release connection after 10 seconds idle.
SPRING_DATASOURCE_HIKARI_IDLE_TIMEOUT: 10000
SPRING_CLOUD_SKIPPER_CLIENT_SERVER_URI: https://our-scdf-skipper-server-route.some-pcf-host.com/api
SPRING_CLOUD_DATAFLOW_SERVER_URI: https://our-scdf-route.some-pcf-host.com
SPRING_CLOUD_DATAFLOW_TASK_PLATFORM_CLOUDFOUNDRY_ACCOUNTS[default]_CONNECTION_URL: ((CF_API_URL))
SPRING_CLOUD_DATAFLOW_TASK_PLATFORM_CLOUDFOUNDRY_ACCOUNTS[default]_CONNECTION_DOMAIN: ((APP_DOMAIN))
SPRING_CLOUD_DATAFLOW_TASK_PLATFORM_CLOUDFOUNDRY_ACCOUNTS[default]_CONNECTION_ORG: ((CF_ORG))
SPRING_CLOUD_DATAFLOW_TASK_PLATFORM_CLOUDFOUNDRY_ACCOUNTS[default]_CONNECTION_SPACE: ((CF_SPACE))
SPRING_CLOUD_DATAFLOW_TASK_PLATFORM_CLOUDFOUNDRY_ACCOUNTS[default]_CONNECTION_USERNAME: ((CF_USER))
SPRING_CLOUD_DATAFLOW_TASK_PLATFORM_CLOUDFOUNDRY_ACCOUNTS[default]_CONNECTION_PASSWORD: ((CF_PASSWORD))
SPRING_CLOUD_DATAFLOW_TASK_PLATFORM_CLOUDFOUNDRY_ACCOUNTS[default]_CONNECTION_SKIP_SSL_VALIDATION: true
SPRING_CLOUD_DATAFLOW_TASK_PLATFORM_CLOUDFOUNDRY_ACCOUNTS[default]_DEPLOYMENT_SCHEDULERURL: ((SCHEDULER_URL))
# Set buildpacks to empty so that CloudFoundry let the buildpacks decide whether they can run the app
SPRING_CLOUD_DATAFLOW_TASK_PLATFORM_CLOUDFOUNDRY_ACCOUNTS[default]_DEPLOYMENT_BUILDPACKS: ""
SPRING_CLOUD_DATAFLOW_TASK_PLATFORM_CLOUDFOUNDRY_ACCOUNTS[default]_DEPLOYMENT_BUILDPACK: ""
SPRING_CLOUD_DATAFLOW_TASK_PLATFORM_CLOUDFOUNDRY_ACCOUNTS[default]_DEPLOYMENT_SERVICES: postgres-database, config-service # other services...
# Composed task runner requires at least 4 connections.
SPRING_CLOUD_DATAFLOW_TASK_PLATFORM_CLOUDFOUNDRY_ACCOUNTS[default]_DEPLOYMENT_ENV[SPRING_DATASOURCE_HIKARI_MAXIMUM_POOL_SIZE]: 4
SPRING_CLOUD_DATAFLOW_TASK_PLATFORM_CLOUDFOUNDRY_ACCOUNTS[default]_DEPLOYMENT_ENV[SPRING_DATASOURCE_HIKARI_MINIMUM_IDLE]: 0
# Release connection after 10 seconds idle.
SPRING_CLOUD_DATAFLOW_TASK_PLATFORM_CLOUDFOUNDRY_ACCOUNTS[default]_DEPLOYMENT_ENV[SPRING_DATASOURCE_HIKARI_IDLE_TIMEOUT]: 10000
# Let the nodejs buildpack set the max_old_space_size for nodejs apps
SPRING_CLOUD_DATAFLOW_TASK_PLATFORM_CLOUDFOUNDRY_ACCOUNTS[default]_DEPLOYMENT_ENV[OPTIMIZE_MEMORY]: true
# Let the application know which space we are running on:
SPRING_CLOUD_DATAFLOW_TASK_PLATFORM_CLOUDFOUNDRY_ACCOUNTS[default]_DEPLOYMENT_ENV[CF_SPACE]: ((CF_SPACE))
SPRING_CLOUD_DATAFLOW_TASK_PLATFORM_CLOUDFOUNDRY_ACCOUNTS[default]_DEPLOYMENT_HEALTHCHECK: process
SPRING_CLOUD_DATAFLOW_TASK_PLATFORM_CLOUDFOUNDRY_ACCOUNTS[default]_DEPLOYMENT_USESPRINGAPPLICATIONJSON: false
SPRING_CLOUD_DEPLOYER_CLOUDFOUNDRY_ENABLE_RANDOM_APP_NAME_PREFIX: true
SPRING_CLOUD_DATAFLOW_FEATURES_SCHEDULES_ENABLED: true
# Suppress warning exception for k8s config
LOGGING_LEVEL_ORG_SPRINGFRAMEWORK_CLOUD_KUBERNETES_FABRIC8_CONFIG: INFO
SPRING_APPLICATION_JSON: '
{
"maven" : {
"localRepository": null,
"remoteRepositories" : {
"springRepo" : {
"url" : "((NEXUS_URL))((NEXUS_INTERNAL_REPO))",
"auth": {
"username": "((NEXUS_USER))",
"password": "((NEXUS_PASSWORD))"
}
},
"repo2": {
"url": "((NEXUS_URL))((NEXUS_EXTERNAL_REPO))"
}
}
},
"spring.cloud.dataflow" : {
"task.platform.cloudfoundry.accounts" : {
"default" : {
"connection" : {
"url" : "((CF_API_URL))",
"domain" : "((APP_DOMAIN))",
"org" : "((CF_ORG))",
"space" : "((CF_SPACE))",
"username" : "((CF_USER))",
"password" : "((CF_PASSWORD))",
"skipSsValidation" : true
},
"deployment" : {
"services" : "postgres-database, config-service"
}
}
}
}
}'
这很大程度上遵循文档：https://dataflow.spring.io/docs/installation/cloudfoundry/cf-cli/#installing-using-a-manifest
我们下载用于部署的JAR的URL是https://repo.maven.apache.org/maven2/org/springframework/cloud/spring-cloud-dataflow-server/2.11.2/spring-cloud-dataflow- server-2.11.2.jar
使用以下命令部署此清单时：
cf push ${APP_NAME_NEW} \
-f ${MANIFEST_FILE} \
-p "${ARTIFACT_FILE}" \
--no-start \
--var COMMITREF="${COMMITREF}" \
--var CF_SPACE="${CF_SPACE}" \
--var CF_ORG="${cfOrg}" \
--var CF_API_URL="${cfApi}" \
--var APP_DOMAIN="${APP_DOMAIN}" \
--var CF_USER="${cfUser}" \
--var CF_PASSWORD="${cfPass}" \
--var NEXUS_USER="${NEXUS_USER}" \
--var NEXUS_PASSWORD="${NEXUS_PASSWORD}" \
--var NEXUS_URL="${NEXUS_URL}" \
--var NEXUS_INTERNAL_REPO="${NEXUS_INTERNAL_REPO}" \
--var NEXUS_EXTERNAL_REPO="${NEXUS_EXTERNAL_REPO}" \
--var SCHEDULER_URL="${SCHEDULER_URL}"
在推送和启动之间我们的脚本仅使用
cf set-env现在至于我得到的错误，这是在我们的 PCF 上启动应用程序时的日志记录：
2024-01-24T12:39:11.65+0000 [CELL/0] OUT Starting health monitoring of container
2024-01-24T12:39:11.86+0000 [APP/PROC/WEB/0] OUT JVM Memory Configuration: -Xmx1341281K -Xss1M -XX:ReservedCodeCacheSize=240M -XX:MaxDirectMemorySize=10M -XX:MaxMetaspaceSize=243870K
2024-01-24T12:39:14.94+0000 [APP/PROC/WEB/0] OUT 2024-01-24 13:39:14.933 INFO 14 --- [kground-preinit] o.h.validator.internal.util.Version : HV000001: Hibernate Validator 6.2.5.Final
2024-01-24T12:39:14.97+0000 [APP/PROC/WEB/0] OUT 2024-01-24 13:39:14.969 INFO 14 --- [ main] s.c.d.c.p.t.DatabaseTypeAwareInitializer : checking database driver type:org.postgresql.Driver
2024-01-24T12:39:14.97+0000 [APP/PROC/WEB/0] OUT 2024-01-24 13:39:14.975 WARN 14 --- [ main] ubernetesProfileEnvironmentPostProcessor : Not running inside kubernetes. Skipping 'kubernetes' profile activation.
2024-01-24T12:39:15.02+0000 [APP/PROC/WEB/0] OUT 2024-01-24 13:39:15.019 INFO 14 --- [ main] o.s.c.c.c.ConfigServerConfigDataLoader : Fetching config from server at : https://config-server.our-domain.com
2024-01-24T12:39:15.02+0000 [APP/PROC/WEB/0] OUT 2024-01-24 13:39:15.020 INFO 14 --- [ main] o.s.c.c.c.ConfigServerConfigDataLoader : Located environment: name=scdf-server, profiles=[default], label=null, version=null, state=null
2024-01-24T12:39:15.02+0000 [APP/PROC/WEB/0] OUT 2024-01-24 13:39:15.020 INFO 14 --- [ main] o.s.c.c.c.ConfigServerConfigDataLoader : Fetching config from server at : https://config-server.our-domain.com
2024-01-24T12:39:15.02+0000 [APP/PROC/WEB/0] OUT 2024-01-24 13:39:15.020 INFO 14 --- [ main] o.s.c.c.c.ConfigServerConfigDataLoader : Located environment: name=scdf-server, profiles=[cloud,test], label=null, version=null, state=null
2024-01-24T12:39:15.02+0000 [APP/PROC/WEB/0] OUT 2024-01-24 13:39:15.022 INFO 14 --- [ main] s.b.CfDataSourceEnvironmentPostProcessor : Setting spring.datasource properties from bound service [postgres-database]
2024-01-24T12:39:15.28+0000 [APP/PROC/WEB/0] OUT 2024-01-24 13:39:15.283 WARN 14 --- [ main] io.fabric8.kubernetes.client.Config : Error reading service account token from: [/var/run/secrets/kubernetes.io/serviceaccount/token]. Ignoring.
2024-01-24T12:39:15.29+0000 [APP/PROC/WEB/0] OUT 2024-01-24 13:39:15.295 INFO 14 --- [ main] ContainerTrustManagerFactory$PKIXFactory : Adding System Trust Manager
2024-01-24T12:39:16.49+0000 [APP/PROC/WEB/0] OUT ____ ____ _ __
2024-01-24T12:39:16.49+0000 [APP/PROC/WEB/0] OUT / ___| _ __ _ __(_)_ __ __ _ / ___| | ___ _ _ __| |
2024-01-24T12:39:16.49+0000 [APP/PROC/WEB/0] OUT \___ \| '_ \| '__| | '_ \ / _` | | | | |/ _ \| | | |/ _` |
2024-01-24T12:39:16.49+0000 [APP/PROC/WEB/0] OUT ___) | |_) | | | | | | | (_| | | |___| | (_) | |_| | (_| |
2024-01-24T12:39:16.49+0000 [APP/PROC/WEB/0] OUT |____/| .__/|_| |_|_| |_|\__, | \____|_|\___/ \__,_|\__,_|
2024-01-24T12:39:16.49+0000 [APP/PROC/WEB/0] OUT ____ |_| _ __|___/ __________
2024-01-24T12:39:16.49+0000 [APP/PROC/WEB/0] OUT | _ \ __ _| |_ __ _ | ___| | _____ __ \ \ \ \ \ \
2024-01-24T12:39:16.49+0000 [APP/PROC/WEB/0] OUT | | | |/ _` | __/ _` | | |_ | |/ _ \ \ /\ / / \ \ \ \ \ \
2024-01-24T12:39:16.49+0000 [APP/PROC/WEB/0] OUT | |_| | (_| | || (_| | | _| | | (_) \ V V / / / / / / /
2024-01-24T12:39:16.49+0000 [APP/PROC/WEB/0] OUT |____/ \__,_|\__\__,_| |_| |_|\___/ \_/\_/ /_/_/_/_/_/
2024-01-24T12:39:16.49+0000 [APP/PROC/WEB/0] OUT
2024-01-24T12:39:16.50+0000 [APP/PROC/WEB/0] OUT 2024-01-24 13:39:16.505 INFO 14 --- [ main] s.c.d.c.p.t.DatabaseTypeAwareInitializer : checking database driver type:org.postgresql.Driver
2024-01-24T12:39:16.51+0000 [APP/PROC/WEB/0] OUT 2024-01-24 13:39:16.517 INFO 14 --- [ main] o.s.c.c.c.ConfigServerConfigDataLoader : Fetching config from server at : https://config-server.our-domain.com
2024-01-24T12:39:16.51+0000 [APP/PROC/WEB/0] OUT 2024-01-24 13:39:16.517 INFO 14 --- [ main] o.s.c.c.c.ConfigServerConfigDataLoader : Located environment: name=scdf-server, profiles=[default], label=null, version=null, state=null
2024-01-24T12:39:16.51+0000 [APP/PROC/WEB/0] OUT 2024-01-24 13:39:16.517 INFO 14 --- [ main] o.s.c.c.c.ConfigServerConfigDataLoader : Fetching config from server at : https://config-server.our-domain.com
2024-01-24T12:39:16.51+0000 [APP/PROC/WEB/0] OUT 2024-01-24 13:39:16.517 INFO 14 --- [ main] o.s.c.c.c.ConfigServerConfigDataLoader : Located environment: name=scdf-server, profiles=[cloud,test], label=null, version=null, state=null
2024-01-24T12:39:16.54+0000 [APP/PROC/WEB/0] OUT 2024-01-24 13:39:16.542 ERROR 14 --- [ main] o.s.boot.SpringApplication : Application run failed
2024-01-24T12:39:16.54+0000 [APP/PROC/WEB/0] OUT org.springframework.cloud.kubernetes.commons.config.NamespaceResolutionFailedException: unresolved namespace
2024-01-24T12:39:16.54+0000 [APP/PROC/WEB/0] OUT at org.springframework.cloud.kubernetes.fabric8.config.Fabric8ConfigUtils.getApplicationNamespace(Fabric8ConfigUtils.java:107)
2024-01-24T12:39:16.54+0000 [APP/PROC/WEB/0] OUT at org.springframework.cloud.kubernetes.fabric8.config.Fabric8ConfigMapPropertySourceLocator.getMapPropertySource(Fabric8ConfigMapPropertySourceLocator.java:70)
2024-01-24T12:39:16.54+0000 [APP/PROC/WEB/0] OUT at org.springframework.cloud.kubernetes.commons.config.ConfigMapPropertySourceLocator.getMapPropertySourceForSingleConfigMap(ConfigMapPropertySourceLocator.java:95)
2024-01-24T12:39:16.54+0000 [APP/PROC/WEB/0] OUT at org.springframework.cloud.kubernetes.commons.config.ConfigMapPropertySourceLocator.lambda$locate$0(ConfigMapPropertySourceLocator.java:75)
2024-01-24T12:39:16.54+0000 [APP/PROC/WEB/0] OUT at java.base/java.lang.Iterable.forEach(Unknown Source)
2024-01-24T12:39:16.54+0000 [APP/PROC/WEB/0] OUT at org.springframework.cloud.kubernetes.commons.config.ConfigMapPropertySourceLocator.locate(ConfigMapPropertySourceLocator.java:75)
2024-01-24T12:39:16.54+0000 [APP/PROC/WEB/0] OUT at org.springframework.cloud.bootstrap.config.PropertySourceLocator.locateCollection(PropertySourceLocator.java:51)
2024-01-24T12:39:16.54+0000 [APP/PROC/WEB/0] OUT at org.springframework.cloud.bootstrap.config.PropertySourceLocator.locateCollection(PropertySourceLocator.java:47)
2024-01-24T12:39:16.54+0000 [APP/PROC/WEB/0] OUT at org.springframework.cloud.kubernetes.commons.config.ConfigMapPropertySourceLocator.locateCollection(ConfigMapPropertySourceLocator.java:87)
2024-01-24T12:39:16.54+0000 [APP/PROC/WEB/0] OUT at org.springframework.cloud.bootstrap.config.PropertySourceBootstrapConfiguration.doInitialize(PropertySourceBootstrapConfiguration.java:120)
2024-01-24T12:39:16.54+0000 [APP/PROC/WEB/0] OUT at org.springframework.cloud.bootstrap.config.PropertySourceBootstrapConfiguration.initialize(PropertySourceBootstrapConfiguration.java:110)
2024-01-24T12:39:16.54+0000 [APP/PROC/WEB/0] OUT at org.springframework.boot.SpringApplication.applyInitializers(SpringApplication.java:605)
2024-01-24T12:39:16.54+0000 [APP/PROC/WEB/0] OUT at org.springframework.boot.SpringApplication.prepareContext(SpringApplication.java:374)
2024-01-24T12:39:16.54+0000 [APP/PROC/WEB/0] OUT at org.springframework.boot.SpringApplication.run(SpringApplication.java:307)
2024-01-24T12:39:16.54+0000 [APP/PROC/WEB/0] OUT at org.springframework.boot.SpringApplication.run(SpringApplication.java:1300)
2024-01-24T12:39:16.54+0000 [APP/PROC/WEB/0] OUT at org.springframework.boot.SpringApplication.run(SpringApplication.java:1289)
2024-01-24T12:39:16.54+0000 [APP/PROC/WEB/0] OUT at org.springframework.cloud.dataflow.server.single.DataFlowServerApplication.main(DataFlowServerApplication.java:54)
2024-01-24T12:39:16.54+0000 [APP/PROC/WEB/0] OUT at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
2024-01-24T12:39:16.54+0000 [APP/PROC/WEB/0] OUT at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
2024-01-24T12:39:16.54+0000 [APP/PROC/WEB/0] OUT at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
2024-01-24T12:39:16.54+0000 [APP/PROC/WEB/0] OUT at java.base/java.lang.reflect.Method.invoke(Unknown Source)
2024-01-24T12:39:16.54+0000 [APP/PROC/WEB/0] OUT at org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:49)
2024-01-24T12:39:16.54+0000 [APP/PROC/WEB/0] OUT at org.springframework.boot.loader.Launcher.launch(Launcher.java:108)
2024-01-24T12:39:16.54+0000 [APP/PROC/WEB/0] OUT at org.springframework.boot.loader.Launcher.launch(Launcher.java:58)
2024-01-24T12:39:16.54+0000 [APP/PROC/WEB/0] OUT at org.springframework.boot.loader.JarLauncher.main(JarLauncher.java:65)
2024-01-24T12:39:16.90+0000 [APP/PROC/WEB/0] OUT Exit status 1
2024-01-24T12:39:16.91+0000 [CELL/SSHD/0] OUT Exit status 0
2024-01-24T12:39:22.33+0000 [CELL/0] OUT Cell 8f007ac2-b677-4fab-af68-785b1f4cc0b5 stopping instance 2b683f0a-a1dd-4e0d-4286-dda3
2024-01-24T12:39:22.33+0000 [CELL/0] OUT Cell 8f007ac2-b677-4fab-af68-785b1f4cc0b5 destroying container for instance 2b683f0a-a1dd-4e0d-4286-dda3
2024-01-24T12:39:22.34+0000 [API/0] OUT Process has crashed with type: "web"
2024-01-24T12:39:22.35+0000 [API/0] OUT App instance exited with guid 76d51d66-9b11-437b-947a-028938058b83 payload: {"instance"=>"2b683f0a-a1dd-4e0d-4286-dda3", "index"=>0, "cell_id"=>"8f007ac2-b677-4fab-af68-785b1f4cc0b5", "reason"=>"CRASHED", "exit_description"=>"APP/PROC/WEB: Exited with status 1", "crash_count"=>1, "crash_timestamp"=>1706099962318633139, "version"=>"5d753320-bcc1-4eb4-b087-0d62ef0cbb6f"}
2024-01-24T12:39:22.35+0000 [CELL/0] OUT Cell 181f5375-240e-46c3-99fa-3078c76f172f creating container for instance babec3dc-e44d-4a2c-4e43-e6a1
2024-01-24T12:39:22.65+0000 [PROXY/0] OUT Exit status 137
2024-01-24T12:39:23.43+0000 [CELL/0] OUT Cell 8f007ac2-b677-4fab-af68-785b1f4cc0b5 successfully destroyed container for instance 2b683f0a-a1dd-4e0d-4286-dda3
从这里可以看出，我收到了一些关于似乎与 K8s 相关的未解析命名空间的错误，尽管事实上在 Spring 横幅上方它明确记录了它检测到未在 K8s 中运行并禁用其配置文件激活。
到目前为止我已经尝试过：
"spring.cloud.dataflow"我希望新的 SCDF 版本的部署能够顺利进行，以便我们可以开始测试它并最终使用它。
想要更新的主要原因是，当将我们的应用程序更新到 Spring Boot 3.2.0（从 3.1.5 开始）以及将匹配的
org.springframework.cloud:spring-cloud-dependencies2022.0.42023.0.0Handler dispatch failed; nested exception is java.lang.UnsupportedClassVersionError: io/pivotal/cfenv/core/CfEnv has been compiled by a more recent version of the Java Runtime (class file version 61.0), this version of the Java Runtime only recognizes class file versions up to 52.0
鉴于这显然与 Java 版本相关，我想我应该升级 SCDF 并添加使用 Java 17 的配置行（
JBP_CONFIG_OPEN_JDK_JRE: '{ jre: { version: 17.+ } }'BP_JVM_VERSION: -jdk172.10 之前的 SCDF 将无法正确启动使用 Spring Boot 3 构建的应用程序
SCDF 2.11.x 将在启动注册为 boot3 应用程序的任务或流时提供正确的参数。 我建议删除：
BP_JVM_VERSION: -jdk17
JBP_CONFIG_OPEN_JDK_JRE: '{ jre: { version: 17.+ } }'
来自您的清单。