在Flink(Scala)的内存缓存中?无法加载番石榴

问题描述 投票:0回答:1

我想在我的Flink作业(Scala)中使用内存缓存,这样我就可以为键设置TTL(生存时间)。我一直在寻找解决方案,并找到了番石榴。但是,我不确定它是否适用于Flink(v 1.6.3 - Scala),因为我无法在Flink shell中加载任何版本的Guava。

scala> :require flink-shaded-guava-18.0-6.0.jar
The path 'flink-shaded-guava-18.0-6.0.jar' cannot be loaded, because existing classpath entries conflict.

scala> :require flink-shaded-guava-18.0-5.0.jar
The path 'flink-shaded-guava-18.0-5.0.jar' cannot be loaded, because existing classpath entries conflict.

scala> :require flink-shaded-guava-18.0-4.0.jar
The path 'flink-shaded-guava-18.0-4.0.jar' cannot be loaded, because existing classpath entries conflict.

scala> :require flink-shaded-guava-18.0-3.0.jar
The path 'flink-shaded-guava-18.0-3.0.jar' cannot be loaded, because existing classpath entries conflict.

scala> :require flink-shaded-guava-18.0-2.0.jar
The path 'flink-shaded-guava-18.0-2.0.jar' cannot be loaded, because existing classpath entries conflict.

scala> :require flink-shaded-guava-18.0-1.0.jar
The path 'flink-shaded-guava-18.0-1.0.jar' cannot be loaded, because existing classpath entries conflict.

还有其他选择吗?有什么帮助解决这个错误?

scala caching classpath guava apache-flink
1个回答
0
投票

也许你可以在FLink 1.6中尝试使用TTL的Flink本地键控状态。看到这里Flink official doc.

© www.soinside.com 2019 - 2024. All rights reserved.