如何解决Pentaho文本文件输出错误-请求的数组大小超出VM限制

问题描述 投票:0回答:1

我通过使用“表输入”步骤到“text_file_output”步骤导出数据到csv文件中,但由于“java.lang.OutOfMemoryError:请求的数组大小超出VM限制”而无法导出csv文件中的10条记录 我的 Spoon.bat 文件已设置以下参数,但还没有运气。

PENTAHO_DI_JAVA_OPTIONS="-Xms1024m" "-Xmx2048m" "-XX:MaxPermSize=256m" "-XX:+UseCompressedOops" "-XX:+HeapDumpOnOutOfMemoryError"

In this transformation, exporting data to excel works okay but performance is bad for 10k+ records ,
so used alternate way as text file output with csv extension, tested with sample data and it worked for 10k records in few seconds only but for new data it's failing even for 1 record.
Tried with increasing heap size as Xms 2GB and Xmx 4 GB but no luck

java etl export-to-csv pentaho pentaho-data-integration
1个回答
0
投票

尝试在文本文件输出步骤的内容部分中勾选“快速数据转储(无格式)”框。

© www.soinside.com 2019 - 2024. All rights reserved.