Pentaho数据集成Google BigQuery Loader异常

问题描述 投票:-2回答:1

我使用Pentaho数据集成来创建作业,以通过“ Google BigQuery Loader”步骤将数据从Google Cloud Storage加载到Google BigQuery。当该步骤成功将数据加载到BigQuery数据集表中(通过BigQuery作业日志和表数据检查)时,它会抛出NPE:

2019/10/24 10:21:31 - Job 1 - Starting entry [Google BigQuery Loader]
2019/10/24 10:21:31 - Job 1 - ERROR (version 8.2.0.0-342, build 8.2.0.0-342 from 2018-11-14 10.30.55 by buildguy) : java.lang.NullPointerException
2019/10/24 10:21:31 - Job 1 -   at com.pentaho.di.job.entries.google.bigquery.JobEntryBigQueryLoader.execute(JobEntryBigQueryLoader.java:383)
2019/10/24 10:21:31 - Job 1 -   at org.pentaho.di.job.Job.execute(Job.java:680)
2019/10/24 10:21:31 - Job 1 -   at org.pentaho.di.job.Job.execute(Job.java:821)
2019/10/24 10:21:31 - Job 1 -   at org.pentaho.di.job.Job.execute(Job.java:497)
2019/10/24 10:21:31 - Job 1 -   at org.pentaho.di.job.Job.run(Job.java:384)
2019/10/24 10:21:31 - Job 1 - ERROR (version 8.2.0.0-342, build 8.2.0.0-342 from 2018-11-14 10.30.55 by buildguy) : A serious error occurred during job execution: 
2019/10/24 10:21:31 - Job 1 - Unexpected error occurred while launching entry [Google BigQuery Loader.0]
2019/10/24 10:21:31 - Job 1 -  at org.pentaho.di.job.Job.run (Job.java:384)
2019/10/24 10:21:31 - Job 1 -  at org.pentaho.di.job.Job.execute (Job.java:497)
2019/10/24 10:21:31 - Job 1 -  at org.pentaho.di.job.Job.execute (Job.java:821)
2019/10/24 10:21:31 - Job 1 -  at org.pentaho.di.job.Job.execute (Job.java:680)
2019/10/24 10:21:31 - Job 1 -  at com.pentaho.di.job.entries.google.bigquery.JobEntryBigQueryLoader.execute (JobEntryBigQueryLoader.java:383)
2019/10/24 10:21:31 - Job 1 - ERROR (version 8.2.0.0-342, build 8.2.0.0-342 from 2018-11-14 10.30.55 by buildguy) : org.pentaho.di.core.exception.KettleException: 
2019/10/24 10:21:31 - Job 1 - Unexpected error occurred while launching entry [Google BigQuery Loader.0]
2019/10/24 10:21:31 - Job 1 -  at org.pentaho.di.job.Job.run (Job.java:384)
2019/10/24 10:21:31 - Job 1 -  at org.pentaho.di.job.Job.execute (Job.java:497)
2019/10/24 10:21:31 - Job 1 -  at org.pentaho.di.job.Job.execute (Job.java:821)
2019/10/24 10:21:31 - Job 1 -  at org.pentaho.di.job.Job.execute (Job.java:680)
2019/10/24 10:21:31 - Job 1 -  at com.pentaho.di.job.entries.google.bigquery.JobEntryBigQueryLoader.execute (JobEntryBigQueryLoader.java:383)
2019/10/24 10:21:31 - Job 1 - 
2019/10/24 10:21:31 - Job 1 -   at org.pentaho.di.job.Job.execute(Job.java:824)
2019/10/24 10:21:31 - Job 1 -   at org.pentaho.di.job.Job.execute(Job.java:497)
2019/10/24 10:21:31 - Job 1 -   at org.pentaho.di.job.Job.run(Job.java:384)
2019/10/24 10:21:31 - Job 1 - Caused by: java.lang.NullPointerException
2019/10/24 10:21:31 - Job 1 -   at com.pentaho.di.job.entries.google.bigquery.JobEntryBigQueryLoader.execute(JobEntryBigQueryLoader.java:383)
2019/10/24 10:21:31 - Job 1 -   at org.pentaho.di.job.Job.execute(Job.java:680)
2019/10/24 10:21:31 - Job 1 -   at org.pentaho.di.job.Job.execute(Job.java:821)
2019/10/24 10:21:31 - Job 1 -   ... 2 more
2019/10/24 10:21:31 - Spoon - Job has ended.

PDI 8.1和8.2显示相同的结果。 PDI 8.3没有Google BigQuery Loader步骤。

感谢您的帮助或解决方法。

google-bigquery pentaho pentaho-data-integration
1个回答
0
投票

我在PDI Shell脚本步骤和gcloud bq cli中找到了解决方法。Pentaho bugtracker中的Issue

© www.soinside.com 2019 - 2024. All rights reserved.