如何使用greenplum pxf外表向sql server插入数据？

问题描述 投票：0回答：1

当我尝试使用pxf外表插入数据时，我遇到了这个问题

postgres=#插入测试值(1); psql：错误：来自“127.0.0.1:5888”的远程组件错误 (500)：类型异常报告消息 java.io.DataInputStream 无法转换为 [B 描述 服务器遇到意外情况，无法完成请求。异常 java.lang.ClassCastException：java.io.DataInputStream 无法转换为 [B (libchurl.c:967) (seg0 172.16.100.109:6000 pid=28756) (libchurl.c:967)

在sqlserver上执行sql

create database test
go 

use test
go

create schema alice
go

create table alice.student
(
    id   int,
    name varchar,
    age  int
)
go

在 greenplum 上执行 sql

CREATE EXTENSION pxf_fdw ;


DROP SERVER sqlserv_server cascade;

CREATE SERVER sqlserv_server FOREIGN DATA WRAPPER jdbc_pxf_fdw OPTIONS (
    jdbc_driver 'com.microsoft.sqlserver.jdbc.SQLServerDriver',
    db_url 'jdbc:sqlserver://172.16.100.109:1433;databaseName=test;encrypt=true;trustServerCertificate=true;',
    batch_size '10000',
    fetch_size '2000'
);

CREATE USER MAPPING FOR mxadmin SERVER sqlserv_server OPTIONS ( user 'sa' , pass 'Aa123456');


CREATE FOREIGN TABLE foreign_sqlserver (
    id int4,
    name varchar(20) ,
    age int4
)
SERVER sqlserv_server
OPTIONS (resource 'alice.student');

insert into foreign_sqlserver values(1,'alice',11),(2,'bob',20);
psql: ERROR:  remote component error (500) from '127.0.0.1:5888':  Type  Exception Report   Message  java.io.DataInputStream cannot be cast to [B   Description  The server encountered an unexpected condition that prevented it from fulfilling the request.   Exception   java.lang.ClassCastException: java.io.DataInputStream cannot be cast to [B (libchurl.c:967)  (seg1 172.16.100.109:6001 pid=12562) (libchurl.c:967)

pxf-service.log贴吹

2023-03-27 13:08:37.0736 ERROR tomcat-http--8 org.greenplum.pxf.service.bridge.WriteBridge - Failed to close bridge resources: java.io.DataInputStream cannot be cast to [B
2023-03-27 13:18:24.0044 ERROR tomcat-http--13 org.greenplum.pxf.service.rest.WritableResource - Exception: totalWritten so far 9999 to alice.student
java.lang.ClassCastException: java.io.DataInputStream cannot be cast to [B
        at org.greenplum.pxf.plugins.jdbc.JdbcResolver.decodeOneRowToPreparedStatement(JdbcResolver.java:309)
        at org.greenplum.pxf.plugins.jdbc.writercallable.BatchWriterCallable.call(BatchWriterCallable.java:68)
        at org.greenplum.pxf.plugins.jdbc.JdbcAccessor.writeNextObject(JdbcAccessor.java:247)
        at org.greenplum.pxf.service.bridge.WriteBridge.setNext(WriteBridge.java:78)
        at org.greenplum.pxf.service.rest.WritableResource.stream(WritableResource.java:138)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)
        at com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$ResponseOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:205)
        at com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)
        at com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:288)
        at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
        at com.sun.jersey.server.impl.uri.rules.ResourceClassRule.accept(ResourceClassRule.java:108)
        at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
        at com.sun.jersey.server.impl.uri.rules.RootResourceClassesRule.accept(RootResourceClassesRule.java:84)
        at com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1469)
        at com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1400)
        at com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1349)
        at com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1339)
        at com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:416)
        at com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:537)
        at com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:699)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:728)
        at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)
        at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
        at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
        at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
        at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
        at org.greenplum.pxf.service.servlet.SecurityServletFilter.lambda$doFilter$0(SecurityServletFilter.java:145)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893)
        at org.greenplum.pxf.service.servlet.SecurityServletFilter.doFilter(SecurityServletFilter.java:158)
        at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
        at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
        at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:219)
        at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:110)
        at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:492)
        at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:165)
        at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:104)
        at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:1025)
        at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116)
        at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:452)
        at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1201)
        at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:654)
        at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:317)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
        at java.lang.Thread.run(Thread.java:748)
2023-03-27 13:18:24.0045 ERROR tomcat-http--13 org.greenplum.pxf.service.bridge.WriteBridge - Failed to close bridge resources: java.io.DataInputStream cannot be cast to [B
sql-server greenplum
1个回答
0
投票

使用 FDW 从 Greenplum 数据库写入外部数据源仍在开发中。但是，您可以使用外部表来完成上述任务。

步骤：

  1. 如果不存在则创建扩展。

    创建扩展 pxf;

  2. Create a writable external table

    创建可写外部表 ( COLUMN_NAME COLUMN_TYPE) LOCATION('pxf://?PROFILE=Jdbc') FORMAT 'custom' (FORMATTER='pxfwritable_export');

例如：

create writable external table w_pg_ext ( id int4 , name varchar(20), age int4) LOCATION('pxf://pgtest?PROFILE=Jdbc') FORMAT 'custom' (FORMATTER='pxfwritable_export');

  1. 确保 jdbc-site.xml 具有正确的驱动程序和用户名/密码条目。

    $PXF_BASE/servers/default/jdbc-site.xml

举个例子：

<?xml version="1.0" encoding="UTF-8"?>
  <configuration>
  <property>
    <name>jdbc.driver</name>
    <value>org.postgresql.Driver</value>
  </property>
  <property>
    <name>jdbc.url</name>
    <value>jdbc:postgresql://localhost:5432/postgres</value>
 </property>
 <property>
    <name>jdbc.user</name>
    <value>USER1</value>
 </property>
 <property>
   <name>jdbc.password</name>
   <value>PASSWORD</value>
 </property>
</configuration>

  1. 插入数据：

    插入 w_pg_ext 值(1,'alice',11);

参考此链接了解更多：

https://gpdb.docs.pivotal.io/6-2/pxf/jdbc_pxf.html

希望这有帮助！

谢谢！

最新问题
© www.soinside.com 2019 - 2024. All rights reserved.