麦粉社区
>
帖子详情

请教数据抽取失败的问题,已经折腾几个小时了

高级开发 发表于 2020-8-14 15:51
发表于 2020-8-14 15:51:13
很奇怪,因为之前数据抽取是成功的,库连接和sql也没有改过,今天重新抽取就一直报错,不知道怎么排查这个问题,加个where抽一条是成功的,说明语句肯定没问题,是某条数据的问题,但是提示的496条数据似乎看起来没什么问题,也不知道卡在哪了

08-14 15:47:55 ERROR executeUpdateSql(smartbix.dataprocess.service.DatabaseResultService:445) - Wrong data or column definition. Row: 496, field: 16.
java.sql.SQLException: Wrong data or column definition. Row: 496, field: 16.
        at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1078) ~[_JDBC_mysql.jar:?]
        at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:4190) ~[_JDBC_mysql.jar:?]
        at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:4122) ~[_JDBC_mysql.jar:?]
        at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:927) ~[_JDBC_mysql.jar:?]
        at com.mysql.jdbc.MysqlIO.sendFileToServer(MysqlIO.java:4087) ~[_JDBC_mysql.jar:?]
        at com.mysql.jdbc.MysqlIO.readResultsForQueryOrUpdate(MysqlIO.java:3196) ~[_JDBC_mysql.jar:?]
        at com.mysql.jdbc.MysqlIO.readAllResults(MysqlIO.java:2366) ~[_JDBC_mysql.jar:?]
        at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2789) ~[_JDBC_mysql.jar:?]
        at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2812) ~[_JDBC_mysql.jar:?]
        at com.mysql.jdbc.StatementImpl.executeUpdate(StatementImpl.java:1811) ~[_JDBC_mysql.jar:?]
        at com.mysql.jdbc.StatementImpl.executeUpdate(StatementImpl.java:1725) ~[_JDBC_mysql.jar:?]
        at org.apache.commons.dbcp.DelegatingStatement.executeUpdate(DelegatingStatement.java:225) ~[commons-dbcp-1.2.1.jar:1.2.1]
        at smartbix.dataprocess.service.DatabaseResultService.executeUpdateSql(DatabaseResultService.java:443) [SmartbiX-DataProcess-0.0.1.jar:?]
        at smartbix.dataprocess.service.DatabaseResultService$$FastClassBySpringCGLIB$$7e915f15.invoke(<generated>) [SmartbiX-DataProcess-0.0.1.jar:?]
        at smartbixlibs.org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204) [spring-core-4.3.25.RELEASE.jar:?]
        at smartbixlibs.org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:736) [spring-aop-4.3.25.RELEASE.jar:?]
        at smartbixlibs.org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:157) [spring-aop-4.3.25.RELEASE.jar:?]
        at smartbixlibs.org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:96) [spring-aop-4.3.25.RELEASE.jar:?]
        at smartbix.smartbi.service.GridDataServiceHandler.handle(GridDataServiceHandler.java:66) [classes/:?]
        at sun.reflect.GeneratedMethodAccessor1111.invoke(Unknown Source) ~[?:?]
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_131]
        at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_131]
        at smartbixlibs.org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:627) [spring-aop-4.3.25.RELEASE.jar:?]
        at smartbixlibs.org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:616) [spring-aop-4.3.25.RELEASE.jar:?]
        at smartbixlibs.org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:70) [spring-aop-4.3.25.RELEASE.jar:?]
        at smartbixlibs.org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179) [spring-aop-4.3.25.RELEASE.jar:?]
        at smartbixlibs.org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:92) [spring-aop-4.3.25.RELEASE.jar:?]
        at smartbixlibs.org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179) [spring-aop-4.3.25.RELEASE.jar:?]
        at smartbixlibs.org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:671) [spring-aop-4.3.25.RELEASE.jar:?]
        at smartbix.dataprocess.service.DatabaseResultService$$EnhancerBySpringCGLIB$$d044584.executeUpdateSql(<generated>) [SmartbiX-DataProcess-0.0.1.jar:?]
        at smartbix.dataprocess.node.save2db.InfoBrightLoaderService.copyLocalCsvToDb(InfoBrightLoaderService.java:90) [SmartbiX-DataProcess-0.0.1.jar:?]
        at smartbix.dataprocess.node.save2db.SmartbiCacheExtractor$ImportThread.call(SmartbiCacheExtractor.java:2018) [SmartbiX-DataProcess-0.0.1.jar:?]
        at smartbix.dataprocess.node.save2db.SmartbiCacheExtractor$ImportThread.call(SmartbiCacheExtractor.java:1983) [SmartbiX-DataProcess-0.0.1.jar:?]
        at smartbix.util.ThreadUtil$SubmitRunnable.call(ThreadUtil.java:142) [SmartbiX-Commons-0.0.1.jar:?]
        at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_131]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:1.8.0_131]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:1.8.0_131]
        at java.lang.Thread.run(Thread.java:748) [?:1.8.0_131]
08-14 15:47:55 ERROR copyLocalCsvToDb(smartbix.dataprocess.node.save2db.InfoBrightLoaderService:93) - 执行数据导入语句失败
08-14 15:47:55  INFO addSQLLogByOutter(common.sql:103) - {"userName":"admin","startTime":"2020-08-14 15:47:54:911","id":"","dataSource":"高速缓存库","status":"faild","resId":"","interval":0,"sql":"LOAD DATA LOCAL INFILE 'D:/tools/Smartbi/Tomcat/bin/SmartbiX-ExtractData/I828081910173e548e5482ddf0173ebf071f6060c/1000000' INTO TABLE `gxy2019` CHARACTER SET 'GBK'  FIELDS ESCAPED BY '\\\\' TERMINATED BY ','  ENCLOSED BY '\"' "}

发表于 2020-8-14 16:42:36
问题找到了,是数据名字字段里有个:玕字导致的,这要怎么解决,因为源库(Oracle,编码:gbk)里这个字显示正常,我直接在高速缓存库里粘帖这个字也不会乱码,为啥抓取数据会失败呢?
回复

使用道具 举报

发表于 2020-8-17 13:32:13
高速缓存库那里配置的是什么?
回复

使用道具 举报

高级模式
B Color Image Link Quote Code Smilies
您需要登录后才可以回帖 登录 | 立即注册

本版积分规则

2回帖数 0关注人数 1777浏览人数
最后回复于:2020-8-17 13:32
快速回复 返回顶部 返回列表