movefile 问题:文件 2.5G 复制变成 2G,分页查询报错
denlguqianyi2.ctx 是从 MongoDB 加载进来的数据,原始文件。
denlguqianyi2_cp.ctx 是通过集算器命令movefile复制而来的,复制后的文件变小了,复制具体脚本如下:
denlguqianyi2_linux_cp.ctx 是通过 linux 命令 cp 复制而来的,文件大小没有变,正常。
denlguqianyi2.ctx 和 denlguqianyi2_cp.ctx 文件结构一致,总条数一致。
denlguqianyi2.ctx 结构和条数如下:
denlguqianyi2_cp.ctx 结构和条数如下
denlguqianyi2.ctx 查询动作都正常返回数据,没有报错。
但是 denlguqianyi2_cp.ctx 文件分页查询会报错:
com.voland.core.db.DaoException: java.sql.SQLException: Error in cell [form_data_leng_page.dfx].A3
null
at com.doeis.inventory.dao.FormLengDataEsProcMongo.skipAndLimitByEsproc(FormLengDataEsProcMongo.java:345)
at com.doeis.inventory.action.admin.FormLengDataAction.index(FormLengDataAction.java:85)
at sun.reflect.GeneratedMethodAccessor1478.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at ognl.OgnlRuntime.invokeMethod(OgnlRuntime.java:897)
at ognl.OgnlRuntime.callAppropriateMethod(OgnlRuntime.java:1299)
at ognl.ObjectMethodAccessor.callMethod(ObjectMethodAccessor.java:68)
at com.opensymphony.xwork2.ognl.accessor.XWorkMethodAccessor.callMethodWithDebugInfo(XWorkMethodAccessor.java:117)
at com.opensymphony.xwork2.ognl.accessor.XWorkMethodAccessor.callMethod(XWorkMethodAccessor.java:108)
at ognl.OgnlRuntime.callMethod(OgnlRuntime.java:1375)
at ognl.ASTMethod.getValueBody(ASTMethod.java:91)
at ognl.SimpleNode.evaluateGetValueBody(SimpleNode.java:212)
at ognl.SimpleNode.getValue(SimpleNode.java:258)
at ognl.Ognl.getValue(Ognl.java:470)
at ognl.Ognl.getValue(Ognl.java:434)
at com.opensymphony.xwork2.ognl.OgnlUtil$3.execute(OgnlUtil.java:398)
at com.opensymphony.xwork2.ognl.OgnlUtil.compileAndExecuteMethod(OgnlUtil.java:450)
at com.opensymphony.xwork2.ognl.OgnlUtil.callMethod(OgnlUtil.java:396)
at com.opensymphony.xwork2.DefaultActionInvocation.invokeAction$original$szu0udZy(DefaultActionInvocation.java:430)
at com.opensymphony.xwork2.DefaultActionInvocation.invokeAction$original$szu0udZy$accessor$XFqdcdDf(DefaultActionInvocation.java)
at com.opensymphony.xwork2.DefaultActionInvocation$auxiliary$VB89Px4B.call(Unknown Source)
at org.apache.skywalking.apm.agent.core.plugin.interceptor.enhance.InstMethodsInter.intercept(InstMethodsInter.java:86)
at com.opensymphony.xwork2.DefaultActionInvocation.invokeAction(DefaultActionInvocation.java)
at com.opensymphony.xwork2.DefaultActionInvocation.invokeActionOnly(DefaultActionInvocation.java:290)
at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:251)
at com.opensymphony.xwork2.interceptor.MethodFilterInterceptor.intercept(MethodFilterInterceptor.java:100)
at com.doeis.GuiceObjectFactory$ProvidedInterceptor.intercept(GuiceObjectFactory.java:236)
at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:245)
at com.voland.core.ExceptionInterceptor.intercept(ExceptionInterceptor.java:32)
at com.doeis.GuiceObjectFactory$ProvidedInterceptor.intercept(GuiceObjectFactory.java:236)
at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:245)
at com.opensymphony.xwork2.interceptor.DefaultWorkflowInterceptor.doIntercept(DefaultWorkflowInterceptor.java:168)
at com.opensymphony.xwork2.interceptor.MethodFilterInterceptor.intercept(MethodFilterInterceptor.java:98)
at com.doeis.GuiceObjectFactory$ProvidedInterceptor.intercept(GuiceObjectFactory.java:236)
at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:245)
at com.opensymphony.xwork2.validator.ValidationInterceptor.doIntercept(ValidationInterceptor.java:265)
at org.apache.struts2.interceptor.validation.AnnotationValidationInterceptor.doIntercept(AnnotationValidationInterceptor.java:76)
at com.opensymphony.xwork2.interceptor.MethodFilterInterceptor.intercept(MethodFilterInterceptor.java:98)
at com.doeis.GuiceObjectFactory$ProvidedInterceptor.intercept(GuiceObjectFactory.java:236)
at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:245)
at com.opensymphony.xwork2.interceptor.ConversionErrorInterceptor.intercept(ConversionErrorInterceptor.java:138)
at com.doeis.GuiceObjectFactory$ProvidedInterceptor.intercept(GuiceObjectFactory.java:236)
at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:245)
at com.opensymphony.xwork2.interceptor.ParametersInterceptor.doIntercept(ParametersInterceptor.java:229)
at com.opensymphony.xwork2.interceptor.MethodFilterInterceptor.intercept(MethodFilterInterceptor.java:98)
at com.doeis.GuiceObjectFactory$ProvidedInterceptor.intercept(GuiceObjectFactory.java:236)
at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:245)
at com.opensymphony.xwork2.interceptor.ParametersInterceptor.doIntercept(ParametersInterceptor.java:229)
at com.opensymphony.xwork2.interceptor.MethodFilterInterceptor.intercept(MethodFilterInterceptor.java:98)
at com.doeis.GuiceObjectFactory$ProvidedInterceptor.intercept(GuiceObjectFactory.java:236)
at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:245)
at com.opensymphony.xwork2.interceptor.StaticParametersInterceptor.intercept(StaticParametersInterceptor.java:191)
at com.doeis.GuiceObjectFactory$ProvidedInterceptor.intercept(GuiceObjectFactory.java:236)
at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:245)
at org.apache.struts2.interceptor.FileUploadInterceptor.intercept(FileUploadInterceptor.java:253)
at com.doeis.GuiceObjectFactory$ProvidedInterceptor.intercept(GuiceObjectFactory.java:236)
at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:245)
at com.opensymphony.xwork2.interceptor.ModelDrivenInterceptor.intercept(ModelDrivenInterceptor.java:100)
at com.doeis.GuiceObjectFactory$ProvidedInterceptor.intercept(GuiceObjectFactory.java:236)
at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:245)
at com.opensymphony.xwork2.interceptor.ChainingInterceptor.intercept(ChainingInterceptor.java:145)
at com.doeis.GuiceObjectFactory$ProvidedInterceptor.intercept(GuiceObjectFactory.java:236)
at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:245)
at com.opensymphony.xwork2.interceptor.PrepareInterceptor.doIntercept(PrepareInterceptor.java:171)
at com.opensymphony.xwork2.interceptor.MethodFilterInterceptor.intercept(MethodFilterInterceptor.java:98)
at com.doeis.GuiceObjectFactory$ProvidedInterceptor.intercept(GuiceObjectFactory.java:236)
at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:245)
at org.apache.struts2.interceptor.ServletConfigInterceptor.intercept(ServletConfigInterceptor.java:164)
at com.doeis.GuiceObjectFactory$ProvidedInterceptor.intercept(GuiceObjectFactory.java:236)
at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:245)
at com.opensymphony.xwork2.interceptor.ParametersInterceptor.doIntercept(ParametersInterceptor.java:229)
at com.opensymphony.xwork2.interceptor.MethodFilterInterceptor.intercept(MethodFilterInterceptor.java:98)
at com.doeis.GuiceObjectFactory$ProvidedInterceptor.intercept(GuiceObjectFactory.java:236)
at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:245)
at org.apache.struts2.interceptor.MultiselectInterceptor.intercept(MultiselectInterceptor.java:73)
at com.doeis.GuiceObjectFactory$ProvidedInterceptor.intercept(GuiceObjectFactory.java:236)
at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:245)
at org.apache.struts2.interceptor.DateTextFieldInterceptor.intercept(DateTextFieldInterceptor.java:125)
at com.doeis.GuiceObjectFactory$ProvidedInterceptor.intercept(GuiceObjectFactory.java:236)
at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:245)
at org.apache.struts2.interceptor.CheckboxInterceptor.intercept(CheckboxInterceptor.java:91)
at com.doeis.GuiceObjectFactory$ProvidedInterceptor.intercept(GuiceObjectFactory.java:236)
at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:245)
at com.opensymphony.xwork2.interceptor.I18nInterceptor.intercept(I18nInterceptor.java:140)
at com.doeis.GuiceObjectFactory$ProvidedInterceptor.intercept(GuiceObjectFactory.java:236)
at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:245)
at com.opensymphony.xwork2.interceptor.AliasInterceptor.intercept(AliasInterceptor.java:193)
at com.doeis.GuiceObjectFactory$ProvidedInterceptor.intercept(GuiceObjectFactory.java:236)
at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:245)
at com.opensymphony.xwork2.interceptor.ExceptionMappingInterceptor.intercept(ExceptionMappingInterceptor.java:189)
at com.doeis.GuiceObjectFactory$ProvidedInterceptor.intercept(GuiceObjectFactory.java:236)
at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:245)
at org.apache.struts2.interceptor.MessageStoreInterceptor.intercept(MessageStoreInterceptor.java:206)
at com.doeis.GuiceObjectFactory$ProvidedInterceptor.intercept(GuiceObjectFactory.java:236)
at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:245)
at com.doeis.interceptor.AccessLogInterceptor.intercept(AccessLogInterceptor.java:176)
at com.doeis.GuiceObjectFactory$ProvidedInterceptor.intercept(GuiceObjectFactory.java:236)
at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:245)
at com.doeis.authorize.interceptor.AuthInterceptor.intercept(AuthInterceptor.java:131)
at com.doeis.GuiceObjectFactory$ProvidedInterceptor.intercept(GuiceObjectFactory.java:236)
at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:245)
at org.apache.struts2.impl.StrutsActionProxy.execute(StrutsActionProxy.java:54)
at org.apache.struts2.dispatcher.Dispatcher.serviceAction(Dispatcher.java:575)
at org.apache.struts2.dispatcher.ng.ExecuteOperations.executeAction(ExecuteOperations.java:81)
at org.apache.struts2.dispatcher.ng.filter.StrutsPrepareAndExecuteFilter.doFilter(StrutsPrepareAndExecuteFilter.java:99)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at com.alibaba.druid.support.http.WebStatFilter.doFilter(WebStatFilter.java:123)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:201)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:97)
at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:544)
at org.apache.catalina.core.StandardHostValve.invoke$original$szmS0j2z(StandardHostValve.java:143)
at org.apache.catalina.core.StandardHostValve.invoke$original$szmS0j2z$accessor$fETYBb3D(StandardHostValve.java)
at org.apache.catalina.core.StandardHostValve$auxiliary$f0MonE0Y.call(Unknown Source)
at org.apache.skywalking.apm.agent.core.plugin.interceptor.enhance.InstMethodsInter.intercept(InstMethodsInter.java:86)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:81)
at org.apache.catalina.valves.AbstractAccessLogValve.invoke(AbstractAccessLogValve.java:698)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:78)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:364)
at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:616)
at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:65)
at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:831)
at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1629)
at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
at java.lang.Thread.run(Thread.java:750)
Caused by: java.sql.SQLException: Error in cell [form_data_leng_page.dfx].A3
null
at com.esproc.jdbc.InternalStatement.executeJDBC(InternalStatement.java:395)
at com.esproc.jdbc.InternalStatement$1.run(InternalStatement.java:225)
Caused by: com.scudata.common.RQException: Error in cell [form_data_leng_page.dfx].A3
null
at com.scudata.dw.Cursor.skipOver(Unknown Source:3188)
at com.scudata.dm.cursor.ICursor.skip(Unknown Source:909)
at com.scudata.expression.mfn.cursor.Skip.calculate(Unknown Source:34)
at com.scudata.expression.operator.DotOperator.calculate(Unknown Source:86)
at com.scudata.expression.Expression.calculate(Unknown Source:161)
at com.scudata.cellset.datamodel.PgmNormalCell.calculate(Unknown Source:159)
at com.scudata.cellset.datamodel.PgmCellSet._$1(Unknown Source:1960)
at com.scudata.cellset.datamodel.PgmCellSet.execute(Unknown Source:2642)
at com.scudata.cellset.datamodel.PgmCellSet.calculateResult(Unknown Source:2685)
at com.scudata.expression.fn.JDBCCall.calculate(Unknown Source:95)
at com.scudata.expression.Expression.calculate(Unknown Source:161)
at com.scudata.expression.fn.Eval.calc(Unknown Source:168)
at com.esproc.jdbc.JDBCUtil.execute(JDBCUtil.java:209)
at com.esproc.jdbc.InternalStatement.executeLocal(InternalStatement.java:421)
at com.esproc.jdbc.InternalStatement.executeJDBC(InternalStatement.java:376)
… 1 more
Caused by: java.io.EOFException
at java.io.RandomAccessFile.readFully(RandomAccessFile.java:438)
at java.io.RandomAccessFile.readFully(RandomAccessFile.java:416)
at com.scudata.dw.ComTable.loadBlock(Unknown Source:392)
at com.scudata.dw.BlockLinkReader.seek(Unknown Source:198)
at com.scudata.dw.BlockLinkReader.readDataBlock(Unknown Source:207)
at com.scudata.dw.BlockLinkReader.readBlockData(Unknown Source:247)
at com.scudata.dw.Cursor.skipOver(Unknown Source:3157)
… 15 more
分页查询脚本内容如下:
集算器版本如下:
请问这个是每次都这样吗?
可以再试一下,看一下 movefile 的返回值是不是 true,有可能是还没复制完就中断程序了,按理说复制后的文件跟源文件的大小应该是一样的。
也可以用 cmp 比较下 2 个文件是否一样
这个文件每次复制都是同样结果,变小,结果是 2G。
打印了一下复制命令结果,返回的是 true
比较结果不一样![imagepng]()
找个别的大文件(大于 2G)的再用 movefile 复制一下,看看是不是只剩 2G?小于 2G 的文件是不是复制就没问题?
Linux 的版本?用的文件系统等?
此问题已修改,稍后会更新 jar 包
程序已更新,请前往下载贴中下载最新的 esproc-bin.jar 文件。
对,超过 2G 的有此问题,小于 2G 的时候很正常。