Question

2
Replies
319
Views
 Bharat Bhushan Soma (BharatBhushanSoma)
Accenture

Accenture
US
BharatBhushanSoma Member since 2016 1 post
Accenture
Posted: October 19, 2017
Last activity: October 20, 2017
Posted: 19 Oct 2017 16:32 EDT
Last activity: 20 Oct 2017 4:26 EDT
Closed

File Listener Always tries to recover the processed File

We have a file listener "B" configured in our DEV environment and hosted on our own network. The file listener is used pick a file in the configured folder and process it and move to completed folder which is working as expected. There is listener "A" that has a activity which splits the files into n number of csv files and places the files in a seperate "TEMP" folder to be picked. So the listener "B" (running on 4 concurrent threads) now tries to pick up file from "TEMP" folder and process it. Even this works as expected. But once the listener completes the processing for all files in this "TEMP" folder, it tries to recover the last file that has already been processed always and stops the further process and gets errored out.



Also please find attached listener configurations for process and error tabs if needed. Please help me out if anyone has encountered it or aware of this issue


Below is the error in Log file. B is listener described above. Listener user id is the operator id though which the B listener operates

Show More

We have a file listener "B" configured in our DEV environment and hosted on our own network. The file listener is used pick a file in the configured folder and process it and move to completed folder which is working as expected. There is listener "A" that has a activity which splits the files into n number of csv files and places the files in a seperate "TEMP" folder to be picked. So the listener "B" (running on 4 concurrent threads) now tries to pick up file from "TEMP" folder and process it. Even this works as expected. But once the listener completes the processing for all files in this "TEMP" folder, it tries to recover the last file that has already been processed always and stops the further process and gets errored out.

Also please find attached listener configurations for process and error tabs if needed. Please help me out if anyone has encountered it or aware of this issue

Below is the error in Log file. B is listener described above. Listener user id is the operator id though which the B listener operates

ERROR File."B"|recover|X_Part00.1508435027698000.csv|Y/Services/"B" ListenerUserID- Exception caught while evaluating when 
com.pega.pegarules.pub.clipboard.InvalidValueException: PropertyValueInvalid	null	.pegaToBigDecimal()	Invalid number format (was sysuser) 
	at com.pega.pegarules.pub.clipboard.PRStringFormat.pegaToBigDecimal(PRStringFormat.java:479) 
	at com.pega.pegarules.pub.clipboard.PRStringFormat.pegaToAny(PRStringFormat.java:842) 
	at com.pega.pegarules.data.internal.clipboard.ClipboardPageBase.getValue(ClipboardPageBase.java:1908) 
	at com.pega.pegarules.data.internal.clipboard.ClipboardPageBase.getBigDecimal(ClipboardPageBase.java:1868) 
	at com.pega.pegarules.data.internal.clipboard.ClipboardPageImpl.getBigDecimal(ClipboardPageImpl.java:484) 
	at com.pega.pegarules.data.internal.clipboard.ClipboardPageBase.getBigDecimal(ClipboardPageBase.java:1864) 
	at com.pega.pegarules.data.internal.clipboard.ClipboardPageImpl.getBigDecimal(ClipboardPageImpl.java:484) 
	at com.pegarules.generated.model.ra_model_cleanserealsampledata_6da378aff22bb30ed2912ddf4353be4d.whenCondition_1(ra_model_cleanserealsampledata_6da378aff22bb30ed2912ddf4353be4d.java:123) 
	at com.pegarules.generated.model.ra_model_cleanserealsampledata_6da378aff22bb30ed2912ddf4353be4d.perform(ra_model_cleanserealsampledata_6da378aff22bb30ed2912ddf4353be4d.java:94) 
	at com.pega.pegarules.session.internal.mgmt.Executable.applyModel(Executable.java:4475) 
	at com.pegarules.generated.activity.ra_action_saverealsampledata_ac0200741af85b05f459f4aa02c44d9a.step3_circum0(ra_action_saverealsampledata_ac0200741af85b05f459f4aa02c44d9a.java:502) 
	at com.pegarules.generated.activity.ra_action_saverealsampledata_ac0200741af85b05f459f4aa02c44d9a.perform(ra_action_saverealsampledata_ac0200741af85b05f459f4aa02c44d9a.java:104) 
	at com.pega.pegarules.session.internal.mgmt.Executable.doActivity(Executable.java:3527) 
	at com.pega.pegarules.integration.engine.internal.RuleExecutionUtils.runActivity(RuleExecutionUtils.java:375) 
	at com.pega.pegarules.integration.engine.internal.services.file.RuleServiceFile.parseRecordAtTime(RuleServiceFile.java:1039) 
	at com.pega.pegarules.integration.engine.internal.services.file.RuleServiceFile.process(RuleServiceFile.java:1756) 
	at com.pega.pegarules.integration.engine.internal.services.file.FileListener.recoverOne(FileListener.java:1522) 
	at com.pega.pegarules.integration.engine.internal.services.file.FileListener.recovery(FileListener.java:1729) 
	at com.pega.pegarules.integration.engine.internal.services.file.FileListener.run_(FileListener.java:1901) 
	at com.pega.pegarules.integration.engine.internal.services.listener.ServiceListenerBaseImpl.run(ServiceListenerBaseImpl.java:454) 
	at com.pega.pegarules.session.internal.engineinterface.etier.impl.AsyncServant.processAsyncTask(AsyncServant.java:213) 
	at com.pega.pegarules.session.internal.engineinterface.etier.impl.AsyncServant.invoke(AsyncServant.java:167) 
	at com.pega.pegarules.session.internal.engineinterface.etier.impl.EngineImpl._invokeEngine_privact(EngineImpl.java:327) 
	at com.pega.pegarules.session.internal.engineinterface.etier.impl.EngineImpl.invokeEngine(EngineImpl.java:270) 
	at com.pega.pegarules.session.internal.engineinterface.etier.ejb.EngineBean.invokeEngine(EngineBean.java:225) 
	at sun.reflect.GeneratedMethodAccessor44.invoke(Unknown Source) 
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 
	at java.lang.reflect.Method.invoke(Method.java:498) 
	at com.pega.pegarules.internal.bootstrap.PRBootstrap.invokeMethod(PRBootstrap.java:370) 
	at com.pega.pegarules.internal.bootstrap.PRBootstrap.invokeMethodPropagatingThrowable(PRBootstrap.java:411) 
	at com.pega.pegarules.boot.internal.extbridge.AppServerBridgeToPega.invokeMethodPropagatingThrowable(AppServerBridgeToPega.java:224) 
	at com.pega.pegarules.boot.internal.extbridge.AppServerBridgeToPega.invokeMethodPropagatingException(AppServerBridgeToPega.java:246) 
	at com.pega.pegarules.internal.etier.ejb.EngineBeanBoot.invokeEngine(EngineBeanBoot.java:168) 
	at sun.reflect.GeneratedMethodAccessor43.invoke(Unknown Source) 
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 
	at java.lang.reflect.Method.invoke(Method.java:498) 
	at org.jboss.as.ee.component.ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptor.java:52) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) 
	at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:63) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) 
	at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:63) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.as.jpa.interceptor.SBInvocationInterceptor.processInvocation(SBInvocationInterceptor.java:47) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.as.ejb3.tx.EjbBMTInterceptor.handleInvocation(EjbBMTInterceptor.java:104) 
	at org.jboss.as.ejb3.tx.BMTInterceptor.processInvocation(BMTInterceptor.java:60) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) 
	at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.as.ejb3.component.pool.PooledInstanceInterceptor.processInvocation(PooledInstanceInterceptor.java:51) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.as.ejb3.component.invocationmetrics.WaitTimeInterceptor.processInvocation(WaitTimeInterceptor.java:43) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.as.ejb3.security.AuthorizationInterceptor.processInvocation(AuthorizationInterceptor.java:116) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.as.ejb3.security.SecurityContextInterceptor.processInvocation(SecurityContextInterceptor.java:86) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.as.ejb3.component.interceptors.EjbExceptionTransformingInterceptorFactories$2.processInvocation(EjbExceptionTransformingInterceptorFactories.java:103) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.as.ejb3.component.interceptors.AdditionalSetupInterceptor.processInvocation(AdditionalSetupInterceptor.java:55) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) 
	at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:185) 
	at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:185) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) 
	at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:73) 
	at com.pega.pegarules.internal.etier.interfaces.EngineLocal$$$view21.invokeEngine(Unknown Source) 
	at com.pega.pegarules.session.internal.engineinterface.etier.mdb.PRAsync.processRequest(PRAsync.java:155) 
	at com.pega.pegarules.session.internal.engineinterface.etier.mdb.PRAsync.onMessage(PRAsync.java:112) 
	at sun.reflect.GeneratedMethodAccessor42.invoke(Unknown Source) 
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 
	at java.lang.reflect.Method.invoke(Method.java:498) 
	at com.pega.pegarules.internal.bootstrap.PRBootstrap.invokeMethod(PRBootstrap.java:370) 
	at com.pega.pegarules.internal.bootstrap.PRBootstrap.invokeMethodPropagatingThrowable(PRBootstrap.java:411) 
	at com.pega.pegarules.boot.internal.extbridge.AppServerBridgeToPega.invokeMethodPropagatingThrowable(AppServerBridgeToPega.java:224) 
	at com.pega.pegarules.boot.internal.extbridge.AppServerBridgeToPega.invokeMethod(AppServerBridgeToPega.java:273) 
	at com.pega.pegarules.internal.etier.mdb.PRAsyncBoot.onMessage(PRAsyncBoot.java:91) 
	at sun.reflect.GeneratedMethodAccessor41.invoke(Unknown Source) 
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 
	at java.lang.reflect.Method.invoke(Method.java:498) 
	at org.jboss.as.ee.component.ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptor.java:52) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) 
	at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:63) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) 
	at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:63) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.as.ejb3.tx.EjbBMTInterceptor.handleInvocation(EjbBMTInterceptor.java:104) 
	at org.jboss.as.ejb3.tx.BMTInterceptor.processInvocation(BMTInterceptor.java:60) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) 
	at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.as.ejb3.component.pool.PooledInstanceInterceptor.processInvocation(PooledInstanceInterceptor.java:51) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.as.ejb3.component.invocationmetrics.WaitTimeInterceptor.processInvocation(WaitTimeInterceptor.java:43) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.as.ejb3.security.SecurityContextInterceptor.processInvocation(SecurityContextInterceptor.java:86) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.as.ejb3.component.interceptors.AdditionalSetupInterceptor.processInvocation(AdditionalSetupInterceptor.java:55) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.as.ejb3.component.messagedriven.MessageDrivenComponentDescription$5$1.processInvocation(MessageDrivenComponentDescription.java:203) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) 
	at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:185) 
	at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:185) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) 
	at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:73) 
	at javax.jms.MessageListener$$$view11.onMessage(Unknown Source) 
	at sun.reflect.GeneratedMethodAccessor40.invoke(Unknown Source) 
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 
	at java.lang.reflect.Method.invoke(Method.java:498) 
	at org.jboss.as.ejb3.inflow.MessageEndpointInvocationHandler.doInvoke(MessageEndpointInvocationHandler.java:140) 
	at org.jboss.as.ejb3.inflow.AbstractInvocationHandler.invoke(AbstractInvocationHandler.java:73) 
	at com.sun.proxy.$Proxy22.onMessage(Unknown Source) 
	at org.hornetq.ra.inflow.HornetQMessageHandler.onMessage(HornetQMessageHandler.java:330) 
	at org.hornetq.core.client.impl.ClientConsumerImpl.callOnMessage(ClientConsumerImpl.java:1117) 
	at org.hornetq.core.client.impl.ClientConsumerImpl.access$500(ClientConsumerImpl.java:57) 
	at org.hornetq.core.client.impl.ClientConsumerImpl$Runner.run(ClientConsumerImpl.java:1252) 
	at org.hornetq.utils.OrderedExecutorFactory$OrderedExecutor$1.run(OrderedExecutorFactory.java:105) 
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) 
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) 
	at java.lang.Thread.run(Thread.java:748) 
2017-10-19 14:13:54,378 [l-threads-736802151)] [  STANDARD] [                    ] [                    ] (    se

Show Less
Low-Code App Development Data Integration System Administration
Moderation Team has archived post, This thread is closed to future replies. Content and links will no longer be updated. If you have the same/similar Question, please write a new Question.
Posted: 3 years ago
Posted: 20 Oct 2017 2:09 EDT
Sudhakar Reddy Yaparla (SudhakarReddy)
PEGA
Principal Technical Solutions Engineer
Pegasystems Inc.
IN

Hi,


It's showing PropertyValueInvalid, is this right error, it would be helpful if you attach complete log file.
Posted: 3 years ago
Posted: 20 Oct 2017 4:26 EDT
Bharat Bhushan Soma (BharatBhushanSoma)
Accenture

Accenture
US

Hello Sudhakar, 


I have attached the log file as requested. 


Lines 233-280 is valid for one file that has been picked by listener and processed by two listeners successfully


Lines 305-2552 is valid for other file that has been picked by listeners.(Error starts at line 365 for recovery of file by listener B. But this same file has been processed(line-352) and deleted from completed folder after processing[Since we have the cleanup File operation as "Delete" in process tab and this works correctly]. At Line 365 , listener B tries to recover the file that has already been processed and deleted and it is unable to find it probably  )


Attached the process tab cleanup File operation.


For your comment for "PropertyValueInvalid", I assume it is not because of property because listener is trying to recover a file that has already been deleted from completed folder and might have recovered only a part of it and chance of missing the full property value here .I am unable to come to a conclusion though.


Can we trace File Listener?


Let me know if anything is needed additionally from my end.