Question

24
Replies
3235
Views
Akshay Kumar (Kumar)
Accenture

Accenture
AU
Kumar Member since 2013 8 posts
Accenture
Posted: June 29, 2016
Last activity: October 27, 2016
Posted: 29 Jun 2016 21:44 EDT
Last activity: 27 Oct 2016 23:35 EDT
Closed
Solved

BIX Extraction Performance

Hi Team,


I am extracting a full record from the work table of my application through BIX extract in Database format, below is the statistics for the same.


Statistics:


2016-06-28 17:32:06,929 [.PRPCWorkManager : 0] [                    ] [CCOLCHN_BIX:02.05.70] (   internal.access.ExtractImpl) INFO    - # Total Instances retrieved: 362724


2016-06-28 17:32:06,945 [.PRPCWorkManager : 0] [                    ] [CCOLCHN_BIX:02.05.70] (   internal.access.ExtractImpl) INFO    - Elapsed Time (seconds): 4626.313


2016-06-28 17:32:06,945 [.PRPCWorkManager : 0] [                    ] [CCOLCHN_BIX:02.05.70] (   internal.access.ExtractImpl) INFO    - Total CPU Time (seconds): 0.0


2016-06-28 17:32:06,945 [.PRPCWorkManager : 0] [                    ] [CCOLCHN_BIX:02.05.70] (   internal.access.ExtractImpl) INFO    - #Instances Extracted: 362723

Hi Team,

I am extracting a full record from the work table of my application through BIX extract in Database format, below is the statistics for the same.

Statistics:

2016-06-28 17:32:06,929 [.PRPCWorkManager : 0] [                    ] [CCOLCHN_BIX:02.05.70] (   internal.access.ExtractImpl) INFO    - # Total Instances retrieved: 362724

2016-06-28 17:32:06,945 [.PRPCWorkManager : 0] [                    ] [CCOLCHN_BIX:02.05.70] (   internal.access.ExtractImpl) INFO    - Elapsed Time (seconds): 4626.313

2016-06-28 17:32:06,945 [.PRPCWorkManager : 0] [                    ] [CCOLCHN_BIX:02.05.70] (   internal.access.ExtractImpl) INFO    - Total CPU Time (seconds): 0.0

2016-06-28 17:32:06,945 [.PRPCWorkManager : 0] [                    ] [CCOLCHN_BIX:02.05.70] (   internal.access.ExtractImpl) INFO    - #Instances Extracted: 362723

2016-06-28 17:32:06,945 [.PRPCWorkManager : 0] [                    ] [CCOLCHN_BIX:02.05.70] (   internal.access.ExtractImpl) INFO    - #Instances per second: 78.4043362392471

2016-06-28 17:32:06,945 [.PRPCWorkManager : 0] [                    ] [CCOLCHN_BIX:02.05.70] (   internal.access.ExtractImpl) INFO    - #Instances per hour: 282255.6104612896

2016-06-28 17:32:06,945 [.PRPCWorkManager : 0] [                    ] [CCOLCHN_BIX:02.05.70] (   internal.access.ExtractImpl) INFO    - #Instances not extracted due to errors: 1

My customer is using a simple ETL tool for extraction and in 1 second it retrieved around 11,000+ records. And same he is expecting from PEGA BIX.

I have few questions and needed an expert advise on it.

 

  1. This extract contains both the columns expose in work table as well as unexposed. I want to understand the number of data extracted in this much time (4626.313 sec) is normal behavior or it is very slow?
  2. Even if we are going to create indexes is it going to improve the extraction consioderably say total extract of that much data:362724 can be extracted in less that 15 or 20 mins?
  3. If we mention all the expose columns from the worktable in the extract,still the whole data will be fetched from BLOB?

 

System Administration Reporting
Moderation Team has archived post, This thread is closed to future replies. Content and links will no longer be updated. If you have the same/similar Question, please write a new Question.