AnsweredAssumed Answered

FlowControl with comination of Threads-5 units and Run as batch of 500 doc's.

Question asked by venky on Aug 10, 2018
Latest reply on Aug 13, 2018 by britto.parthalomew

Hi team,

 

In our process we retrieving the records from Net suite and creating them into database. For making process performance better used Flowcontrol shape with multiple options here is below

 

Option1-Flow control with run as batch of 500 records 

Records count-524122

Process execution time-19:01:53

 

OPtion2-Parallel processing, no of units-3 (Threads)
record count-524122
Process execution time-26:48:43

(Total records retrieved successfully from Net suite but only 403150 records created in DB remaining records error out

Error Msg:Error_Description
Error executing sql statement: Transaction (Process ID 74) was deadlocked on lock |
communication buffer resources with another process and has been chosen as the deadlock victim.
Rerun the transaction.; Caused by: Transaction (Process ID 74) was deadlocked on lock |
communication buffer resources with another process and has been chosen as the deadlock victim. Rerun the transaction.)

 

Option3- FlowControl with comination of Threads-5 units and Run as batch of 500 doc's.

record count-524122 
Process execution time-31:24:42  

(Total records retrieved successfully from Net suite but only 265299 records created in DB remaining records error out

Error Msg:Error_Description
Error executing sql statement: Transaction (Process ID 74) was deadlocked on lock | 
communication buffer resources with another process and has been chosen as the deadlock victim. 
Rerun the transaction.; Caused by: Transaction (Process ID 74) was deadlocked on lock |
communication buffer resources with another process and has been chosen as the deadlock victim. Rerun the transaction.)

 

Please help us why we are getting this error, when we execute with batch option didn't receive any error, but using with parallel processing it seems like gettig this error.

Process taking more time when executing with parallel option when compare with batching process.

 

Outcomes