FlowControl shape causes memory to be depleted.

Document created by anton_serbanescu Employee on Apr 3, 2014Last modified by ellen_obrien816040 on Apr 4, 2016
Version 2Show Document
  • View in full screen mode
FlowControl shape set to process each record individually causes memory to be depleted
The FlowControl follows a Database shape that has batch count set to 1 and generates 1 record per document.

 

The process fails almost every day with out of memory, java heap space, forcing a restart of the Atom.
The FlowControl should be used when there are more than 1000 document or 100000 documents to be processed, and need to process a few documents at a time. If there is only 1 record or 1 document to be processed, then most likely the flow control
will not improve the execution of the process, and should not be used.

Attachments

    Outcomes