I am trying to write 12 times to S3 in the same process. I am running into an issue with response time. This is taking round 9 seconds. Is there any way to speed this up.
This is a real time process. I am sending data to an Atom Queue to be written to S3 outside of the real time process. I created a sub process to "group" the data with a return shape before sending in the connector (This was recommended by Dellfor a different process with success before changing to write to disk).
The Atom this is running on is on-premise.
File sizes are between .04 and .26 kb.
Shape executed successfully in 9062 ms.
Example of what the processes looks like
[sub] Map to S3 and set S3 location