Does Split by Line of a Flat File Profile in Data Process Shape expected to remove empty lines?
The split will not remove empty lines. You will need to do a search and replace
Why i ask because, without doing Find/Replace, i notice the empty lines in a Flat File profile is removed when i combine after the split by line. I'm not sure if i can rely on this "hidden" behaviour of removing lines. I tried many suggestions from the community (including the one you mentioned here) but none is removing the lines filled with space. e.g My file looks like this (Note: The empty Line#3 is filled with 3 spaces)
How to check if a line is blank using regex - Stack Overflow
Do a search/replace as prescribed in the link. Then follow my advice above.
The samples work when the entire line is blank (with no spaces). With spaces, i have no luck so far.
Use Search/Replace like below:
Data process split documents automatically removes new line and spaced lines. However, to be on the safer side, I would suggest to use a cleanse shape before your split and map. Cleanse shape would ensure all the unwanted new lines and spaces removed and you get only valid data as output. A sample below.
Mark as helpful if this addresses your query.
Retrieving data ...