How to handle source data split over multiple files?

Hi All,

I have a requirement to process source data where the data maybe split over multiple files. The data maybe split as shown below.

I am only concerned with the section header and row data. I need to be able to refer to the section header data from file1 when processing the data in file n+1.

The file naming convention is xxx-yyyymmdd.sequenceNumber.version.format. The final file is determined by the fact that it contains a record footer and record count section. My initial thinking is that stitching the files together prior to processing in PI would be cumbersome since you can't just append the data to the end of the previous file.

Any suggestions where I may start looking to find how to handle this scenario would be much appreciated.

regards

Julian