If these are not direct connect sources, I’m assuming you’re using a flat file source instead, so you can use the File Upload Utility to automate aggregating the data into SailPoint:
File Upload Utility - CoLab / Community Tools - SailPoint Developer Community