Hi @peratkar - The behavior for lookups is explained here. You might consider running with --verbose
to see the lookup table generated.
If you are interested in the lookup generation, you can see the source code here.
The lookups require 1) iterating through all sources, and 2) a source having the attribute cloudExternalId
populated (from old CC source IDs). Some newer sources might not have this set.
So you can either:
- Ensure your source has the old Source ID in
cloudExternalId
and rely on lookups - Or use the new Source ID in the file name.
The later is the most reliable way forward as there are no lookups, and newer sources won’t have an old Source ID going forward.