Hi all,
I am try the Dataflow Gen 2 to implement SCD2 logic with the target set to a warehouse. During the first run all the records are being pushed to target as expected.
During the second run the same set of records are again being pushed created a duplicate entry for the record even when there are no changes.
When manually viewing the target records in the dataflow, no records are being shown as expected. But upon publish/run the same set of records get pushed again to the target.
I am testing it out on sample data, I am attaching below some screenshots for the same.
Please anyone had a similar experience, it would be great if you could let me know how you resolved it.
Thank you