Hello,
I am creating a dataflow with a sql query dataset that is about 2-7 million rows. The sql query itself usually takes 1.5h to finish running. Ive tried using Power Query and change the runtime to 200mins to run the sql but it keeps throwing timed out errors.
Now Im trying to load the base tables directly from database with necessary columns, then in Power Query join/combine the tables to get the final output data, but the tables are too big and it cant finish loading to combine.
Initially we need the previous 90 days data, so Ive also tried to slice the dataset into 15 days each batch, but still took too long to load and failed.
Any potional solutions we can try here? Appreciate any ideas and help!
