I'm using PowerBi Service connected to an in premises Microsoft SQL Server 2012 via a data gateway (personal mode).
The database of SQL Server is more than 50.000.000 lines and 78 columns, but what I import into PBI is only one table with aprox 3.500.000 rows and 37 columns. That table increases around 80.000 rows daily.
After using PowerQuery in PBI Desktop to filter and delete some rows, my Power Bi Desktop file weights 248 MB. I also do one small dax calculation for some new columns (only concatenating 1 row to create a hyperlink direct to google, nothing fancy)
The first publishing (PBI) of that PBI desktop file takes a while (250 mb) takes around 1 hour to upload... Slow, but I can manage it for being the first upload.
The problem is when refreshing the dataset daily by a data way, it takes 1 hour and 40 minutes to upload the 3.500.000 rows + the "new" 80.000 rows. 1 hour and 40 minutes shows a rate of 0,041 MB per second...
As far as I know, there is not a possibility of increasing it only the new 80.000 rows... (incremental load)
So my question is:
¿I am doing something wrong? It really takes that long (almost two hours) to upload 3.500.000 rows of 37 columns, with the PBI Desktop file equivalent is 250 mb?
I checked the native query for the table, and everything looked ok. Refreshing the 3.500.000 rows in PBI Desktop takes only 1 minute, so I don't think the problem is on the query...