Quantcast
Channel: Service topics
Viewing all articles
Browse latest Browse all 62260

Incremental Refresh does not load newly loaded data

$
0
0

Hi, 

 

I've recently created a test report to see if Incremental Refresh works with PBI Pro connected to MS Blob Storage. The data is imported as .parquet file. There are two reports (exactly the same ones but one with Incremental Refresh and one with just Scheduled refresh).

 

The problem is that once the new data is loaded to the blob storage, the one with Incremental Refresh did not load the new data but the Scheduled Refresh report did. The steps I took to confiure Incremental Refresh are:

 

1. Imported the .parquet from the blob storage

2. Created RangeStart and RangeEnd parameter 

Aki_umemoto_0-1628072632236.png

 

 

3. Since there is no date/time column (but DateID column formated like 20210804), I've created a function that converts RangeStart and RangeEnd to match the ID column format

Aki_umemoto_1-1628072632246.png

 

 

4. Filtered the DateID column and applied RangeStart and RangeEnd as the range

Aki_umemoto_2-1628072632269.png

 

 

5. Implemented Incremental Refresh Policy for the table

Aki_umemoto_3-1628072632663.png

 

6. Published it and set the Scheduled Refresh

 

Currently the data shown in the report is for 20210717 - 20210724, and after the refresh it should have changed to 20210717-20210725 but it only shows the data 20210717 - 20210724. 

 

My Questions are:

 

1. Am I doing something wrong in the steps to configure IR? Do I need Scheduled Refresh set up if the Incremental Refresh is defined before Desktop?

2. I see the warning sign when applying IR. How could I check if query folding does take place? Could this be why it's not working?


Viewing all articles
Browse latest Browse all 62260

Trending Articles



<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>