My datasource is Google BigQuery, and I have scheduled Auto refresh weekly, but it failed constantly starting from a few days ago, the error message says this: [Resource Governing: This operation was canceled because there wasn't enough memory to finish running it. Either reduce the memory footprint of your dataset by doing things such as limiting the amount of imported data, or if using Power BI Premium, increase the memory of the Premium capacity where this dataset is hosted. More details: consumed memory 16155 MB, memory limit 15405 MB, database size before command execution 978 MB. See https://go.microsoft.com/fwlink/?linkid=2159753 to learn more.]
From reading other similar posts, I know that it is because when Power BI does data refresh, it takes the uncompressed dataset, the compressed old set and the compressed new set so the memory is significantly higher than the compressed size of the model.
I am having Pro license, and I am not planning to pay for Premium (no money), so I am stuck with 1GB memory for refresh, nor can I click the "Enable large dataset button", nor can I use the Metrics app to inspect my data refresh process.
When stuck with Pro, I saw there are online tutorials teaching viusalization of refresh process using SSMS sql server profiler to find memory spikes for us to optimize data model and calculated columns and stuff, but I cannot connect to the sql server of my dashboard, and I suspect it is because the datasource is from Google BigQuery.
My question is, is there other ways to solve this data refresh failure without upgrading BI license?