Hello,
I need to create dataflows with warehouse movemente from my ERP system. I have the gateway properly installed on a server, create connection to the ERP database (postresql) using odbc connector. It works properly with some datasets I've already upload in PBI service.
The movements are more or less 27million rows. If I try to extract them with a single dataflow I have an error (I suppose it's caused by not enough resources in the ERP database to answer the query or limitation of the odbc connector... I do not know). So I created more dataflows based on years intervals (2000-2004/2005-2009/ and so on) with a limit of 5-6millions of rows (more rows generate the error). On the last dataflow (2019-today) I set up the incremental refresh (10 years in archive and 18 months update. I have put 10 years in archive because I obviously do not want to lose the oldest movements, considering that incremental refresh is "rolling"). The problem is that refreshing this dataflow I have always the following error:
Error: Encountered user gateway exception: '[GatewayPipelineErrorCode]=DM_GWPipeline_Gateway_SpooledOperationMissing [ErrorShortName]=GatewayClientErrorResponseException[GatewayId=639729]/UnknownSpooledOperationIdException [ExceptionErrorShortName]=GatewayClientErrorResponseException[GatewayId=639729]'.. RootActivityId = 2f9cf085-b3dc-4d72-af47-580037a5ac49.Param1 = [GatewayPipelineErrorCode]=DM_GWPipeline_Gateway_SpooledOperationMissing [ErrorShortName]=GatewayClientErrorResponseException[GatewayId=639729]/UnknownSpooledOperationIdException [ExceptionErrorShortName]=GatewayClientErrorResponseException[GatewayId=639729] Request ID: 96caf062-c8f3-8909-27d7-151ba68a33e4.
If I remove the incremental refresh the dataflows refreshes properly.
Anyone can help me with this issue?