How do I split the response of call rest service into parts?

0
Hi,   I'll be pulling 50,000 rows of data using call rest GET. This process takes an hour, which consumes the application's memory. What can I do? How can I pull the 50,000 rows from the call rest service by splitting them into smaller pieces? I'll run this process daily using a schedule event.
asked
2 answers
0

Hello Ayberk Akbalik,

 

To GET the data from another source, normally it is the data owning party(api owning party) that can implement measures to not send you all the data. 

Sometimes with limits; sometimes with filters, sometimes with both.

So i would recommend to first discuss this with the api owning party.

 

Hope this helps,

 

Good luck!

answered
0

As Jelle says, this would really need to be done on the API side, ideally through some sort of pagination allowing you to bring back smaller data sets for processing.

 

If you can't get a smaller data set from the API, the alternative may have to be to increase the size of the Mendix container. This would give you more resources in your app to process the large amount of data returned. This would be an additional cost.

 

Good luck!

answered