Rest API out of memory issue

0
Hi, We have 1 million objects in our application. So we are using rest api to export the data when we need, As datagrid2 is stopping after exporting 3-400k records. But we used the restapi with limit and offset to export data. we tried to export 5000 objects in a single api call. But we see out of memory issue when we export 500k records(5000 objects i each api  get call). Could some one please help on how to resolve this issue or is there any other way to do this.    Thanks in advance. 
asked
2 answers
1

This all depends on how you implemented the export. If the only thing you've built is a REST api which returns 5000 records and then the request is finished. 

 

Probably you created a microflow which handles the export.. retrieving 5000 records and doing that over and over within the same microflow transaction will cause the memory issue.

 

Please share more information about how you have implemented the export in order to get a more precize answer/solution

answered
1

More the data more heavier is the response body JSON of your REST api as well. So not only does your network call is slower your server may have a limit too (better check this with devops)

 

But dont you think the underlying issue stemmed from why the DataGrid2 struggles? or deeper still do your or your business user really need this much data to be exported?

answered