Question

Amount of data that can be retrieve from database using microflow

0

Hi, I have a requirement where i need to update 100k objects. So retrieving all at once will cause memory issues. So i though to update the data in batches. Could someone help me on out of 100k objects ow much no of objects i can retrieve at a time(say 5 or 10k records in a batch). And how to determine how many objects a batch can have based on any factors? or any mendix best practices. Thanks in advance.

asked 2024-02-19

Thmanampudi Lokesh Parameswara Reddy

1 answers

Eline Bijkerk · Accepted Answer · 2024-02-19

Aside from the recommendation mentioned by Amani, it highly depends on what you're retrieving and what kind of updates you're doing. Batch processing is indeed a good way to do this. I would recommend setting the batch size to be variable so you can easily adjust the amount per batch and then experiment a little with a data set that is representative of your production environment.