I need to generate large reports from my database (exporting csvs of 100k+ rows). I get the NeonDbError: response is too large (max is 10485760 bytes). Is the best way to to deal with this simply chunking my requests and adding everything back up? Would love to know if there’s a better way to handle this. My concern with chunking is that there may be a failed request in the batch.
Is the best way to to deal with this simply chunking my requests and adding everything back up?
Yes. You can use cursors for that
My concern with chunking is that there may be a failed request in the batch.
Depending on your setup, you can include error handling with retries
@williamlmao BTW the 10MB limit is only for our HTTP driver, if you establish a connection using WebSockets you shouldn’t be getting this error.