Inserting large records from a spreadsheet (CSV file) to Backend is a very common and hard engineering problem.
Modern data stack ETL tools may solve it ..But
- You are a web developer (javascript)person..:)
- You don't want to invest money on an ETL tool.
- You are not a data engineer who create and maintain data pipeline.
Please read this blog to understand how YoBulk is solving this in a most frugal(limited CPU and RAM) way.
https://github.com/yobulkdev/yobulkdev/tree/main/pages/api/upload