Objective: I am building a C# tool to bulk upload IFC files via the API. The goal is to automate the ingestion of multiple IFC models into Speckle efficiently.
Issue: When processing large IFC files, the uploads create a heavy load on the Speckle fileimporter. After running for a while, the process simply stops.
I am looking for advice on how to prevent this. Are there recommended strategies for handling massive IFC uploads?
Assuming you’re wanting to get the IFCs into your own self hosted server, rather than app.speckle.systems,
You could try using the env var FILE_IMPORT_TIME_LIMIT_MIN to set the timeout to something greater (e.g. 30 mins)
This should be set on the speckle-server service.
For app.speckle.systems, we run our machines on runners with 64GB of memory, as we’ve observed processing some super large IFCs can be very hungry for RAM.
This maybe particularly important, since you’re running the public open source version of the server, which lags behind some of the efficiently improvements we’ve made for app.speckle.systems