ProcessPoolExecutor. We have a large usage example demonstrating parallel CSV ingestion, here, which may be run in either threadpool or processpool mode.
multiprocessingexecution method for
ProcessPoolExecutoron Linux is not compatible with TileDB (nor with most other multi-threaded applications) due to complications of global process state after
ProcessPoolExecutormust be used with
multiprocessing.set_start_method("spawn")to avoid unexpected behavior (such as hangs and crashes).