Memory Corruption/Double-Free in multiprocessing ingest
When terminating with Ctrl-c while ingesting, my python interpreter had a hard crash:
Error in `/sw/python-versions/python-3.9.2/bin/python3': double free or corruption (!prev): 0x0000000004688480
======= Backtrace: =========
/usr/lib64/libc.so.6(+0x81329)[0x7f0ef99ab329]
/pdo/users/willfong/.local/lib/python3.9/site-packages/psycopg2/_psycopg.cpython-39-x86_64-linux-gnu.so(+0x21731)[0x7f0e75e17731]
/pdo/users/willfong/.local/lib/python3.9/site-packages/psycopg2/_psycopg.cpython-39-x86_64-linux-gnu.so(+0x22680)[0x7f0e75e18680]
/pdo/users/willfong/.local/lib/python3.9/site-packages/psycopg2/_psycopg.cpython-39-x86_64-linux-gnu.so(_pq_execute_sync+0xf8)[0x7f0e75e18a48]
/pdo/users/willfong/.local/lib/python3.9/site-packages/psycopg2/_psycopg.cpython-39-x86_64-linux-gnu.so(+0x1ab65)[0x7f0e75e10b65]
/sw/python-versions/python-3.9.2/lib/libpython3.9.so.1.0(+0xc07e6)[0x7f0efa9147e6]
/sw/python-versions/python-3.9.2/lib/libpython3.9.so.1.0(_PyEval_EvalFrameDefault+0x4ed1)[0x7f0efa8c12e1]
/sw/python-versions/python-3.9.2/lib/libpython3.9.so.1.0(+0x67408)[0x7f0efa8bb408]
/sw/python-versions/python-3.9.2/lib/libpython3.9.so.1.0(+0xba4e0)[0x7f0efa90e4e0]
/sw/python-versions/python-3.9.2/lib/libpython3.9.so.1.0(PyVectorcall_Call+0x5e)[0x7f0efa90afde]
/sw/python-versions/python-3.9.2/lib/libpython3.9.so.1.0(_PyEval_EvalFrameDefault+0x395b)[0x7f0efa8bfd6b]
/sw/python-versions/python-3.9.2/lib/libpython3.9.so.1.0(+0x67408)[0x7f0efa8bb408]
/sw/python-versions/python-3.9.2/lib/libpython3.9.so.1.0(_PyEval_EvalFrameDefault+0x4ed1)[0x7f0efa8c12e1]
/sw/python-versions/python-3.9.2/lib/libpython3.9.so.1.0(+0x67408)[0x7f0efa8bb408]
/sw/python-versions/python-3.9.2/lib/libpython3.9.so.1.0(_PyEval_EvalFrameDefault+0x4ed1)[0x7f0efa8c12e1]
/sw/python-versions/python-3.9.2/lib/libpython3.9.so.1.0(+0x67408)[0x7f0efa8bb408]
/sw/python-versions/python-3.9.2/lib/libpython3.9.so.1.0(+0xba52b)[0x7f0efa90e52b]
/sw/python-versions/python-3.9.2/lib/libpython3.9.so.1.0(PyVectorcall_Call+0x5e)[0x7f0efa90afde]
/sw/python-versions/python-3.9.2/lib/libpython3.9.so.1.0(+0x268866)[0x7f0efaabc866]
/sw/python-versions/python-3.9.2/lib/libpython3.9.so.1.0(+0x20d477)[0x7f0efaa61477]
/usr/lib64/libpthread.so.0(+0x7ea5)[0x7f0efa408ea5]
/usr/lib64/libc.so.6(clone+0x6d)[0x7f0ef9a28b0d]
======= Memory map: ========
00400000-00401000 r-xp 00000000 00:29 171672208 /pdo/app/python-versions/python-3.9.2/bin/python3.9
00600000-00601000 r--p 00000000 00:29 171672208 /pdo/app/python-versions/python-3.9.2/bin/python3.9
00601000-00602000 rw-p 00001000 00:29 171672208 /pdo/app/python-versions/python-3.9.2/bin/python3.9
01cfd000-12b42000 rw-p 00000000 00:00 0 [heap]
12b42000-3f4f0000 rw-p 00000000 00:00 0 [heap]
7f0d3c0ff000-7f0d468bf000 rw-p 00000000 00:00 0
7f0d5663d000-7f0d5663f000 r-xp 00000000 00:29 171684156 /pdo/app/python-versions/python-3.9.2/lib/python3.9/lib-dynload/_posixshmem.cpython-39-x86_64-linux-gnu.so
7f0d5663f000-7f0d5683e000 ---p 00002000 00:29 171684156 /pdo/app/python-versions/python-3.9.2/lib/python3.9/lib-dynload/_posixshmem.cpython-39-x86_64-linux-gnu.so
7f0d5683e000-7f0d5683f000 r--p 00001000 00:29 171684156 /pdo/app/python-versions/python-3.9.2/lib/python3.9/lib-dynload/_posixshmem.cpython-39-x86_64-linux-gnu.so
7f0d5683f000-7f0d56840000 rw-p 00002000 00:29 171684156 /pdo/app/python-versions/python-3.9.2/lib/python3.9/lib-dynload/_posixshmem.cpython-39-x86_64-linux-gnu.so
7f0d56840000-7f0d90000000 rw-p 00000000 00:00 0
7f0d90000000-7f0d90021000 rw-p 00000000 00:00 0
7f0d90021000-7f0d94000000 ---p 00000000 00:00 0
7f0d94000000-7f0d98cc0000 rw-p 00000000 00:00 0
7f0d98cff000-7f0d99a7f000 rw-p 00000000 00:00 0
7f0d99a7f000-7f0d99a80000 ---p 00000000 00:00 0
7f0d99a80000-7f0d9fac0000 rw-p 00000000 00:00 0
7f0d9fac1000-7f0dae181000 rw-p 00000000 00:00 0
7f0dae183000-7f0db5c03000 rw-p 00000000 00:00 0
7f0db5c05000-7f0dc18c5000 rw-p 00000000 00:00 0
7f0dc18c6000-7f0dc2a06000 rw-p 00000000 00:00 0
7f0dc2a07000-7f0de3bc7000 rw-p 00000000 00:00 0
7f0de3bc7000-7f0de3be5000 r-xp 00000000 08:28 1836393 /usr/lib64/libgssrpc.so.4.2
7f0de3be5000-7f0de3de5000 ---p 0001e000 08:28 1836393 /usr/lib64/libgssrpc.so.4.2
7f0de3de5000-7f0de3de6000 r--p 0001e000 08:28 1836393 /usr/lib64/libgssrpc.so.4.2
7f0de3de6000-7f0de3de7000 rw-p 0001f000 08:28 1836393 /usr/lib64/libgssrpc.so.4.2
7f0de3de7000-7f0de3e02000 r-xp 00000000 08:28 67736163 /usr/lib64/gssproxy/proxymech.so
7f0de3e02000-7f0de4002000 ---p 0001b000 08:28 67736163 /usr/lib64/gssproxy/proxymech.so
7f0de4002000-7f0de4003000 r--p 0001b000 08:28 67736163 /usr/lib64/gssproxy/proxymech.so
7f0de4003000-7f0de4004000 rw-p 0001c000 08:28 67736163 /usr/lib64/gssproxy/proxymech.so
7f0de4004000-7f0de4010000 r-xp 00000000 08:28 1188 /usr/lib64/libnss_files-2.17.so
7f0de4010000-7f0de420f000 ---p 0000c000 08:28 1188 /usr/lib64/libnss_files-2.17.so
7f0de420f000-7f0de4210000 r--p 0000b000 08:28 1188 /usr/lib64/libnss_files-2.17.so
7f0de4210000-7f0de4211000 rw-p 0000c000 08:28 1188 /usr/lib64/libnss_files-2.17.so
7f0de4211000-7f0de4257000 rw-p 00000000 00:00 0
7f0de4257000-7f0de4259000 r-xp 00000000 00:29 171691040 /pdo/app/python-versions/python-3.9.2/lib/python3.9/site-packages/astropy/time/_parse_times.cpython-39-x86_64-linux-gnu.so
7f0de4259000-7f0de4458000 ---p 00002000 00:29 171691040 /pdo/app/python-versions/python-3.9.2/lib/python3.9/site-packages/astropy/time/_parse_times.cpython-39-x86_64-linux-gnu.so
7f0de4458000-7f0de4459000 rw-p 00001000 00:29 171691040 /pdo/app/python-versions/python-3.9.2/lib/python3.9/site-packages/astropy/time/_parse_times.cpython-39-x86_64-linux-gnu.so
7f0de4459000-7f0de4499000 rw-p 00000000 00:00 0
7f0de4499000-7f0de44be000 r-xp 00000000 08:28 1330 /usr/lib64/libtinfo.so.5.9
7f0de44be000-7f0de46be000 ---p 00025000 08:28 1330 /usr/lib64/libtinfo.so.5.9
7f0de46be000-7f0de46c2000 r--p 00025000 08:28 1330 /usr/lib64/libtinfo.so.5.9
7f0de46c2000-7f0de46c3000 rw-p 00029000 08:28 1330 /usr/lib64/libtinfo.so.5.9
7f0de46c3000-7f0de46fa000 r-xp 00000000 08:28 1276 /usr/lib64/libncursesw.so.5.9
To upload designs, you'll need to enable LFS and have an admin enable hashed storage. More information