Commit Graph

6 Commits

Author SHA1 Message Date
Fred Boniface
91fd38104c Reorganise logging 2024-04-14 19:03:13 +01:00
Fred Boniface
4459d4d316 Update package corpus to stream data to the parse function. 2024-04-11 20:50:36 +01:00
Fred Boniface
39405e6d6a Add comments 2024-04-10 20:46:20 +01:00
Fred Boniface
f903219276 Streaming data into the CIF Parse function reduces memory down to 4.1GB - also looking to stream the parsed data directly into the database if feasable. 2024-04-10 20:19:16 +01:00
Fred Boniface
a2c52f7b8b Increase use of pointers to improve memory usage. Currently uses around 16GB RAM. 2024-04-09 21:07:21 +01:00
Fred Boniface
493fb41da8 Reorganise repo 2024-04-05 22:23:42 +01:00