6 Commits

Author	SHA1	Message	Date
Fred Boniface	91fd38104c	Reorganise logging	2024-04-14 19:03:13 +01:00
Fred Boniface	4459d4d316	Update package corpus to stream data to the parse function.	2024-04-11 20:50:36 +01:00
Fred Boniface	39405e6d6a	Add comments	2024-04-10 20:46:20 +01:00
Fred Boniface	f903219276	Streaming data into the CIF Parse function reduces memory down to 4.1GB - also looking to stream the parsed data directly into the database if feasable.	2024-04-10 20:19:16 +01:00
Fred Boniface	a2c52f7b8b	Increase use of pointers to improve memory usage. Currently uses around 16GB RAM.	2024-04-09 21:07:21 +01:00
Fred Boniface	493fb41da8	Reorganise repo	2024-04-05 22:23:42 +01:00