Commit Graph

13 Commits

Author SHA1 Message Date
Fred Boniface ba8e4e4c72 Update VSTP package to use processing from CIF package 2024-04-15 20:37:04 +01:00
Fred Boniface 76f206441a Tidy logging in package cif and dbAccess/cif.go 2024-04-14 21:28:17 +01:00
Fred Boniface 91fd38104c Reorganise logging 2024-04-14 19:03:13 +01:00
Fred Boniface 77dc11a658 Add additional logging to identify why CIF updates were sometimes failing
Go Test / test (push) Successful in 46s Details
2024-04-13 21:45:24 +01:00
Fred Boniface 6ec8cd8895 Complete CIF Metadata parsing logic
Go Test / test (push) Successful in 1m3s Details
2024-04-12 20:43:03 +01:00
Fred Boniface b2f82b0250 Optimise batch size and stream handling 2024-04-11 20:50:13 +01:00
Fred Boniface 7acae49812 Re-implement processParsedCif() to reduce memory use by 10%. Further reductions are neccessary
Go Test / test (push) Successful in 31s Details
2024-04-09 22:39:35 +01:00
Fred Boniface 94e4cd964d Improve CIF Parsing to acheive 60% memory reduction 2024-04-09 21:26:56 +01:00
Fred Boniface 3e5ed2c10a Writing full CIF data now works. Still need to work on updating CIF data. 2024-04-08 21:08:07 +01:00
Fred Boniface 4a7bcd7f80 Increase use of pointers to minimise memory usage
Go Test / test (push) Failing after 1m26s Details
2024-04-07 20:59:41 +01:00
Fred Boniface 3481c4e314 Tidy up
Go Test / test (push) Successful in 1m43s Details
2024-04-06 22:31:38 +01:00
Fred Boniface a15cbb778a Implement generateMetadata function 2024-04-06 22:28:26 +01:00
Fred Boniface 493fb41da8 Reorganise repo
Go Test / test (push) Failing after 48s Details
2024-04-05 22:23:42 +01:00