|
|
ba8e4e4c72
|
Update VSTP package to use processing from CIF package
|
2024-04-15 20:37:04 +01:00 |
|
|
|
76f206441a
|
Tidy logging in package cif and dbAccess/cif.go
|
2024-04-14 21:28:17 +01:00 |
|
|
|
91fd38104c
|
Reorganise logging
|
2024-04-14 19:03:13 +01:00 |
|
|
|
b2f82b0250
|
Optimise batch size and stream handling
|
2024-04-11 20:50:13 +01:00 |
|
|
|
fb510e1408
|
Add logging for unknown CIF data types
Go Test / test (push) Successful in 23s
|
2024-04-10 23:05:19 +01:00 |
|
|
|
751b67e61e
|
Remove unused functions
Go Test / test (push) Successful in 25s
|
2024-04-10 22:59:13 +01:00 |
|
|
|
fea7a5b831
|
Disable parsing of JSONAssociations as they are not currently used within OwlBoard
Go Test / test (push) Successful in 26s
|
2024-04-10 21:47:08 +01:00 |
|
|
|
39405e6d6a
|
Add comments
|
2024-04-10 20:46:20 +01:00 |
|
|
|
f903219276
|
Streaming data into the CIF Parse function reduces memory down to 4.1GB - also looking to stream the parsed data directly into the database if feasable.
|
2024-04-10 20:19:16 +01:00 |
|
|
|
94e4cd964d
|
Improve CIF Parsing to acheive 60% memory reduction
|
2024-04-09 21:26:56 +01:00 |
|
|
|
a2c52f7b8b
|
Increase use of pointers to improve memory usage. Currently uses around 16GB RAM.
|
2024-04-09 21:07:21 +01:00 |
|
|
|
493fb41da8
|
Reorganise repo
Go Test / test (push) Failing after 48s
|
2024-04-05 22:23:42 +01:00 |
|
