35 Commits

Author SHA1 Message Date
Fred Boniface
f85a3da50e Fix TIPLOC/STANOX fetching code, fix logging for PIS metadata 2024-11-22 21:49:32 +00:00
Fred Boniface
2ef228a192 Enable writing of PIS Metadata 2024-11-22 21:38:53 +00:00
Fred Boniface
977ff77d50 Update PIS to use live db collection 2024-11-22 20:53:21 +00:00
Fred Boniface
d35a2a010e Temporarily deploy PIS data to testing collection 2024-11-13 00:28:11 +00:00
Fred Boniface
0b3c1b6ad3 Temporarily fix issue finding TIPLOC for WPH 2024-11-12 11:59:23 +00:00
Fred Boniface
e8e715aa37 PIS module ready for testing 2024-10-23 11:42:47 +01:00
Fred Boniface
77eb22b837 Testing new stations data 2024-06-30 20:28:34 +01:00
Fred Boniface
9496c9aae0 Add pipeline for tiploc/stanox 2024-06-30 19:36:37 +01:00
Fred Boniface
fed0208291 Complete alpha newStations data, deactivate CORPUS Stations data 2024-06-30 19:29:41 +01:00
Fred Boniface
358e69bec7 Add parsing for Stations 2024-06-30 09:45:16 +01:00
Fred Boniface
90e8fd5649 Begin PIS implementation 2024-05-02 15:35:00 +01:00
Fred Boniface
9bd6bbde25 Prevent deleting VSTP services when completing full download. 2024-04-23 20:49:28 +01:00
Fred Boniface
a2c5bd49ff Improve CIF Indexes 2024-04-23 20:10:04 +01:00
Fred Boniface
652d900618 Fix CIF Indexes 2024-04-23 16:54:29 +01:00
Fred Boniface
9e65b66474 Ammend CIF Indexes 2024-04-23 15:20:49 +01:00
Fred Boniface
728e8f89e2 Add VSTP index 2024-04-23 15:13:16 +01:00
Fred Boniface
6cfddee1f3 Add notes 2024-04-23 00:32:03 +01:00
Fred Boniface
fe059abd6c Adjust indexes on CIF collection 2024-04-23 00:31:03 +01:00
Fred Boniface
7bd9187e64 Add index creation 2024-04-23 00:27:33 +01:00
Fred Boniface
ba8e4e4c72 Update VSTP package to use processing from CIF package 2024-04-15 20:37:04 +01:00
Fred Boniface
3d730054c0 Adjust log levels 2024-04-14 22:17:44 +01:00
Fred Boniface
76f206441a Tidy logging in package cif and dbAccess/cif.go 2024-04-14 21:28:17 +01:00
Fred Boniface
c9f894bbe6 Add RemoveOutdatedServices 2024-04-14 21:21:35 +01:00
Fred Boniface
f97bea78eb Added multiple attempts with backoff delay to datebase connection 2024-04-14 21:21:13 +01:00
Fred Boniface
992005cc97 Optimise start-up and shut-down 2024-04-14 20:00:34 +01:00
Fred Boniface
91fd38104c Reorganise logging 2024-04-14 19:03:13 +01:00
Fred Boniface
77dc11a658 Add additional logging to identify why CIF updates were sometimes failing 2024-04-13 21:45:24 +01:00
Fred Boniface
251a190558 Set unordered for bulk CIF deletions from DB & reorganise dbAccess module. 2024-04-11 21:06:10 +01:00
Fred Boniface
76ae25fab6 Add LastUpdateType to CIF Metadata 2024-04-11 20:59:02 +01:00
Fred Boniface
3883031e04 Increase use of pointers in CORPUS package 2024-04-10 20:56:13 +01:00
Fred Boniface
39405e6d6a Add comments 2024-04-10 20:46:20 +01:00
Fred Boniface
7acae49812 Re-implement processParsedCif() to reduce memory use by 10%. Further reductions are neccessary 2024-04-09 22:39:35 +01:00
Fred Boniface
3e5ed2c10a Writing full CIF data now works. Still need to work on updating CIF data. 2024-04-08 21:08:07 +01:00
Fred Boniface
9b53bbf5af Implement function to insert new CIF entries in to the database and adjust the deletion function to follow the same style. 2024-04-06 22:27:55 +01:00
Fred Boniface
493fb41da8 Reorganise repo 2024-04-05 22:23:42 +01:00