Commit Graph

188 Commits (9b877c152461fa92297cfe7a26a3f561e5fb2904)

Author SHA1 Message Date
Max Ignatenko 9b877c1524 Remove everything that's not needed for PLC mirror 2024-09-25 22:04:13 +01:00
Max Ignatenko 56727bbe11 fix: properly install curl 2024-09-07 19:36:48 +01:00
Max Ignatenko 87a66bd269 fix: remove deprecated field 2024-09-07 13:52:39 +01:00
Max Ignatenko db74fac7d0 feature: add plc-mirror healthcheck 2024-09-07 13:48:19 +01:00
Max Ignatenko a41f6aa75c wip: try partitioning by date 2024-09-07 13:29:50 +01:00
Max Ignatenko 19a21ad3a9 feature: skip unnecessary recompilation in some cases 2024-09-07 11:47:15 +01:00
Max Ignatenko a8bcde76e2 feature: move schema updates into a separate oneshot service 2024-09-07 11:25:10 +01:00
Max Ignatenko de51bd9015 Read handles from the new plc mirror 2024-06-24 16:31:50 +01:00
mathan 9cc2572666 Filter out dead dids on postgres level. 2024-06-03 14:53:43 -07:00
mathan 4af4f48a1e Update dash. 2024-05-30 07:55:35 -07:00
mathan d57f4750d9 Add listblock query. 2024-05-27 10:38:39 -07:00
Max Ignatenko 8de7cb87cb Fix regexp to include bsky.social in 1st-party PDS list 2024-05-21 17:05:14 +01:00
Max Ignatenko 51986e34c6 Update dashboard 2024-05-21 17:02:36 +01:00
Max Ignatenko e6176a2217 Add exponential backoff to firehose connection attempts and export connection status directly 2024-05-21 11:43:35 +01:00
Max Ignatenko e986d370ec go get -u ./... 2024-05-21 11:41:42 +01:00
Max Ignatenko 722952af34 go mod tidy 2024-05-21 09:44:21 +01:00
Max Ignatenko 9283a841b4 Fix for atproto.brid.gy being treated as not whitelisted due to not matching "https://*" glob pattern 2024-05-21 08:58:37 +01:00
mathan a9076c44c0 Ladder fixed. 2024-05-16 22:17:17 -07:00
mathan 64b7533315 remove the latest migration until further notice. 2024-05-16 17:29:07 -07:00
mathan 6fe357b54a Fix decay values. 2024-05-16 08:32:16 -07:00
mathan ca7d5956eb Cutoff at 240 days. 2024-05-15 20:56:06 -07:00
mathan 621ce539cf Undo fix. 2024-05-15 13:28:21 -07:00
mathan 8daf08d57c Fix optout header. 2024-05-15 11:51:27 -07:00
mathan fb1048f3a6 Add temporal ladder export. Fix optout export typo. 2024-05-15 10:40:23 -07:00
mathan 59922eb54c Add monthly export. 2024-05-14 19:26:00 -07:00
mathan a568e16624 Merge branch 'main' of github.com:uabluerail/indexer 2024-05-06 17:04:58 -07:00
mathan 53db0fc5e7 Added optouts to export. 2024-05-06 17:04:57 -07:00
Max Ignatenko 9c375a3458 go get -u golang.org/x/net 2024-05-06 22:49:15 +01:00
Max Ignatenko 1d68d70a41 Avoid lister having stuck on a single broken PDS 2024-05-06 21:17:42 +01:00
Max Ignatenko f315059994 Avoid querying too few repos from each single PDS 2024-05-06 21:14:18 +01:00
mathan 1201ee3868 Update dash. 2024-04-25 08:35:54 -07:00
mathan a17250788d Update dash. 2024-04-16 14:17:18 -07:00
Max Ignatenko 6997d51c07 Split firehose graphs between 1st- and 3rd-party PDSs 2024-04-16 17:01:31 +01:00
Max Ignatenko 4c3b1c7acc Make hostname abbreviations uniform 2024-04-16 16:46:02 +01:00
Max Ignatenko 5cb8befb0d Add my dashboard as a default 2024-04-15 22:00:21 +01:00
Max Ignatenko 78b4f54527 Add wiring for maintaining a dashboard 2024-04-15 21:58:33 +01:00
Max Ignatenko c364822818 Tweak rate limit a little bit 2024-04-14 13:07:24 +01:00
Max Ignatenko bc24c23afc Switch to batch inserts 2024-04-14 12:45:05 +01:00
Max Ignatenko c204e48de1 Add missing word 2024-04-13 22:48:34 +01:00
Max Ignatenko 2271f4da1f Update readme 2024-04-13 21:03:34 +01:00
Max Ignatenko 9af4101a7a Update readme 2024-04-13 20:59:40 +01:00
Max Ignatenko 4c29c3f179 Add license 2024-04-13 20:41:56 +01:00
Max Ignatenko fa88777ecd Update readme 2024-04-13 20:40:47 +01:00
Max Ignatenko 60c89c8796 Fix Makefile 2024-04-13 20:24:01 +01:00
Max Ignatenko c5f3a55ac8 Add a target for waiting until PLC mirror catches up 2024-04-13 19:42:36 +01:00
Max Ignatenko c6fe0c2350 Make the address for exporting metrics configurable 2024-04-13 19:01:51 +01:00
Max Ignatenko c09052eb4c Tweak example configs 2024-04-13 18:56:14 +01:00
Max Ignatenko a746fd7120 Add deps on .env in couple more places 2024-04-13 18:50:06 +01:00
Max Ignatenko 81152c0bfc Add block subjects to exported dids 2024-04-13 18:45:04 +01:00
Max Ignatenko 7af2a3f8be Remove compression from content columns 2024-04-13 18:42:26 +01:00