Commit graph

206 commits

Author SHA1 Message Date
b00ce6d799 Merge remote-tracking branch 'bsky-mirror/main' 2024-11-14 18:07:10 +00:00
Max Ignatenko
bad22e6422 fix: s/LastSuccess/LastCompletion/ and use it as orignally intended 2024-11-14 12:44:42 +00:00
Max Ignatenko
04ab6167c7 fix: use LastRecordTimestamp in serve() instead of LastSuccess 2024-11-14 12:36:39 +00:00
Max Ignatenko
b26866fe0c fix: update lastSuccessTimestamp after each request too
Updating only in run() can be delayed arbitrarily long under load.
2024-11-14 12:34:13 +00:00
Max Ignatenko
2c6a7201ef fix: actually store the queried timestamp in the struct 2024-11-14 12:17:01 +00:00
Max Ignatenko
04f2f80a06 fix: keep the timestamp of last record in memory instead of querying the DB every time 2024-11-13 18:56:22 +00:00
Max Ignatenko
80128ebcff fix: change lower bound 1 -> 0.1 2024-10-27 12:23:59 +00:00
Max Ignatenko
f379f6b4b4 fix: tweak histogram buckets 2024-10-27 12:21:59 +00:00
Max Ignatenko
d0fd66f83f feature: a few exported metrics 2024-10-26 21:31:44 +01:00
61f751b59a update files 2024-10-26 02:59:57 +01:00
ca4d5709e8 Update README.md 2024-10-26 03:54:30 +02:00
bb036dc6d8 Update README.md 2024-10-26 03:53:15 +02:00
add8ffc1c4 Update cmd/plc-mirror/Dockerfile 2024-10-26 03:50:41 +02:00
90370ef60b Update cmd/plc-mirror/serve.go 2024-10-25 23:58:58 +02:00
49182413f0 Update cmd/plc-mirror/mirror.go 2024-10-25 23:58:45 +02:00
4432fcea80 Update cmd/plc-mirror/main.go 2024-10-25 23:58:25 +02:00
39c3c9cd5a Update go.mod 2024-10-25 23:56:56 +02:00
Max Ignatenko
9f29e6cc24 Rename module and run go mod tidy 2024-09-25 22:05:40 +01:00
Max Ignatenko
9b877c1524 Remove everything that's not needed for PLC mirror 2024-09-25 22:04:13 +01:00
Max Ignatenko
56727bbe11 fix: properly install curl 2024-09-07 19:36:48 +01:00
Max Ignatenko
87a66bd269 fix: remove deprecated field 2024-09-07 13:52:39 +01:00
Max Ignatenko
db74fac7d0 feature: add plc-mirror healthcheck 2024-09-07 13:48:19 +01:00
Max Ignatenko
a41f6aa75c wip: try partitioning by date 2024-09-07 13:29:50 +01:00
Max Ignatenko
19a21ad3a9 feature: skip unnecessary recompilation in some cases 2024-09-07 11:47:15 +01:00
Max Ignatenko
a8bcde76e2 feature: move schema updates into a separate oneshot service 2024-09-07 11:25:10 +01:00
Max Ignatenko
de51bd9015 Read handles from the new plc mirror 2024-06-24 16:31:50 +01:00
mathan
9cc2572666 Filter out dead dids on postgres level. 2024-06-03 14:53:43 -07:00
mathan
4af4f48a1e Update dash. 2024-05-30 07:55:35 -07:00
mathan
d57f4750d9 Add listblock query. 2024-05-27 10:38:39 -07:00
Max Ignatenko
8de7cb87cb Fix regexp to include bsky.social in 1st-party PDS list 2024-05-21 17:05:14 +01:00
Max Ignatenko
51986e34c6 Update dashboard 2024-05-21 17:02:36 +01:00
Max Ignatenko
e6176a2217 Add exponential backoff to firehose connection attempts and export connection status directly 2024-05-21 11:43:35 +01:00
Max Ignatenko
e986d370ec go get -u ./... 2024-05-21 11:41:42 +01:00
Max Ignatenko
722952af34 go mod tidy 2024-05-21 09:44:21 +01:00
Max Ignatenko
9283a841b4 Fix for atproto.brid.gy being treated as not whitelisted due to not matching "https://*" glob pattern 2024-05-21 08:58:37 +01:00
mathan
a9076c44c0 Ladder fixed. 2024-05-16 22:17:17 -07:00
mathan
64b7533315 remove the latest migration until further notice. 2024-05-16 17:29:07 -07:00
mathan
6fe357b54a Fix decay values. 2024-05-16 08:32:16 -07:00
mathan
ca7d5956eb Cutoff at 240 days. 2024-05-15 20:56:06 -07:00
mathan
621ce539cf Undo fix. 2024-05-15 13:28:21 -07:00
mathan
8daf08d57c Fix optout header. 2024-05-15 11:51:27 -07:00
mathan
fb1048f3a6 Add temporal ladder export. Fix optout export typo. 2024-05-15 10:40:23 -07:00
mathan
59922eb54c Add monthly export. 2024-05-14 19:26:00 -07:00
mathan
a568e16624 Merge branch 'main' of github.com:uabluerail/indexer 2024-05-06 17:04:58 -07:00
mathan
53db0fc5e7 Added optouts to export. 2024-05-06 17:04:57 -07:00
Max Ignatenko
9c375a3458 go get -u golang.org/x/net 2024-05-06 22:49:15 +01:00
Max Ignatenko
1d68d70a41 Avoid lister having stuck on a single broken PDS 2024-05-06 21:17:42 +01:00
Max Ignatenko
f315059994 Avoid querying too few repos from each single PDS 2024-05-06 21:14:18 +01:00
mathan
1201ee3868 Update dash. 2024-04-25 08:35:54 -07:00
mathan
a17250788d Update dash. 2024-04-16 14:17:18 -07:00