a41f6aa75c
wip: try partitioning by date
2024-09-07 13:29:50 +01:00
19a21ad3a9
feature: skip unnecessary recompilation in some cases
2024-09-07 11:47:15 +01:00
a8bcde76e2
feature: move schema updates into a separate oneshot service
2024-09-07 11:25:10 +01:00
de51bd9015
Read handles from the new plc mirror
2024-06-24 16:31:50 +01:00
9cc2572666
Filter out dead dids on postgres level.
2024-06-03 14:53:43 -07:00
4af4f48a1e
Update dash.
2024-05-30 07:55:35 -07:00
d57f4750d9
Add listblock query.
2024-05-27 10:38:39 -07:00
8de7cb87cb
Fix regexp to include bsky.social in 1st-party PDS list
2024-05-21 17:05:14 +01:00
51986e34c6
Update dashboard
2024-05-21 17:02:36 +01:00
e6176a2217
Add exponential backoff to firehose connection attempts and export connection status directly
2024-05-21 11:43:35 +01:00
e986d370ec
go get -u ./...
2024-05-21 11:41:42 +01:00
722952af34
go mod tidy
2024-05-21 09:44:21 +01:00
9283a841b4
Fix for atproto.brid.gy being treated as not whitelisted due to not matching "https://*" glob pattern
2024-05-21 08:58:37 +01:00
a9076c44c0
Ladder fixed.
2024-05-16 22:17:17 -07:00
64b7533315
remove the latest migration until further notice.
2024-05-16 17:29:07 -07:00
6fe357b54a
Fix decay values.
2024-05-16 08:32:16 -07:00
ca7d5956eb
Cutoff at 240 days.
2024-05-15 20:56:06 -07:00
621ce539cf
Undo fix.
2024-05-15 13:28:21 -07:00
8daf08d57c
Fix optout header.
2024-05-15 11:51:27 -07:00
fb1048f3a6
Add temporal ladder export. Fix optout export typo.
2024-05-15 10:40:23 -07:00
59922eb54c
Add monthly export.
2024-05-14 19:26:00 -07:00
a568e16624
Merge branch 'main' of github.com:uabluerail/indexer
2024-05-06 17:04:58 -07:00
53db0fc5e7
Added optouts to export.
2024-05-06 17:04:57 -07:00
9c375a3458
go get -u golang.org/x/net
2024-05-06 22:49:15 +01:00
1d68d70a41
Avoid lister having stuck on a single broken PDS
2024-05-06 21:17:42 +01:00
f315059994
Avoid querying too few repos from each single PDS
2024-05-06 21:14:18 +01:00
1201ee3868
Update dash.
2024-04-25 08:35:54 -07:00
a17250788d
Update dash.
2024-04-16 14:17:18 -07:00
6997d51c07
Split firehose graphs between 1st- and 3rd-party PDSs
2024-04-16 17:01:31 +01:00
4c3b1c7acc
Make hostname abbreviations uniform
2024-04-16 16:46:02 +01:00
5cb8befb0d
Add my dashboard as a default
2024-04-15 22:00:21 +01:00
78b4f54527
Add wiring for maintaining a dashboard
2024-04-15 21:58:33 +01:00
c364822818
Tweak rate limit a little bit
2024-04-14 13:07:24 +01:00
bc24c23afc
Switch to batch inserts
2024-04-14 12:45:05 +01:00
c204e48de1
Add missing word
2024-04-13 22:48:34 +01:00
2271f4da1f
Update readme
2024-04-13 21:03:34 +01:00
9af4101a7a
Update readme
2024-04-13 20:59:40 +01:00
4c29c3f179
Add license
2024-04-13 20:41:56 +01:00
fa88777ecd
Update readme
2024-04-13 20:40:47 +01:00
60c89c8796
Fix Makefile
2024-04-13 20:24:01 +01:00
c5f3a55ac8
Add a target for waiting until PLC mirror catches up
2024-04-13 19:42:36 +01:00
c6fe0c2350
Make the address for exporting metrics configurable
2024-04-13 19:01:51 +01:00
c09052eb4c
Tweak example configs
2024-04-13 18:56:14 +01:00
a746fd7120
Add deps on .env in couple more places
2024-04-13 18:50:06 +01:00
81152c0bfc
Add block subjects to exported dids
2024-04-13 18:45:04 +01:00
7af2a3f8be
Remove compression from content columns
2024-04-13 18:42:26 +01:00
fe19806af2
Add code missing in the previous commit
2024-04-13 18:37:26 +01:00
d6b5850827
Add plc mirror
...
If you want to avoid sending all requests to https://plc.directory while
it's catching up for the first time, do
`docker compose up -d --build plc` and wait for it to catch up before
updating all other containers.
2024-04-13 16:45:02 +01:00
c17730c11f
Drop the hack for detecting cursor reset from non-compliant servers
2024-04-10 23:32:21 +01:00
4b40c5919b
Don't update LastFirehoseRev more than once a day
2024-04-07 15:06:13 +01:00
Max Ignatenko
mathan