mathan
a568e16624
Merge branch 'main' of github.com:uabluerail/indexer
2024-05-06 17:04:58 -07:00
mathan
53db0fc5e7
Added optouts to export.
2024-05-06 17:04:57 -07:00
Max Ignatenko
9c375a3458
go get -u golang.org/x/net
2024-05-06 22:49:15 +01:00
Max Ignatenko
1d68d70a41
Avoid lister having stuck on a single broken PDS
2024-05-06 21:17:42 +01:00
Max Ignatenko
f315059994
Avoid querying too few repos from each single PDS
2024-05-06 21:14:18 +01:00
mathan
1201ee3868
Update dash.
2024-04-25 08:35:54 -07:00
mathan
a17250788d
Update dash.
2024-04-16 14:17:18 -07:00
Max Ignatenko
6997d51c07
Split firehose graphs between 1st- and 3rd-party PDSs
2024-04-16 17:01:31 +01:00
Max Ignatenko
4c3b1c7acc
Make hostname abbreviations uniform
2024-04-16 16:46:02 +01:00
Max Ignatenko
5cb8befb0d
Add my dashboard as a default
2024-04-15 22:00:21 +01:00
Max Ignatenko
78b4f54527
Add wiring for maintaining a dashboard
2024-04-15 21:58:33 +01:00
Max Ignatenko
c364822818
Tweak rate limit a little bit
2024-04-14 13:07:24 +01:00
Max Ignatenko
bc24c23afc
Switch to batch inserts
2024-04-14 12:45:05 +01:00
Max Ignatenko
c204e48de1
Add missing word
2024-04-13 22:48:34 +01:00
Max Ignatenko
2271f4da1f
Update readme
2024-04-13 21:03:34 +01:00
Max Ignatenko
9af4101a7a
Update readme
2024-04-13 20:59:40 +01:00
Max Ignatenko
4c29c3f179
Add license
2024-04-13 20:41:56 +01:00
Max Ignatenko
fa88777ecd
Update readme
2024-04-13 20:40:47 +01:00
Max Ignatenko
60c89c8796
Fix Makefile
2024-04-13 20:24:01 +01:00
Max Ignatenko
c5f3a55ac8
Add a target for waiting until PLC mirror catches up
2024-04-13 19:42:36 +01:00
Max Ignatenko
c6fe0c2350
Make the address for exporting metrics configurable
2024-04-13 19:01:51 +01:00
Max Ignatenko
c09052eb4c
Tweak example configs
2024-04-13 18:56:14 +01:00
Max Ignatenko
a746fd7120
Add deps on .env in couple more places
2024-04-13 18:50:06 +01:00
Max Ignatenko
81152c0bfc
Add block subjects to exported dids
2024-04-13 18:45:04 +01:00
Max Ignatenko
7af2a3f8be
Remove compression from content columns
2024-04-13 18:42:26 +01:00
Max Ignatenko
fe19806af2
Add code missing in the previous commit
2024-04-13 18:37:26 +01:00
Max Ignatenko
d6b5850827
Add plc mirror
...
If you want to avoid sending all requests to https://plc.directory while
it's catching up for the first time, do
`docker compose up -d --build plc` and wait for it to catch up before
updating all other containers.
2024-04-13 16:45:02 +01:00
Max Ignatenko
c17730c11f
Drop the hack for detecting cursor reset from non-compliant servers
2024-04-10 23:32:21 +01:00
Max Ignatenko
4b40c5919b
Don't update LastFirehoseRev more than once a day
2024-04-07 15:06:13 +01:00
Max Ignatenko
581cf8c720
go mod tidy
2024-04-07 14:55:02 +01:00
Max Ignatenko
99c0b08eab
Write more words
2024-04-07 14:53:22 +01:00
Max Ignatenko
52dd38f11b
Don't attribute context cancellation to firehose record content
2024-04-06 22:14:58 +01:00
Max Ignatenko
ecf2fc57d8
Disconnect from firehoses in parallel when shutting down
2024-04-06 21:59:21 +01:00
Max Ignatenko
1358bc3f08
Export a counter of firehose connection errors
2024-04-06 21:55:36 +01:00
Max Ignatenko
ff0ea08296
Implement commit signature validation
2024-04-06 21:50:51 +01:00
mathan
f9dde4db39
Update dash.
2024-04-03 12:14:49 -07:00
mathan
9cfc23b981
Update dash.
2024-04-03 12:12:28 -07:00
Max Ignatenko
89d3a264c9
Export the number of bad firehose records for each PDS
...
Fixes #1
2024-03-29 12:02:05 +00:00
Max Ignatenko
7c09c37a51
Pass the correct context to Consumer.Start so that it will actually stop
...
when singalled
2024-03-29 10:16:22 +00:00
mathan
567885af60
Fix grafana not restarting.
2024-03-28 14:57:20 -07:00
Max Ignatenko
1abe505ef9
Add support for discovering new PDSs from relays
2024-03-28 20:55:02 +00:00
Max Ignatenko
c919050833
Keep the set of running consumers up to date
2024-03-28 20:02:48 +00:00
Max Ignatenko
337f3ef2b8
Delete commented out code
2024-03-28 18:46:39 +00:00
Max Ignatenko
3da7228f35
Wait for postgres to become ready before starting other containers
2024-03-28 16:16:38 +00:00
Max Ignatenko
fc5307a971
Add a bit more logging for cursor values
2024-03-28 16:00:28 +00:00
Max Ignatenko
5d3d562ecc
Stop the ticker when goroutine exits
2024-03-28 16:00:28 +00:00
mathan
4556d6738a
Update makefile.
2024-03-27 19:59:24 -07:00
mathan
3aca467516
Update iexport.
2024-03-27 16:18:18 -07:00
Max Ignatenko
ffa2faa420
Properly escape null character in the consumer too
2024-03-24 12:43:52 +00:00
Max Ignatenko
693ae1ba0a
Bump the limit on stored bad records to 500
2024-03-24 12:32:13 +00:00