Commit Graph

163 Commits (a568e1662494b9fbb3927bb36fbf87730edf159d)

Author SHA1 Message Date
mathan a568e16624 Merge branch 'main' of github.com:uabluerail/indexer 2024-05-06 17:04:58 -07:00
mathan 53db0fc5e7 Added optouts to export. 2024-05-06 17:04:57 -07:00
Max Ignatenko 9c375a3458 go get -u golang.org/x/net 2024-05-06 22:49:15 +01:00
Max Ignatenko 1d68d70a41 Avoid lister having stuck on a single broken PDS 2024-05-06 21:17:42 +01:00
Max Ignatenko f315059994 Avoid querying too few repos from each single PDS 2024-05-06 21:14:18 +01:00
mathan 1201ee3868 Update dash. 2024-04-25 08:35:54 -07:00
mathan a17250788d Update dash. 2024-04-16 14:17:18 -07:00
Max Ignatenko 6997d51c07 Split firehose graphs between 1st- and 3rd-party PDSs 2024-04-16 17:01:31 +01:00
Max Ignatenko 4c3b1c7acc Make hostname abbreviations uniform 2024-04-16 16:46:02 +01:00
Max Ignatenko 5cb8befb0d Add my dashboard as a default 2024-04-15 22:00:21 +01:00
Max Ignatenko 78b4f54527 Add wiring for maintaining a dashboard 2024-04-15 21:58:33 +01:00
Max Ignatenko c364822818 Tweak rate limit a little bit 2024-04-14 13:07:24 +01:00
Max Ignatenko bc24c23afc Switch to batch inserts 2024-04-14 12:45:05 +01:00
Max Ignatenko c204e48de1 Add missing word 2024-04-13 22:48:34 +01:00
Max Ignatenko 2271f4da1f Update readme 2024-04-13 21:03:34 +01:00
Max Ignatenko 9af4101a7a Update readme 2024-04-13 20:59:40 +01:00
Max Ignatenko 4c29c3f179 Add license 2024-04-13 20:41:56 +01:00
Max Ignatenko fa88777ecd Update readme 2024-04-13 20:40:47 +01:00
Max Ignatenko 60c89c8796 Fix Makefile 2024-04-13 20:24:01 +01:00
Max Ignatenko c5f3a55ac8 Add a target for waiting until PLC mirror catches up 2024-04-13 19:42:36 +01:00
Max Ignatenko c6fe0c2350 Make the address for exporting metrics configurable 2024-04-13 19:01:51 +01:00
Max Ignatenko c09052eb4c Tweak example configs 2024-04-13 18:56:14 +01:00
Max Ignatenko a746fd7120 Add deps on .env in couple more places 2024-04-13 18:50:06 +01:00
Max Ignatenko 81152c0bfc Add block subjects to exported dids 2024-04-13 18:45:04 +01:00
Max Ignatenko 7af2a3f8be Remove compression from content columns 2024-04-13 18:42:26 +01:00
Max Ignatenko fe19806af2 Add code missing in the previous commit 2024-04-13 18:37:26 +01:00
Max Ignatenko d6b5850827 Add plc mirror
If you want to avoid sending all requests to https://plc.directory while
it's catching up for the first time, do
`docker compose up -d --build plc` and wait for it to catch up before
updating all other containers.
2024-04-13 16:45:02 +01:00
Max Ignatenko c17730c11f Drop the hack for detecting cursor reset from non-compliant servers 2024-04-10 23:32:21 +01:00
Max Ignatenko 4b40c5919b Don't update LastFirehoseRev more than once a day 2024-04-07 15:06:13 +01:00
Max Ignatenko 581cf8c720 go mod tidy 2024-04-07 14:55:02 +01:00
Max Ignatenko 99c0b08eab Write more words 2024-04-07 14:53:22 +01:00
Max Ignatenko 52dd38f11b Don't attribute context cancellation to firehose record content 2024-04-06 22:14:58 +01:00
Max Ignatenko ecf2fc57d8 Disconnect from firehoses in parallel when shutting down 2024-04-06 21:59:21 +01:00
Max Ignatenko 1358bc3f08 Export a counter of firehose connection errors 2024-04-06 21:55:36 +01:00
Max Ignatenko ff0ea08296 Implement commit signature validation 2024-04-06 21:50:51 +01:00
mathan f9dde4db39 Update dash. 2024-04-03 12:14:49 -07:00
mathan 9cfc23b981 Update dash. 2024-04-03 12:12:28 -07:00
Max Ignatenko 89d3a264c9 Export the number of bad firehose records for each PDS
Fixes #1
2024-03-29 12:02:05 +00:00
Max Ignatenko 7c09c37a51 Pass the correct context to Consumer.Start so that it will actually stop
when singalled
2024-03-29 10:16:22 +00:00
mathan 567885af60 Fix grafana not restarting. 2024-03-28 14:57:20 -07:00
Max Ignatenko 1abe505ef9 Add support for discovering new PDSs from relays 2024-03-28 20:55:02 +00:00
Max Ignatenko c919050833 Keep the set of running consumers up to date 2024-03-28 20:02:48 +00:00
Max Ignatenko 337f3ef2b8 Delete commented out code 2024-03-28 18:46:39 +00:00
Max Ignatenko 3da7228f35 Wait for postgres to become ready before starting other containers 2024-03-28 16:16:38 +00:00
Max Ignatenko fc5307a971 Add a bit more logging for cursor values 2024-03-28 16:00:28 +00:00
Max Ignatenko 5d3d562ecc Stop the ticker when goroutine exits 2024-03-28 16:00:28 +00:00
mathan 4556d6738a Update makefile. 2024-03-27 19:59:24 -07:00
mathan 3aca467516 Update iexport. 2024-03-27 16:18:18 -07:00
Max Ignatenko ffa2faa420 Properly escape null character in the consumer too 2024-03-24 12:43:52 +00:00
Max Ignatenko 693ae1ba0a Bump the limit on stored bad records to 500 2024-03-24 12:32:13 +00:00