Commit Graph

23 Commits (9283a841b4079ba9e460a370e6b72918ddc93034)

Author SHA1 Message Date
Max Ignatenko c17730c11f Drop the hack for detecting cursor reset from non-compliant servers 2024-04-10 23:32:21 +01:00
Max Ignatenko 4b40c5919b Don't update LastFirehoseRev more than once a day 2024-04-07 15:06:13 +01:00
Max Ignatenko 52dd38f11b Don't attribute context cancellation to firehose record content 2024-04-06 22:14:58 +01:00
Max Ignatenko 1358bc3f08 Export a counter of firehose connection errors 2024-04-06 21:55:36 +01:00
Max Ignatenko ff0ea08296 Implement commit signature validation 2024-04-06 21:50:51 +01:00
Max Ignatenko c919050833 Keep the set of running consumers up to date 2024-03-28 20:02:48 +00:00
Max Ignatenko fc5307a971 Add a bit more logging for cursor values 2024-03-28 16:00:28 +00:00
Max Ignatenko 5d3d562ecc Stop the ticker when goroutine exits 2024-03-28 16:00:28 +00:00
Max Ignatenko ffa2faa420 Properly escape null character in the consumer too 2024-03-24 12:43:52 +00:00
Max Ignatenko 693ae1ba0a Bump the limit on stored bad records to 500 2024-03-24 12:32:13 +00:00
Max Ignatenko bae23a62d0 Don't try to upsert zero records 2024-03-20 13:31:14 +00:00
Max Ignatenko 9c51a4621f Start recording last rev for each repo 2024-03-13 22:28:54 +00:00
Max Ignatenko 57aa4731e5 Properly update repo consistency metadata
Previously these two queries did nothing at all -_-

Note that this will trigger a full re-index of every repo seen on the
firehose.
2024-03-13 10:36:41 +00:00
Max Ignatenko 0f191b2609 Increment exported vars for every language in a post 2024-02-23 11:12:39 +00:00
mathan 78a17bf238 Merge branch 'main' of github.com:uabluerail/indexer 2024-02-22 18:56:19 -08:00
mathan db425b1d5f Fix view in migration. Add by lang metric to consumer. 2024-02-22 18:54:29 -08:00
Max Ignatenko a28199fb92 Handle the new #identity message 2024-02-22 12:17:21 +00:00
Max Ignatenko 8f32c494f7 Add whitelist for PDS hosts and update repo PDS pointer on appropriate occasions 2024-02-22 12:17:21 +00:00
Max Ignatenko 758c5fe5e6 Add quick&dirty quarantine logic for bad records 2024-02-19 17:06:19 +00:00
Max Ignatenko 1d25842b78 Add few more metrics 2024-02-18 17:23:54 +00:00
Max Ignatenko 1038ca3bea Add AtRev column to only overwrite records with a newer version 2024-02-17 14:29:45 +00:00
Max Ignatenko 8313c74482 Remove deleted_at 2024-02-15 20:29:08 +00:00
Max Ignatenko 63a767d890 Import 2024-02-15 16:10:39 +00:00