Commit Graph

21 Commits (db74fac7d005f74a2713634d39501f318827f1b1)

Author SHA1 Message Date
Max Ignatenko a41f6aa75c wip: try partitioning by date 2024-09-07 13:29:50 +01:00
Max Ignatenko 9283a841b4 Fix for atproto.brid.gy being treated as not whitelisted due to not matching "https://*" glob pattern 2024-05-21 08:58:37 +01:00
Max Ignatenko ff0ea08296 Implement commit signature validation 2024-04-06 21:50:51 +01:00
Max Ignatenko 4c41389e9b Detect CAR files with zero blocks and handle them accordingly 2024-03-17 17:42:09 +00:00
Max Ignatenko 0cc11e75b2 Avoid updating records when then didn't actually change 2024-03-17 14:16:25 +00:00
Max Ignatenko 9c51a4621f Start recording last rev for each repo 2024-03-13 22:28:54 +00:00
Max Ignatenko 3a2c6a6f5b Add PDS URL to error message 2024-02-26 07:27:15 +00:00
mathan efc106453f Fixed NPE, fixed failed lister migration. 2024-02-25 20:51:10 -08:00
Max Ignatenko 0b6e326762 Set an explicit default for Deleted 2024-02-25 10:30:49 +00:00
mathan 78a17bf238 Merge branch 'main' of github.com:uabluerail/indexer 2024-02-22 18:56:19 -08:00
mathan db425b1d5f Fix view in migration. Add by lang metric to consumer. 2024-02-22 18:54:29 -08:00
Max Ignatenko 8f32c494f7 Add whitelist for PDS hosts and update repo PDS pointer on appropriate occasions 2024-02-22 12:17:21 +00:00
mathan 600dac7694 Added metric for posts by lang (olivčykom). 2024-02-21 18:09:12 -08:00
Max Ignatenko 765b7b792b Set default PDS ID to unknown 2024-02-21 09:39:26 +00:00
Max Ignatenko b2003530ba Handle repos with unknown PDS 2024-02-21 09:35:25 +00:00
Max Ignatenko 1d25842b78 Add few more metrics 2024-02-18 17:23:54 +00:00
Max Ignatenko 1038ca3bea Add AtRev column to only overwrite records with a newer version 2024-02-17 14:29:45 +00:00
Max Ignatenko 4626b8b9ca Limit the number of retries when failing to index a repo 2024-02-16 15:23:34 +00:00
Max Ignatenko 8313c74482 Remove deleted_at 2024-02-15 20:29:08 +00:00
Max Ignatenko 8561d90caf A bit of query optimization 2024-02-15 18:39:29 +00:00
Max Ignatenko 63a767d890 Import 2024-02-15 16:10:39 +00:00