Commit Graph

152 Commits (c364822818de23df93458ef98f7167492ca36e20)

Author SHA1 Message Date
Max Ignatenko 346aa7c539 Document consistency model for repo data 2024-03-17 15:21:54 +00:00
Max Ignatenko 0cc11e75b2 Avoid updating records when then didn't actually change 2024-03-17 14:16:25 +00:00
Max Ignatenko 9c51a4621f Start recording last rev for each repo 2024-03-13 22:28:54 +00:00
mathan 85259baa1c Update dash. 2024-03-13 14:21:05 -07:00
mathan 9d429be424 Update dash. 2024-03-13 11:33:13 -07:00
Max Ignatenko 76a50524a0 Give postgres plenty of time to shutdown cleanly 2024-03-13 18:12:55 +00:00
Max Ignatenko 44d2b25951 Fix nil pointer deref 2024-03-13 16:38:58 +00:00
Max Ignatenko e150f1da90 Populate FirstRevSinceReset if empty 2024-03-13 11:32:23 +00:00
Max Ignatenko 87d510e67a Check repos against PDS cursor resets, instead of waiting for a first new even for them on firehose 2024-03-13 10:39:41 +00:00
Max Ignatenko 57aa4731e5 Properly update repo consistency metadata
Previously these two queries did nothing at all -_-

Note that this will trigger a full re-index of every repo seen on the
firehose.
2024-03-13 10:36:41 +00:00
Max Ignatenko 080cbb8b12 Bump WAL size limit to 8GB 2024-03-13 09:51:40 +00:00
mathan 75386c0235 Add export_blocks view. Add iexport + audit table. 2024-03-12 21:15:23 -07:00
mathan e1ec43def7 Add count listitems. 2024-03-06 18:58:08 -08:00
mathan dc80cd95ad Update stats dash. 2024-03-05 14:17:46 -08:00
mathan 209813bd87 Update dash + csv_export. 2024-02-28 10:37:18 -08:00
mathan 439518fda1 Update dash. 2024-02-26 12:57:05 -08:00
Max Ignatenko 3a2c6a6f5b Add PDS URL to error message 2024-02-26 07:27:15 +00:00
mathan efc106453f Fixed NPE, fixed failed lister migration. 2024-02-25 20:51:10 -08:00
mathan 067be8ec83 Update dash. Add smartmon to readme. 2024-02-25 18:04:06 -08:00
Max Ignatenko 95ca4f0eef Use materialized views for export to csv 2024-02-25 22:05:34 +00:00
mathan 2172651870 Merge branch 'main' of github.com:uabluerail/indexer 2024-02-25 09:05:50 -08:00
mathan 95abc3691f Update dash, added smartmon 2024-02-25 09:05:48 -08:00
Max Ignatenko b4a0c268d6 Bump max_parallel_workers_per_gather to 8 2024-02-25 11:35:10 +00:00
Max Ignatenko fa592c2b34 Add a migration to enable compression on already existing tables 2024-02-25 11:24:40 +00:00
Max Ignatenko 3432121be2 Give postgres a bit more RAM 2024-02-25 11:06:47 +00:00
Max Ignatenko 0b6e326762 Set an explicit default for Deleted 2024-02-25 10:30:49 +00:00
Max Ignatenko fdace096fb Add fast compression to save a bit on IO bandwidth 2024-02-25 10:30:03 +00:00
mathan b9b3159828 Update dashboards 2024-02-24 20:01:16 -08:00
mathan fa87ce6105 Update dashboards 2024-02-23 18:35:38 -08:00
mathan a5ad0743ee Update stats dash 2024-02-23 14:22:39 -08:00
mathan d18867f495 Update stats dash. 2024-02-23 13:37:59 -08:00
mathan e98c4f4c63 Add stats dash. Update indexer dash 2024-02-23 12:48:52 -08:00
mathan bd4e74d36f Update dash 2024-02-23 12:33:53 -08:00
mathan 9fb8fc3dce Update dash 2024-02-23 11:44:06 -08:00
mathan 69c5c6b7ad Add ignore to override. 2024-02-23 09:26:11 -08:00
Max Ignatenko ddde20a014 Fix comparison with NULL when listing PDSs 2024-02-23 15:22:22 +00:00
Max Ignatenko 6bb2e5a1de Fix path to sql file 2024-02-23 11:28:24 +00:00
Max Ignatenko 13b911615d Add sqldu 2024-02-23 11:26:06 +00:00
Max Ignatenko ea3e11e495 Add sqltop 2024-02-23 11:19:13 +00:00
Max Ignatenko 0f191b2609 Increment exported vars for every language in a post 2024-02-23 11:12:39 +00:00
Max Ignatenko 297e9e0347 Scripts for benchmarking partitioning 2024-02-23 11:10:45 +00:00
mathan 78a17bf238 Merge branch 'main' of github.com:uabluerail/indexer 2024-02-22 18:56:19 -08:00
mathan db425b1d5f Fix view in migration. Add by lang metric to consumer. 2024-02-22 18:54:29 -08:00
Max Ignatenko a20ddf0717 Fix the fucking regexp 2024-02-22 18:16:43 +00:00
Max Ignatenko a28199fb92 Handle the new #identity message 2024-02-22 12:17:21 +00:00
Max Ignatenko 8f32c494f7 Add whitelist for PDS hosts and update repo PDS pointer on appropriate occasions 2024-02-22 12:17:21 +00:00
mathan 600dac7694 Added metric for posts by lang (olivčykom). 2024-02-21 18:09:12 -08:00
mathan 3c632ebe97 Update csv_export 2024-02-21 13:40:18 -08:00
mathan 9d4bb721cf Fix makefile 2024-02-21 10:22:00 -08:00
Max Ignatenko 9a520c186e Fix dids dumping 2024-02-21 17:40:23 +00:00