Commit Graph

193 Commits (90370ef60b3e908bcbf81f6511aa69230b966550)

Author SHA1 Message Date
Max Ignatenko 57aa4731e5 Properly update repo consistency metadata
Previously these two queries did nothing at all -_-

Note that this will trigger a full re-index of every repo seen on the
firehose.
2024-03-13 10:36:41 +00:00
Max Ignatenko 080cbb8b12 Bump WAL size limit to 8GB 2024-03-13 09:51:40 +00:00
mathan 75386c0235 Add export_blocks view. Add iexport + audit table. 2024-03-12 21:15:23 -07:00
mathan e1ec43def7 Add count listitems. 2024-03-06 18:58:08 -08:00
mathan dc80cd95ad Update stats dash. 2024-03-05 14:17:46 -08:00
mathan 209813bd87 Update dash + csv_export. 2024-02-28 10:37:18 -08:00
mathan 439518fda1 Update dash. 2024-02-26 12:57:05 -08:00
Max Ignatenko 3a2c6a6f5b Add PDS URL to error message 2024-02-26 07:27:15 +00:00
mathan efc106453f Fixed NPE, fixed failed lister migration. 2024-02-25 20:51:10 -08:00
mathan 067be8ec83 Update dash. Add smartmon to readme. 2024-02-25 18:04:06 -08:00
Max Ignatenko 95ca4f0eef Use materialized views for export to csv 2024-02-25 22:05:34 +00:00
mathan 2172651870 Merge branch 'main' of github.com:uabluerail/indexer 2024-02-25 09:05:50 -08:00
mathan 95abc3691f Update dash, added smartmon 2024-02-25 09:05:48 -08:00
Max Ignatenko b4a0c268d6 Bump max_parallel_workers_per_gather to 8 2024-02-25 11:35:10 +00:00
Max Ignatenko fa592c2b34 Add a migration to enable compression on already existing tables 2024-02-25 11:24:40 +00:00
Max Ignatenko 3432121be2 Give postgres a bit more RAM 2024-02-25 11:06:47 +00:00
Max Ignatenko 0b6e326762 Set an explicit default for Deleted 2024-02-25 10:30:49 +00:00
Max Ignatenko fdace096fb Add fast compression to save a bit on IO bandwidth 2024-02-25 10:30:03 +00:00
mathan b9b3159828 Update dashboards 2024-02-24 20:01:16 -08:00
mathan fa87ce6105 Update dashboards 2024-02-23 18:35:38 -08:00
mathan a5ad0743ee Update stats dash 2024-02-23 14:22:39 -08:00
mathan d18867f495 Update stats dash. 2024-02-23 13:37:59 -08:00
mathan e98c4f4c63 Add stats dash. Update indexer dash 2024-02-23 12:48:52 -08:00
mathan bd4e74d36f Update dash 2024-02-23 12:33:53 -08:00
mathan 9fb8fc3dce Update dash 2024-02-23 11:44:06 -08:00
mathan 69c5c6b7ad Add ignore to override. 2024-02-23 09:26:11 -08:00
Max Ignatenko ddde20a014 Fix comparison with NULL when listing PDSs 2024-02-23 15:22:22 +00:00
Max Ignatenko 6bb2e5a1de Fix path to sql file 2024-02-23 11:28:24 +00:00
Max Ignatenko 13b911615d Add sqldu 2024-02-23 11:26:06 +00:00
Max Ignatenko ea3e11e495 Add sqltop 2024-02-23 11:19:13 +00:00
Max Ignatenko 0f191b2609 Increment exported vars for every language in a post 2024-02-23 11:12:39 +00:00
Max Ignatenko 297e9e0347 Scripts for benchmarking partitioning 2024-02-23 11:10:45 +00:00
mathan 78a17bf238 Merge branch 'main' of github.com:uabluerail/indexer 2024-02-22 18:56:19 -08:00
mathan db425b1d5f Fix view in migration. Add by lang metric to consumer. 2024-02-22 18:54:29 -08:00
Max Ignatenko a20ddf0717 Fix the fucking regexp 2024-02-22 18:16:43 +00:00
Max Ignatenko a28199fb92 Handle the new #identity message 2024-02-22 12:17:21 +00:00
Max Ignatenko 8f32c494f7 Add whitelist for PDS hosts and update repo PDS pointer on appropriate occasions 2024-02-22 12:17:21 +00:00
mathan 600dac7694 Added metric for posts by lang (olivčykom). 2024-02-21 18:09:12 -08:00
mathan 3c632ebe97 Update csv_export 2024-02-21 13:40:18 -08:00
mathan 9d4bb721cf Fix makefile 2024-02-21 10:22:00 -08:00
Max Ignatenko 9a520c186e Fix dids dumping 2024-02-21 17:40:23 +00:00
Max Ignatenko 59e343355e Add a few indexes and views 2024-02-21 10:36:55 +00:00
Max Ignatenko 0898658acb Split out list-related records into separate partitions 2024-02-21 10:08:50 +00:00
Max Ignatenko 765b7b792b Set default PDS ID to unknown 2024-02-21 09:39:26 +00:00
Max Ignatenko 67a8ab5aff Downgrade intermediate resolver error to trace 2024-02-21 09:36:09 +00:00
Max Ignatenko b2003530ba Handle repos with unknown PDS 2024-02-21 09:35:25 +00:00
Max Ignatenko fa8b67bcc9 Fix tar output filename 2024-02-21 09:16:19 +00:00
mathan d6dff5a9a0 Fix csv_export and Makefile 2024-02-20 22:08:14 -08:00
mathan 0e01664cfb Added example content jsons.
Updated README.md
2024-02-20 22:00:26 -08:00
mathan 3b77099bec Add daemon csv export to Makefile 2024-02-20 20:43:50 -08:00