Commit Graph

178 Commits (d57f4750d97ce14fe5a465b0fc320cbf35454120)

Author SHA1 Message Date
Max Ignatenko 3432121be2 Give postgres a bit more RAM 2024-02-25 11:06:47 +00:00
Max Ignatenko 0b6e326762 Set an explicit default for Deleted 2024-02-25 10:30:49 +00:00
Max Ignatenko fdace096fb Add fast compression to save a bit on IO bandwidth 2024-02-25 10:30:03 +00:00
mathan b9b3159828 Update dashboards 2024-02-24 20:01:16 -08:00
mathan fa87ce6105 Update dashboards 2024-02-23 18:35:38 -08:00
mathan a5ad0743ee Update stats dash 2024-02-23 14:22:39 -08:00
mathan d18867f495 Update stats dash. 2024-02-23 13:37:59 -08:00
mathan e98c4f4c63 Add stats dash. Update indexer dash 2024-02-23 12:48:52 -08:00
mathan bd4e74d36f Update dash 2024-02-23 12:33:53 -08:00
mathan 9fb8fc3dce Update dash 2024-02-23 11:44:06 -08:00
mathan 69c5c6b7ad Add ignore to override. 2024-02-23 09:26:11 -08:00
Max Ignatenko ddde20a014 Fix comparison with NULL when listing PDSs 2024-02-23 15:22:22 +00:00
Max Ignatenko 6bb2e5a1de Fix path to sql file 2024-02-23 11:28:24 +00:00
Max Ignatenko 13b911615d Add sqldu 2024-02-23 11:26:06 +00:00
Max Ignatenko ea3e11e495 Add sqltop 2024-02-23 11:19:13 +00:00
Max Ignatenko 0f191b2609 Increment exported vars for every language in a post 2024-02-23 11:12:39 +00:00
Max Ignatenko 297e9e0347 Scripts for benchmarking partitioning 2024-02-23 11:10:45 +00:00
mathan 78a17bf238 Merge branch 'main' of github.com:uabluerail/indexer 2024-02-22 18:56:19 -08:00
mathan db425b1d5f Fix view in migration. Add by lang metric to consumer. 2024-02-22 18:54:29 -08:00
Max Ignatenko a20ddf0717 Fix the fucking regexp 2024-02-22 18:16:43 +00:00
Max Ignatenko a28199fb92 Handle the new #identity message 2024-02-22 12:17:21 +00:00
Max Ignatenko 8f32c494f7 Add whitelist for PDS hosts and update repo PDS pointer on appropriate occasions 2024-02-22 12:17:21 +00:00
mathan 600dac7694 Added metric for posts by lang (olivčykom). 2024-02-21 18:09:12 -08:00
mathan 3c632ebe97 Update csv_export 2024-02-21 13:40:18 -08:00
mathan 9d4bb721cf Fix makefile 2024-02-21 10:22:00 -08:00
Max Ignatenko 9a520c186e Fix dids dumping 2024-02-21 17:40:23 +00:00
Max Ignatenko 59e343355e Add a few indexes and views 2024-02-21 10:36:55 +00:00
Max Ignatenko 0898658acb Split out list-related records into separate partitions 2024-02-21 10:08:50 +00:00
Max Ignatenko 765b7b792b Set default PDS ID to unknown 2024-02-21 09:39:26 +00:00
Max Ignatenko 67a8ab5aff Downgrade intermediate resolver error to trace 2024-02-21 09:36:09 +00:00
Max Ignatenko b2003530ba Handle repos with unknown PDS 2024-02-21 09:35:25 +00:00
Max Ignatenko fa8b67bcc9 Fix tar output filename 2024-02-21 09:16:19 +00:00
mathan d6dff5a9a0 Fix csv_export and Makefile 2024-02-20 22:08:14 -08:00
mathan 0e01664cfb Added example content jsons.
Updated README.md
2024-02-20 22:00:26 -08:00
mathan 3b77099bec Add daemon csv export to Makefile 2024-02-20 20:43:50 -08:00
mathan fba373f835 Add db-migrations folder.
Add future language metrics to query-exporter.
2024-02-20 15:45:23 -08:00
Max Ignatenko da86ee3a1c JSON indexes for posts 2024-02-20 22:58:29 +00:00
mathan de4017bc83 Add delimiters, fixed likes file name. 2024-02-20 11:07:47 -08:00
Max Ignatenko b7458a18f4 Export the list of repos from indexer 2024-02-20 15:36:52 +00:00
Max Ignatenko d9147940aa Bump connection limit for postgres from 100 to 1000 2024-02-20 15:35:59 +00:00
Max Ignatenko 876b454916 Patch through POSTRES_PASSWORD and export the number of failed repos 2024-02-20 11:02:53 +00:00
mathan b809b8b983 Rename dump.sh 2024-02-19 15:11:09 -08:00
mathan 95c24ff0c5 Add maitenance queries 2024-02-19 11:22:51 -08:00
mathan 4ef6abbfc4 Update readme 2024-02-19 11:20:34 -08:00
Max Ignatenko f5a8be6ebb Script for dumping data into .csv 2024-02-19 19:06:51 +00:00
Max Ignatenko 6b400b1f43 Add a script for breaking up records table into partitions 2024-02-19 19:06:51 +00:00
mathan 8b86f8f929 Merge branch 'main' of github.com:uabluerail/indexer 2024-02-19 10:59:24 -08:00
mathan 4b06e54cdc Update dash 2024-02-19 10:59:23 -08:00
Max Ignatenko a0934c360e fix division by zero 2024-02-19 18:34:31 +00:00
mathan e8ca4e808e Move query-exporter to docker. Update dash. 2024-02-19 10:18:40 -08:00