Max Ignatenko
|
4c41389e9b
|
Detect CAR files with zero blocks and handle them accordingly
|
2024-03-17 17:42:09 +00:00 |
|
Max Ignatenko
|
638bdcf515
|
Add a check for zero bytes fetched from PDS
And log additional info when we're failing to extract rev from repo
bytes
|
2024-03-17 17:15:23 +00:00 |
mathan
|
bc895b6425
|
Update dash.
|
2024-03-17 08:52:28 -07:00 |
|
Max Ignatenko
|
553894dc6a
|
Switch to partial repo fetches
|
2024-03-17 15:34:26 +00:00 |
|
Max Ignatenko
|
346aa7c539
|
Document consistency model for repo data
|
2024-03-17 15:21:54 +00:00 |
|
Max Ignatenko
|
0cc11e75b2
|
Avoid updating records when then didn't actually change
|
2024-03-17 14:16:25 +00:00 |
|
Max Ignatenko
|
9c51a4621f
|
Start recording last rev for each repo
|
2024-03-13 22:28:54 +00:00 |
|
mathan
|
85259baa1c
|
Update dash.
|
2024-03-13 14:21:05 -07:00 |
|
mathan
|
9d429be424
|
Update dash.
|
2024-03-13 11:33:13 -07:00 |
|
Max Ignatenko
|
76a50524a0
|
Give postgres plenty of time to shutdown cleanly
|
2024-03-13 18:12:55 +00:00 |
|
Max Ignatenko
|
44d2b25951
|
Fix nil pointer deref
|
2024-03-13 16:38:58 +00:00 |
|
Max Ignatenko
|
e150f1da90
|
Populate FirstRevSinceReset if empty
|
2024-03-13 11:32:23 +00:00 |
|
Max Ignatenko
|
87d510e67a
|
Check repos against PDS cursor resets, instead of waiting for a first new even for them on firehose
|
2024-03-13 10:39:41 +00:00 |
|
Max Ignatenko
|
57aa4731e5
|
Properly update repo consistency metadata
Previously these two queries did nothing at all -_-
Note that this will trigger a full re-index of every repo seen on the
firehose.
|
2024-03-13 10:36:41 +00:00 |
|
Max Ignatenko
|
080cbb8b12
|
Bump WAL size limit to 8GB
|
2024-03-13 09:51:40 +00:00 |
|
mathan
|
75386c0235
|
Add export_blocks view. Add iexport + audit table.
|
2024-03-12 21:15:23 -07:00 |
|
mathan
|
e1ec43def7
|
Add count listitems.
|
2024-03-06 18:58:08 -08:00 |
|
mathan
|
dc80cd95ad
|
Update stats dash.
|
2024-03-05 14:17:46 -08:00 |
|
mathan
|
209813bd87
|
Update dash + csv_export.
|
2024-02-28 10:37:18 -08:00 |
|
mathan
|
439518fda1
|
Update dash.
|
2024-02-26 12:57:05 -08:00 |
|
Max Ignatenko
|
3a2c6a6f5b
|
Add PDS URL to error message
|
2024-02-26 07:27:15 +00:00 |
|
mathan
|
efc106453f
|
Fixed NPE, fixed failed lister migration.
|
2024-02-25 20:51:10 -08:00 |
|
mathan
|
067be8ec83
|
Update dash. Add smartmon to readme.
|
2024-02-25 18:04:06 -08:00 |
|
Max Ignatenko
|
95ca4f0eef
|
Use materialized views for export to csv
|
2024-02-25 22:05:34 +00:00 |
|
mathan
|
2172651870
|
Merge branch 'main' of github.com:uabluerail/indexer
|
2024-02-25 09:05:50 -08:00 |
|
mathan
|
95abc3691f
|
Update dash, added smartmon
|
2024-02-25 09:05:48 -08:00 |
|
Max Ignatenko
|
b4a0c268d6
|
Bump max_parallel_workers_per_gather to 8
|
2024-02-25 11:35:10 +00:00 |
|
Max Ignatenko
|
fa592c2b34
|
Add a migration to enable compression on already existing tables
|
2024-02-25 11:24:40 +00:00 |
|
Max Ignatenko
|
3432121be2
|
Give postgres a bit more RAM
|
2024-02-25 11:06:47 +00:00 |
|
Max Ignatenko
|
0b6e326762
|
Set an explicit default for Deleted
|
2024-02-25 10:30:49 +00:00 |
|
Max Ignatenko
|
fdace096fb
|
Add fast compression to save a bit on IO bandwidth
|
2024-02-25 10:30:03 +00:00 |
|
mathan
|
b9b3159828
|
Update dashboards
|
2024-02-24 20:01:16 -08:00 |
|
mathan
|
fa87ce6105
|
Update dashboards
|
2024-02-23 18:35:38 -08:00 |
|
mathan
|
a5ad0743ee
|
Update stats dash
|
2024-02-23 14:22:39 -08:00 |
|
mathan
|
d18867f495
|
Update stats dash.
|
2024-02-23 13:37:59 -08:00 |
|
mathan
|
e98c4f4c63
|
Add stats dash. Update indexer dash
|
2024-02-23 12:48:52 -08:00 |
|
mathan
|
bd4e74d36f
|
Update dash
|
2024-02-23 12:33:53 -08:00 |
|
mathan
|
9fb8fc3dce
|
Update dash
|
2024-02-23 11:44:06 -08:00 |
|
mathan
|
69c5c6b7ad
|
Add ignore to override.
|
2024-02-23 09:26:11 -08:00 |
|
Max Ignatenko
|
ddde20a014
|
Fix comparison with NULL when listing PDSs
|
2024-02-23 15:22:22 +00:00 |
|
Max Ignatenko
|
6bb2e5a1de
|
Fix path to sql file
|
2024-02-23 11:28:24 +00:00 |
|
Max Ignatenko
|
13b911615d
|
Add sqldu
|
2024-02-23 11:26:06 +00:00 |
|
Max Ignatenko
|
ea3e11e495
|
Add sqltop
|
2024-02-23 11:19:13 +00:00 |
|
Max Ignatenko
|
0f191b2609
|
Increment exported vars for every language in a post
|
2024-02-23 11:12:39 +00:00 |
|
Max Ignatenko
|
297e9e0347
|
Scripts for benchmarking partitioning
|
2024-02-23 11:10:45 +00:00 |
|
mathan
|
78a17bf238
|
Merge branch 'main' of github.com:uabluerail/indexer
|
2024-02-22 18:56:19 -08:00 |
|
mathan
|
db425b1d5f
|
Fix view in migration. Add by lang metric to consumer.
|
2024-02-22 18:54:29 -08:00 |
|
Max Ignatenko
|
a20ddf0717
|
Fix the fucking regexp
|
2024-02-22 18:16:43 +00:00 |
|
Max Ignatenko
|
a28199fb92
|
Handle the new #identity message
|
2024-02-22 12:17:21 +00:00 |
|
Max Ignatenko
|
8f32c494f7
|
Add whitelist for PDS hosts and update repo PDS pointer on appropriate occasions
|
2024-02-22 12:17:21 +00:00 |