Commit Graph

51 Commits (0898658acb84dd0de373151d6d4441b150e7272a)

Author SHA1 Message Date
Max Ignatenko 0898658acb Split out list-related records into separate partitions 2024-02-21 10:08:50 +00:00
Max Ignatenko 765b7b792b Set default PDS ID to unknown 2024-02-21 09:39:26 +00:00
Max Ignatenko 67a8ab5aff Downgrade intermediate resolver error to trace 2024-02-21 09:36:09 +00:00
Max Ignatenko b2003530ba Handle repos with unknown PDS 2024-02-21 09:35:25 +00:00
Max Ignatenko fa8b67bcc9 Fix tar output filename 2024-02-21 09:16:19 +00:00
mathan d6dff5a9a0 Fix csv_export and Makefile 2024-02-20 22:08:14 -08:00
mathan 0e01664cfb Added example content jsons.
Updated README.md
2024-02-20 22:00:26 -08:00
mathan 3b77099bec Add daemon csv export to Makefile 2024-02-20 20:43:50 -08:00
mathan fba373f835 Add db-migrations folder.
Add future language metrics to query-exporter.
2024-02-20 15:45:23 -08:00
Max Ignatenko da86ee3a1c JSON indexes for posts 2024-02-20 22:58:29 +00:00
mathan de4017bc83 Add delimiters, fixed likes file name. 2024-02-20 11:07:47 -08:00
Max Ignatenko b7458a18f4 Export the list of repos from indexer 2024-02-20 15:36:52 +00:00
Max Ignatenko d9147940aa Bump connection limit for postgres from 100 to 1000 2024-02-20 15:35:59 +00:00
Max Ignatenko 876b454916 Patch through POSTRES_PASSWORD and export the number of failed repos 2024-02-20 11:02:53 +00:00
mathan b809b8b983 Rename dump.sh 2024-02-19 15:11:09 -08:00
mathan 95c24ff0c5 Add maitenance queries 2024-02-19 11:22:51 -08:00
mathan 4ef6abbfc4 Update readme 2024-02-19 11:20:34 -08:00
Max Ignatenko f5a8be6ebb Script for dumping data into .csv 2024-02-19 19:06:51 +00:00
Max Ignatenko 6b400b1f43 Add a script for breaking up records table into partitions 2024-02-19 19:06:51 +00:00
mathan 8b86f8f929 Merge branch 'main' of github.com:uabluerail/indexer 2024-02-19 10:59:24 -08:00
mathan 4b06e54cdc Update dash 2024-02-19 10:59:23 -08:00
Max Ignatenko a0934c360e fix division by zero 2024-02-19 18:34:31 +00:00
mathan e8ca4e808e Move query-exporter to docker. Update dash. 2024-02-19 10:18:40 -08:00
Max Ignatenko 758c5fe5e6 Add quick&dirty quarantine logic for bad records 2024-02-19 17:06:19 +00:00
mathan 4418d76bb2 Dash update 2024-02-18 16:58:29 -08:00
mathan 4f259dccbf Move panels 2024-02-18 16:40:44 -08:00
mathan 3e34e4ca02 Add s/s graph 2024-02-18 16:39:29 -08:00
mathan a73c638116 Fixed disk space on dash. Avail -> free. 2024-02-18 13:33:57 -08:00
mathan 252501d57a Update dashboard 2024-02-18 13:18:39 -08:00
mathan 655a3ca758 Merge branch 'main' of github.com:uabluerail/indexer 2024-02-18 12:35:54 -08:00
mathan 07f9c5d3e9 Fix readme 2024-02-18 12:33:00 -08:00
Max Ignatenko e92be0a999 make psql 2024-02-18 20:29:14 +00:00
Max Ignatenko 82197c63ff Error out after creating .env 2024-02-18 20:27:17 +00:00
Max Ignatenko 495fbaab6a Add a simple Makefile 2024-02-18 20:23:54 +00:00
mathan c413ab41c2 Add query exporter 2024-02-18 12:00:39 -08:00
mathan 5a24b6eff6 Update docker-compose 2024-02-18 10:35:20 -08:00
mathan 5e87198276 Move prometheus + grafana to metrics. Edit readme 2024-02-18 10:27:51 -08:00
mathan 8ad97d6752 Update readmes 2024-02-18 09:56:00 -08:00
mathan c391db0a42 Update 2024-02-18 09:39:38 -08:00
Max Ignatenko 1d25842b78 Add few more metrics 2024-02-18 17:23:54 +00:00
mathan 334af033b8 Add prometheus + grafana 2024-02-18 07:37:50 -08:00
Max Ignatenko 8b89a1544e Log failed resolve attempts in fallbackResolver 2024-02-18 15:34:14 +00:00
Max Ignatenko 1038ca3bea Add AtRev column to only overwrite records with a newer version 2024-02-17 14:29:45 +00:00
Max Ignatenko 1d3c6edf0a Fix panic on closing already closed channel 2024-02-17 12:26:57 +00:00
Max Ignatenko 04d521f58c Increase request timeout, default 30 seconds are not enough to download some repos 2024-02-16 16:47:36 +00:00
Max Ignatenko 4626b8b9ca Limit the number of retries when failing to index a repo 2024-02-16 15:23:34 +00:00
Max Ignatenko 37ccca4c2f Actually return errors 2024-02-16 08:50:37 +00:00
Max Ignatenko 8313c74482 Remove deleted_at 2024-02-15 20:29:08 +00:00
Max Ignatenko 8561d90caf A bit of query optimization 2024-02-15 18:39:29 +00:00
Max Ignatenko 63a767d890 Import 2024-02-15 16:10:39 +00:00