gearheads
/
mastodon
Archived
2
0
Fork 0
Code Releases 4 Activity
7,484 Commits
2 Branches
11 Tags
201 MiB
Commit Graph

3 Commits (d04c584159fdad36d7713718c4ba0b3b42cd27a9)

Author SHA1 Message Date
unarist 5c8ca024ef Improve error handling on LinkCrawlWorker (#5250) 
* Improve error handling on LinkCrawlWorker

* Ignore TimeoutError and InvalidURIError too
* Record errors to debug log
* Enable dead job queue on LinkCrawlWorker

Since most of acceptable errors were already ignored, only our side issue should go to dead job queue.

* Ignore all http gem errors
 2017-10-06 20:39:08 +02:00
Eugen Rochko f722bd2387 Separate background jobs into different queues. ATTENTION: new queue "pull" 
must be added to the Sidekiq invokation in your systemd file

The pull queue will handle link crawling, thread resolving, and OStatus
processing. Such tasks are more likely to hang for a longer time (due to
network requests) so it is more sensible to not make the "in-house" tasks
wait for them.
 2017-04-04 00:53:20 +02:00
Eugen Rochko f0de621e76 Fix #463 - Fetch and display previews of URLs using OpenGraph tags 2017-01-20 01:00:14 +01:00