Sidekiq in Practice

Sidekiq in Practice

English | MP4 | AVC 1920×1080 | AAC 44KHz 2ch | 9 Lessons (1h 5m) | 1.07 GB

Are you using Sidekiq to process your background jobs, but struggling with it as your application scales? Sidekiq can scale to 5,000 jobs per second with just a little effort and knowledge: in Sidekiq in Practice, I’ll show you how.

Sidekiq in Practice takes a step-by-step approach towards building a complex, real-world application that runs a massive volume of jobs through Sidekiq.

Contents include:

1. How to understand scaling: how many processes and servers you need, and how to autoscale them efficiently.

2. Idempotency: Increase your scalability by discarding “unique jobs” and instead use basic computer science to make jobs work regardless of the number of times they are enqueued

3. Memory bloat. How to reduce and diagnose memory problems that are causing you to deal with massive server bills.

4. Concurrency settings, thread safety, queue design and structures, database pool sizes, and more.

Here’s what you’ll receive:

An interactive workshop, driven by a command-line experience. (try it now: gem install skp && skp list)

9 hands-on exercises which show you how to put the principles of the course into real practice.

60 minutes of HD video discussing additional topics on scaling Sidekiq.

A 100-page reference of the text content from the workshop, available in multiple formats.

Sidekiq Pro and/or Enterprise are not required. The workshop mostly covers features in Sidekiq OSS.

Table of Contents

Reducing Redis Load
Multi-Server Setups
Amdahl’s Law
Jobs are Cheaper
Load Shedding
Scaling Redis… with SQL
Managing SQL Load
Multi-Threading Inside a Job
Memory Profiling

Homepage