RubyConf 2019 - Parallel Ruby: Managing the Memory Monster by Kevin Miller

Published: 04 December 2019
on channel: Confreaks
2,402
87

Parallel Ruby: Managing the Memory Monster by Kevin Miller

At Flexport, we process a lot of data. One sunny day, we decided to switch from a swarm of single-threaded Ruby processes to a wonderful new threadpool. Threads have way less overhead than processes, after all, so we could run far more. Fast forward a couple of hours and everything is on fire. Let’s talk about what went wrong, why it was the Ruby garbage collector's fault, and we did about it.


#confreaks #rubyconf2019