Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Anybody know of a way to increase the buffer size of pipes? I've experienced cases where piping a really fast program to a slow one caused them both to go slower as the OS pauses first program writing when pipe buffer is full. This seemed to ruin the caching for the first program and caused them both to be slower even though normally pipes are faster as you're not touching disk.


Both mbuffer and pv by default contain fairly large in-memory buffers for pipe data, and accept parameters for particularly large buffers.

http://www.maier-komor.de/mbuffer.html http://www.ivarch.com/programs/pv.shtml


Thanks - hoping that there was a built in solution but a buffer program makes sense




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: