WelcomeWelcome | FAQFAQ | DownloadsDownloads | WikiWiki

Author Topic: SquashFS Getting Major Performance Enhancements  (Read 1977 times)

Offline spence91

  • Jr. Member
  • **
  • Posts: 80
SquashFS Getting Major Performance Enhancements
« on: November 20, 2013, 04:51:04 AM »

Lougher is planning to get these SquashFS performance patches merged soon; it might be too late for Linux 3.13 but otherwise would be material for the Linux 3.14 kernel. The improvements to SquashFS in the Linux kernel include enhanced parallel I/O, multi-threaded decompression support using perCPU variables, directly decompressing into the page cache for file data, and other changes -- including the refactoring of the decompressor interface and code.

In the change to enhancing parallel I/O by allowing multiple decompressors, one example test done on the patch shows a system with two CPUs and 4GB of RAM going from taking 99 seconds to decompress four SquashFS file-systems to now taking just nine seconds! The multiple decompressor support for SquashFS right now though is hidden behind its own kernel configuration option (SQUASHFS_MULTI_DECOMPRESSOR).

The patch to directly decompress into the page cache for file data showed single-data decompression going from a 13 MB/s to now decompressing at 67 MB/s.

This is mildly exciting - sounds like it could have the potential to make TCL *even* quicker :-)

Offline curaga

  • Administrator
  • Hero Member
  • *****
  • Posts: 10992
Re: SquashFS Getting Major Performance Enhancements
« Reply #1 on: November 20, 2013, 05:24:03 AM »
Excellent indeed!
The only barriers that can stop you are the ones you create yourself.