WelcomeWelcome | FAQFAQ | DownloadsDownloads | WikiWiki

Author Topic: Option to choose backup compression type  (Read 1895 times)

Offline bmarkus

  • Administrator
  • Hero Member
  • *****
  • Posts: 7183
    • My Community Forum
Option to choose backup compression type
« on: September 30, 2009, 02:56:24 PM »
Backup is using gzip compression. Made some test on my live TC with different compressions:

7.4M - standard mydata.tgz using gzip
7.0M - mydata.bz2 using bzip2
5.4M - mydata.xz using XZ

As you can see XZ gives significantly smaller backup than others. XZ in general offers the best compression in most cases. Now it is spreading. There are sites offering download in .xz format, latest GNU tar now supports it, etc.

I would appreciate if compression method would be configurable and XZ would be an option.

For more info on XZ see http://tukaani.org/xz/
Béla
Ham Radio callsign: HA5DI

"Amateur Radio: The First Technology-Based Social Network."

Offline curaga

  • Administrator
  • Hero Member
  • *****
  • Posts: 10957
Re: Option to choose backup compression type
« Reply #1 on: October 02, 2009, 12:10:07 PM »
It also takes considerably more time to compress and decompress than gzip.


Bzip2 could be an option, but I don't see XZ as one, since the utility is not in the base (not in busybox either, AFAIK).
The only barriers that can stop you are the ones you create yourself.

Offline bmarkus

  • Administrator
  • Hero Member
  • *****
  • Posts: 7183
    • My Community Forum
Re: Option to choose backup compression type
« Reply #2 on: October 02, 2009, 08:04:55 PM »
Bzip2 do not give too much benefits therefore out of the game. My idea is to have an option to use xz or anything else when it is installed by the user and not to add it to the base. Saved data is restored after extensions are loaded, so decompression can't be a problem.

Regarding speed, user can decide preferences over spped or size. Also you can tune xz parameters I guess.
Béla
Ham Radio callsign: HA5DI

"Amateur Radio: The First Technology-Based Social Network."

Offline roberts

  • Administrator
  • Hero Member
  • *****
  • Posts: 7361
  • Founder Emeritus
Re: Option to choose backup compression type
« Reply #3 on: October 02, 2009, 08:52:56 PM »
Lets revisit after 2.4 goes final.
10+ Years Contributing to Linux Open Source Projects.

Offline bmarkus

  • Administrator
  • Hero Member
  • *****
  • Posts: 7183
    • My Community Forum
Re: Option to choose backup compression type
« Reply #4 on: October 02, 2009, 08:56:54 PM »
Thanks...
Béla
Ham Radio callsign: HA5DI

"Amateur Radio: The First Technology-Based Social Network."