WelcomeWelcome | FAQFAQ | DownloadsDownloads | WikiWiki

Author Topic: Mirroring the TinyCoreLinux repository  (Read 4180 times)

Offline mat128

  • Newbie
  • *
  • Posts: 6
Mirroring the TinyCoreLinux repository
« on: May 12, 2016, 11:00:33 AM »
Hey guys,

First off, thanks for your excellent work on TinyCoreLinux, it has been very helpful for us.

I was wondering how we could mirror the repository? I could not find any official docs on that topic, other than the mirror list itself on the wiki.

Thank you,
Mathieu

Offline gerald_clark

  • TinyCore Moderator
  • Hero Member
  • *****
  • Posts: 4254
Re: Mirroring the TinyCoreLinux repository
« Reply #1 on: May 12, 2016, 11:33:19 AM »
Mirroring is not encouraged due to bandwidth issues.

Offline curaga

  • Administrator
  • Hero Member
  • *****
  • Posts: 10957
Re: Mirroring the TinyCoreLinux repository
« Reply #2 on: May 12, 2016, 12:06:00 PM »
rsync doesn't use much, just the first full copy does (the entire tree is over 108gb!). So if you want to mirror things, please do the first copy from a mirror near you instead of tinycorelinux.net, then keep it up to date with rsync from the main mirror. Recursive wget works fine for the first copy.

To save your space, you can avoid copying older versions, etc. Look up wget and rsync man pages on how to do that.
The only barriers that can stop you are the ones you create yourself.

Offline andyj

  • Hero Member
  • *****
  • Posts: 1020
Re: Mirroring the TinyCoreLinux repository
« Reply #3 on: May 12, 2016, 03:54:54 PM »
I'd be happy just to mirror the version I'm using, which I hope is less than 108 gigs. Then I could be hitting that instead of ibiblio.net all the time. The other architectures won't do me any good. I didn't know rsync was an option. I wouldn't want to update very often. What would that URL be?

Offline curaga

  • Administrator
  • Hero Member
  • *****
  • Posts: 10957
Re: Mirroring the TinyCoreLinux repository
« Reply #4 on: May 13, 2016, 01:03:27 AM »
This is what I use to sync everything:
Code: [Select]
rsync -av --delete repo.tinycorelinux.net::tc /path/to/dest
The only barriers that can stop you are the ones you create yourself.

Offline mat128

  • Newbie
  • *
  • Posts: 6
Re: Mirroring the TinyCoreLinux repository
« Reply #5 on: May 16, 2016, 05:02:38 AM »
Thanks for your replies, rsync seems to work. Is there a preferred schedule? How often should I sync the repo?

Offline curaga

  • Administrator
  • Hero Member
  • *****
  • Posts: 10957
Re: Mirroring the TinyCoreLinux repository
« Reply #6 on: May 16, 2016, 11:58:25 AM »
The official mirrors sync once a day, if yours is for internal use, you may do it less often, depends what you need.
The only barriers that can stop you are the ones you create yourself.

Offline mat128

  • Newbie
  • *
  • Posts: 6
Re: Mirroring the TinyCoreLinux repository
« Reply #7 on: May 19, 2016, 07:18:03 AM »
Excellent. On the topic of mirrors, is there any plan to offer GPG signatures and/or mirrors over HTTPS to ensure data authenticity? (c.f. https://bugs.launchpad.net/ironic-python-agent/+bug/1581112)

Offline curaga

  • Administrator
  • Hero Member
  • *****
  • Posts: 10957
Re: Mirroring the TinyCoreLinux repository
« Reply #8 on: May 19, 2016, 08:04:19 AM »
No, I'm afraid not. The reason is that neither could be made use of in the default image really, and so they'd be used by a small minority.

Both GPG and SSL support are really big (in space) and slow (execution speed - remember, we support 486). Increasing the base image size by say 50%, and boot time by 5x, they aren't tradeoffs worth it. Checking signatures only at download time would expose you to anyone who has had physical access to your usb stick, etc, and so isn't really a complete solution.

An option I thought about was writing a small public key signing program, and I created one using the ed25519 elliptic curves. The binary was about 75kb IIRC, which would be acceptable in the base image. However, the speed is still prohibitive for low-end computers, and a home-grown solution would be scoffed at by the general public, even if it was using a verified library for the cryptography.
The only barriers that can stop you are the ones you create yourself.