Tiny Core Linux

General TC => General TC Talk => Topic started by: GNUser on November 08, 2019, 05:56:05 AM

Title: how to sync local mirror to repo.tinycorelinux.net?
Post by: GNUser on November 08, 2019, 05:56:05 AM
I have a local Pure64 mirror that I periodically update with this command:

Code: [Select]
lftp -c "open http://distro.ibiblio.org/tinycorelinux/10.x/x86_64/tcz/; lcd /path/to/local/tcz; mirror --verbose --continue --delete --no-recursion"

But I've noticed that when juanito posts an extension, it becomes immediately available on http://repo.tinycorelinux.net while it takes a day or two to become available on http://distro.ibiblio.org. Therefore, I'd like to sync my local mirror directly to http://repo.tinycorelinux.net if possible.

This command does not work--lftp sees the remote tcz directory as empty for some reason:

Code: [Select]
lftp -c "open http://repo.tinycorelinux.net/10.x/x86_64/tcz/; lcd /path/to/local/tcz; mirror --verbose --continue --delete --no-recursion"

What's wrong with this command? What command should I use to sync my local mirror to http://repo.tinycorelinux.net?

P.S. The command downloads only the files that are new or have changed, so there is no strain on anyone's bandwidth.
Title: Re: how to sync local mirror to repo.tinycorelinux.net?
Post by: Rich on November 08, 2019, 06:15:48 AM
Hi GNUser
Use  rsync.  Here's an example for keeping a current list of  ,dep  files in your current directory:
Code: [Select]
rsync -dtivh --delete repo.tinycorelinux.net::tc/10.x/x86/tcz/*.dep .
Title: Re: how to sync local mirror to repo.tinycorelinux.net?
Post by: GNUser on November 08, 2019, 06:32:56 AM
Hi, Rich. YES! Wow, that's beautiful. This does what I need:
Code: [Select]
rsync -dtivh --delete repo.tinycorelinux.net::tc/10.x/x86/tcz/ /path/to/local/tczGlad I asked. Many thanks!
Title: Re: how to sync local mirror to repo.tinycorelinux.net?
Post by: GNUser on November 08, 2019, 08:05:37 AM
What does ::tc mean here?

I figure the :: indicates rsync daemon is running remotely, but I'm confused as to what the tc is doing there. Is it a username? Or maybe a module?
(Please pardon my ignorance, but I don't know much about rsync daemon--I'm only familiar with "local" and "remote shell" usage.)
Title: Re: how to sync local mirror to repo.tinycorelinux.net?
Post by: Rich on November 08, 2019, 08:21:16 AM
Hi GNUser
I don't remember the specifics of the command. I'm pretty sure I wound asking Google for help composing it.
Title: Re: how to sync local mirror to repo.tinycorelinux.net?
Post by: GNUser on November 08, 2019, 08:23:05 AM
Internet searches are not helping me crack it. Oh, well. I'll dig some more when I can.
If you remember why you put that there, please do tell. Cheers.
Title: Re: how to sync local mirror to repo.tinycorelinux.net?
Post by: GNUser on November 08, 2019, 08:32:58 AM
If I leave tc out, rsync spits out an error saying "the remote path must start with a module name not a /". I guess the rsync daemon running on repo.tinycorelinux.net has a module named tc.
Title: Re: how to sync local mirror to repo.tinycorelinux.net?
Post by: curaga on November 08, 2019, 10:26:54 AM
Yes, it's just the name we gave for the rsync daemon module.
Title: Re: how to sync local mirror to repo.tinycorelinux.net?
Post by: GNUser on November 08, 2019, 10:52:36 AM
Thank you, curaga. Always better to know than to suppose :)
Title: Re: how to sync local mirror to repo.tinycorelinux.net?
Post by: gadget42 on November 06, 2022, 06:14:25 AM
@Rich

which resource should we mirror if we decided to locally host a complete set of tcl for internal consumption?

saw this forum thread but didn't know if it was still the best way:
https://forum.tinycorelinux.net/index.php/topic,23315.0.html
Title: Re: how to sync local mirror to repo.tinycorelinux.net?
Post by: Rich on November 06, 2022, 06:43:23 AM
Hi gadget42
We generally try to discourage cloning entire repositories because
most of what you download you will never use.

The current x86 and x86_64 repos are about 5 and 10 Gigabytes respectively.
I recommend you select one of the large university hosted mirrors and spread
the download over a couple of weeks.
Title: Re: how to sync local mirror to repo.tinycorelinux.net?
Post by: TT on November 07, 2022, 08:48:16 AM
The current x86 repo[] [is] about 5 [] Gigabytes respectively.
It looks like 32-bit TCL may fit with appropriate compression on a single cheap DVD disk with an open session. This way it can be distributed in offline communities and updated. Also as a dream lab for offline experiments and schools. May be it would be possible to consolidate, configure, and upload such a one-shot image somewhere on a file-sharing service? We have Africa, war-torn continental countries, you name it: https://forum.slitaz.org/topic/slitaz-future#post-49385
Title: Re: how to sync local mirror to repo.tinycorelinux.net?
Post by: TT on November 09, 2022, 01:33:06 PM
I've just encountered: https://doc.slitaz.org/en:guides:dvd