WelcomeWelcome | FAQFAQ | DownloadsDownloads | WikiWiki

Author Topic: Apps downloading is pretty slow  (Read 25823 times)

Offline Sashank999

  • Sr. Member
  • ****
  • Posts: 404
Apps downloading is pretty slow
« on: August 02, 2020, 09:25:02 AM »
Hi !

I usually have to download some tczs from Apps so that I can compile some things. But these downloads are pretty slow. The download speed of mine is 10 Mbps and I think that is too much for a 16mb tcz(icu65-dev for vte-dev). I don't know if it is the repo's limit or my problem. What can I do to increase the network speed for repo downloads ?

The apps actually checks all the dependencies of a package so that the package loads good. But it is freaking slow. When I download a new tcz that has a lot of deps. Can we configure the Apps to maintain 5-6 subprocesses so that it can start loading or checking deps fast ?

Offline curaga

  • Administrator
  • Hero Member
  • *****
  • Posts: 11049
Re: Apps downloading is pretty slow
« Reply #1 on: August 02, 2020, 01:09:40 PM »
Pick a mirror near you.
The only barriers that can stop you are the ones you create yourself.

Offline Rich

  • Administrator
  • Hero Member
  • *****
  • Posts: 11694
Re: Apps downloading is pretty slow
« Reply #2 on: August 02, 2020, 01:12:33 PM »
Hi Sashank999
...  Can we configure the Apps to maintain 5-6 subprocesses so that it can start loading or checking deps fast ?
Dependencies get resolved in a linear fashion, meaning the lowest dependencies get loaded first and the extension you requested
gets loaded last. Even if you could parallelize it, creating the download list is so fast it would make no difference.

That leaves your connection speed. At 10 Mbps that would be approximately 1Mbyte/sec assuming you use all of your bandwidth
for the download. So the fastest you could download a 16Mbyte  .tcz  would be 16 seconds.
If there is other activity on your network, it will take longer.
If your router limits the percentage of bandwidth a connected computer can have, it will take longer.

Offline Sashank999

  • Sr. Member
  • ****
  • Posts: 404
Re: Apps downloading is pretty slow
« Reply #3 on: August 02, 2020, 10:35:18 PM »
@curaga I ran that in Apps browser but it shows the "repo.tinycorelinux.net" as the nearest one.

@Rich Mine is actually a 20 Mbps Connection. But in OOKLA Speed Test it showed 10Mbps which gradually increased to 15 Mbps. Hence I reported it as 10 Mbps. What I wonder is why would it be 1Mbps when my speed 10Mbps ? I have a Home Router capable of supporting upto 500 Mbps. I have checked it and confirmed that there are no restrictions on bandwidth and that my TCL Laptop is the only device connected to it (except the router itself). I want only checking the deps faster.
« Last Edit: August 02, 2020, 10:39:35 PM by Sashank999 »

Offline Rich

  • Administrator
  • Hero Member
  • *****
  • Posts: 11694
Re: Apps downloading is pretty slow
« Reply #4 on: August 02, 2020, 10:56:43 PM »
Hi Sashank999
... What I wonder is why would it be 1Mbps when my speed 10Mbps ? ...
Read it again:
... That leaves your connection speed. At 10 Mbps that would be approximately 1Mbyte/sec ...
You are confusing Mega Bits with Mega Bytes. Network bandwidth is in Mega Bits. That bandwidth includes the data in your
packet, various headers attached to that packet, routing information, and any gap time required between transmitted packets.

A byte has 8 bits but to allow for the overhead mentioned above, I divide Mega Bits by 10 to estimate Mega Bytes.
Extension sizes are given in bytes, not bits.

    [EDIT]: Replaced the word  convert  with  estimate.  Rich
« Last Edit: August 03, 2020, 10:19:50 AM by Rich »

TinyCoreLinux

  • Guest
Re: Apps downloading is pretty slow
« Reply #5 on: August 02, 2020, 11:45:55 PM »
Code: [Select]
tce-load -wil mirrors
tcemirror.sh
« Last Edit: August 02, 2020, 11:48:15 PM by NOOB »

Offline Sashank999

  • Sr. Member
  • ****
  • Posts: 404
Re: Apps downloading is pretty slow
« Reply #6 on: August 03, 2020, 02:41:03 AM »
@Rich Oh. My bad. Looks like I reported something wrong. ISPs here use Mega Bytes. Not Megabits ;D. My reports are all in Mega bytes.

@NOOB Thanks for reminding me.

Offline Rich

  • Administrator
  • Hero Member
  • *****
  • Posts: 11694
Re: Apps downloading is pretty slow
« Reply #7 on: August 03, 2020, 10:50:26 AM »
Hi Sashank999
Although possible, it sounds unlikely. Look at any networking port (on a motherboard, router, network switch, etc.) and you will find
their bandwidth is always given in  Bits Per Second.  You stated:
...  But in OOKLA Speed Test it showed 10Mbps which gradually increased to 15 Mbps. ...
OOKLA defaults to  Mbps  which means  Megabits Per Second.

Offline Sashank999

  • Sr. Member
  • ****
  • Posts: 404
Re: Apps downloading is pretty slow
« Reply #8 on: August 03, 2020, 11:05:10 PM »
Oh. Ok. My bad. But 1MegaByte per second means we should get download in 16 sec. Adding some more time to ping requests, some network adapter problem or DNS Server Traffic, we should get it atleast in 30 Sec. But it took 3 mins.

Now even that "Find Fastest Mirrir" stopped working. I don't know why.

Offline Rich

  • Administrator
  • Hero Member
  • *****
  • Posts: 11694
Re: Apps downloading is pretty slow
« Reply #9 on: August 04, 2020, 08:56:16 AM »
Hi Sashank999
Install  wget.tcz.  Then:
Code: [Select]
mkdir icu
cd icu
wget --debug --output-file=icu.txt http://repo.tinycorelinux.net/11.x/x86_64/tcz/icu65-dev.tcz
Attach the  icu.txt  file to your next post.

Offline Sashank999

  • Sr. Member
  • ****
  • Posts: 404
Re: Apps downloading is pretty slow
« Reply #10 on: August 04, 2020, 09:47:22 AM »
Hey, I replaced icu65-dev with bash in the URL. I can't download the 16MB tcz again. The fastest mirror is now working. It shows the tinycore official repo as fastest.

I think we are deviating away from topic. I want to make Apps verify the deps and download the tcz faster.
« Last Edit: August 04, 2020, 09:54:22 AM by Sashank999 »

Offline Rich

  • Administrator
  • Hero Member
  • *****
  • Posts: 11694
Re: Apps downloading is pretty slow
« Reply #11 on: August 04, 2020, 11:06:33 AM »
Hi Sashank999
... I think we are deviating away from topic. I want to make Apps verify the deps and download the tcz faster.
And I wanted to gather some more information to try to see what's going on. Is there a reason you are running IPv6? I think I remember
reading at one time that just having IPv6 enabled can slow some things down.

Try it again like this:
Code: [Select]
rm bash.tcz
wget --debug --output-file=icu.txt --inet4-only http://repo.tinycorelinux.net/11.x/x86_64/tcz/bash.tcz

According to the file you attached:
Quote
2020-08-04 13:43:59 (61.9 KB/s) - 'bash.tcz' saved [442368/442368]
Your download speed was 0.062 Mega Bytes/sec. I would expect your connection to be at least 10 times faster.

So OOKLA connects at 10Mbps.
And wget connects at 0.62Mbps.

Offline Sashank999

  • Sr. Member
  • ****
  • Posts: 404
Re: Apps downloading is pretty slow
« Reply #12 on: August 06, 2020, 12:35:16 AM »
Here is the file.

Offline Rich

  • Administrator
  • Hero Member
  • *****
  • Posts: 11694
Re: Apps downloading is pretty slow
« Reply #13 on: August 06, 2020, 10:23:14 AM »
Hi Sashank999
Looks faster now:
Quote
2020-08-06 04:34:35 (380 KB/s) - 'bash.tcz' saved [442368/442368]
Your download speed was 0.380 Mega Bytes/sec, about 6.1 times faster than the last time.

So comparing apples to apples:
OOKLA connected at 10Mbps.
This time wget connected at 3.8Mbps.

Run this command:
Code: [Select]
sudo sysctl -w net.ipv6.conf.all.disable_ipv6=1That should disable IPv6.

Then one more speed test please:
Code: [Select]
rm bash.tcz
wget --debug --output-file=icu.txt http://repo.tinycorelinux.net/11.x/x86_64/tcz/bash.tcz

Offline Sashank999

  • Sr. Member
  • ****
  • Posts: 404
Re: Apps downloading is pretty slow
« Reply #14 on: August 07, 2020, 10:14:57 PM »
Run this command:
Code: [Select]
sudo sysctl -w net.ipv6.conf.all.disable_ipv6=1That should disable IPv6.
That says :
Code: [Select]
sysctl: error: 'net.ipv6/conf/all/disable_ipv6' is an unknown key.
Another test attached.