manual fallback mechanism for provides.sh

[caminati]

I understand that provides.sh has to rely on CGI to work, and I don't see an easy alternative to that.

However, what about adding some additional emergency mechanism?
Like making google indexing all tcz.list files on tinycore repositories?

This way one could do a poorman provides.sh using google, submitting a search like, for example

Code: [Select]

"glib.h" site:distro.ibiblio.org/tinycorelinux
I mean, only if this is easily doable: I noticed that google for example indexes the contents of distro.ibiblio.org/tinycorelinux/tce/915resolution.tce.md5.txt, while it doesn't index the contents of other files not ending in ".txt".

So maybe if tcz.list files were renamed to tcz.list.txt, we could have a simple way to add some emergency provides.sh alternative in case ibiblio is down, which happened some minutes ago, triggering this post.
Of course I am not sure it would work, since I don't know how google spiders the web and the mechanics of robots.txt. Just an idea.

[caminati]

So maybe if tcz.list files were renamed to tcz.list.txt, we could have a simple way to add some emergency provides.sh alternative in case ibiblio is down, which happened some minutes ago, triggering this post.

Bump.
"Provides" search is currently not working, probably due to ibiblio issues, and having set up this mechanism would have been a life saver for me now.

[Rich]

Hi caminati
I just tried the provides function, and according to wireshark, the request is being made to the new server, not
ibiblio. The response was  404 Not Found. Once the new server is fully functional, provides will work again.

[caminati]

Once the new server is fully functional, provides will work again.

Thank you! That was not exactly the point, however

[roberts]

When ibiblio was out of space, then there is no space for a duplicate uncompressed additional file, as changing the name would likely cause issues for prior versions.

When the server is down, whether it is ibiblio, dreamhost, or our new server, it is down. That is never planned.

As it appears that many users have download the provides.db to do local searching, therefore I plan to drop the cgi method in favor of having download and local search being the default for v 4.7.2. I having being do such for the arm raspberry pi repo.  The cgi version was always slow and not a participant of the mirrors. So download and local searching should be much faster.
 

[Rich]

Hi caminati
That's true. However, Googling something like:

Code: [Select]

filelist glib.h linuxshould get you the information you need.

[roberts]

Local searching with local provides.db completed for 4.7.2. Currently in Team testing.

[caminati]

Hi caminati
That's true. However, Googling something like:

Code: [Select]

filelist glib.h linuxshould get you the information you need.

Good. Similarly, I use inner-package search on packages.debian.org.

[caminati]

Local searching with local provides.db completed for 4.7.2. Currently in Team testing.

Thanks for the announcement, Robert.