What is the story of those "massive" tree files?

[maro]

Every few days I sync my private TCZ repository. To be "nice" to our main repository (i.e. 'ibiblio.org') I'm using a mirror of that repository (e.g. 'rsync.gtlib.gatech.edu') for this purpose. Today I saw to my great surprise that two unexpectedly large files came through:
    71,649,321 winetricks.tcz.tree and
    68,212,728 winetricks-gui.tcz.tree

The files looked to me as a case of a "recursion gone wrong". I then took a brief look onto 'ibiblio.org' (with 'wget -S --spider ...' and found that the former file has since been updated and is now again really small. That now leaves me with just a few thoughts:

• Would it be possible to "fix" 'winetricks-gui.tcz.tree' as well and could we maybe get an explanation what happened here?
• Due to this whole episode I was wondering whether the "official" script that produces the *.tree files could be published somewhere. Maybe that has already been taken care of, but I at least don't recall that I've so far stumbled over it (and I had a possibly silly idea that I wanted to try out).

[Rich]

Just a thought, but it might be a good idea to implement a sanity check in the algorithm. For example, as
the tree is being built or written to the file, keep a running count of the number characters. When the count
exceeds a threshold, terminate the algorithm and flag the file as being suspect. I don't know what that
threshold should be since some of those files are pretty big.  network-manager-kde-tcz-tree  is  93.7K
and there might be others that are larger still.

[AbNoRMiS]

yep, very interesting, i sent the following tree-file

Code: [Select]

winetricks-gui.tcz
   p7zip.tcz
   perl5.tcz
   wine.tcz
      libssl-0.9.8.tcz
      gnutls.tcz
         libgcrypt.tcz
            libgpg-error.tcz
         libtasn1.tcz
         nettle.tcz
            gmp.tcz
         p11-kit.tcz
      mpg123.tcz
         libltdl.tcz
      libxslt.tcz
         libxml2.tcz
      Xorg-7.6-lib.tcz
      libcapi20.tcz
      fontconfig.tcz
         expat2.tcz
      ncurses.tcz
         ncurses-common.tcz
      libgsm.tcz
      libltdl.tcz
      libxml2.tcz
   winetricks.tcz
      p7zip.tcz
      cabextract.tcz
      wget.tcz
         openssl-1.0.0.tcz
      xdg-utils.tcz
      zip-unzip.tcz
   zenity.tcz
      gtk2.tcz
         atk.tcz
            glib2.tcz
               libffi.tcz
            libffi.tcz
         cairo.tcz
            pixman.tcz
            fontconfig.tcz
               expat2.tcz
         pango.tcz
            glib2.tcz
               libffi.tcz
            Xorg-7.6-lib.tcz
            libxcb.tcz
         gdk-pixbuf2.tcz
            glib2.tcz
               libffi.tcz
            graphics-libs-1.tcz
         shared-mime-info.tcz
            glib2.tcz
               libffi.tcz
            libxml2.tcz
      libnotify.tcz
         dbus-glib.tcz
            dbus.tcz
               expat2.tcz
            glib2.tcz
               libffi.tcz
         gtk2.tcz
            atk.tcz
               glib2.tcz
                  libffi.tcz
               libffi.tcz
            cairo.tcz
               pixman.tcz
               fontconfig.tcz
                  expat2.tcz
            pango.tcz
               glib2.tcz
                  libffi.tcz
               Xorg-7.6-lib.tcz
               libxcb.tcz
            gdk-pixbuf2.tcz
               glib2.tcz
                  libffi.tcz
               graphics-libs-1.tcz
            shared-mime-info.tcz
               glib2.tcz
                  libffi.tcz
               libxml2.tcz
i used slightly modified script from here
may be something went wrong on the server
should be inform to gutmensch about this

[Rich]

I've sent gutmensch a PM.

[gutmensch]

Indeed recursion of death. ;-) A wrong dep file for winetricks was uploaded, which initiated this error. Should be all ok now

@AbNoRMiS: You can submit .tree files, but there are generated either way on the server, so practically no need to do so.

[AbNoRMiS]

i just included the tree generating function to the script that builds the packages
so that i myself could see all package dependencies
this script adds tree-file together with package to archive (for submitting)
if add a call submitqc4 audit to this script then zsync-file also will get into the archive
i think nothing bad will happen?