Announcements

[Jason W]

If no bug reports in the next day or so, I will make a new release as the previous contains bugs that have been corrected by this release candidate.

[netnomad]

hi jason,

in the last days i had no error messages and nothing noticable that went wrong,
despite
updatesce -c -a
replied that no updates are requested!!!

###
tc@box:~$ updatesce -c -a
debian
#################### 100.0% 0.0 kBps DONE   
verifying download...checksum matches OK
used 10719232 local, fetched 0
Using the repo http://ftp.us.debian.org/debian debian jessie main
 Searching for availbe updates for chosen SCEs.
000-base-jessie
100-desktop-jessie
200-multimedia-jessie
libreoffice
original-modules-3.8.13-tinycore
vbox
No updates available for chosen SCEs.
###


but updatesce wants to load updated packages:

###
tc@box:~/.TCE/sce$ importsce -s 000-base-jessie     
Using the -s option.
Using the -u option.
debian
#################### 100.0% 3.4 kBps DONE   
verifying download...checksum matches OK
used 10719232 local, fetched 0
Using the repo http://ftp.us.debian.org/debian debian jessie main
Do you want to create 000-base-jessie.sce from package list /mnt/sdb2/tce/sce/000-base-jessie.sce.lst? (y/N): y
Using Package Index: /etc/sysconfig/tcedir/debian_jessie_main_i386_Packages
Using debian Mirror: http://ftp.us.debian.org/debian
000-base-jessie is from your own custom package list:
Gathering dependency info..
Determining HD and RAM space needed..
3.92 MB of downloads required.
222.38 MB needed for unpacking archives.
71.75 MB of compressed archives will be used.
369.79 MB is a good estimate of /mnt/sdb2/tce space needed, 2779.13 MB is available.
###

the same with two further packages:
###
tc@box:~/.TCE/sce$ importsce -s 100-desktop-jessie
...
The below SCE's in your SCE directory will be used as
to provide dependencies for 100-desktop-jessie.sce.
000-base-jessie
Determining HD and RAM space needed..
0.14 MB of downloads required.
459.52 MB needed for unpacking archives.
168.64 MB of compressed archives will be used.
796.95 MB is a good estimate of /mnt/sdb2/tce space needed, 2779.13 MB is available.
###

###
tc@box:~/.TCE/sce$ importsce -s 200-multimedia-jessie
...
The below SCE's in your SCE directory will be used as
to provide dependencies for 200-multimedia-jessie.sce.
000-base-jessie
100-desktop-jessie
Determining HD and RAM space needed..
7.69 MB of downloads required.
690.95 MB needed for unpacking archives.
181.19 MB of compressed archives will be used.
1061.02 MB is a good estimate of /mnt/sdb2/tce space needed, 2779.13 MB is available.
###

[Jason W]

Are you saying that running updatesce causes those packages to be imported, or when you run importsce those packages then want to be loaded?

importsce will re-import the package every time you run the command "importsce packagename".

[netnomad]

hi jason,

updatesce told me that there are no updates for my meta-packages,
but importsce wants to download additional, probably updates for my packages.

after performing a new importsce for all my packages,
the result are smaller sce-packages in comparison to my recent packages and are broken

yes, you are right that importsce re-imports the packages every time i run the command "importsce packagename", but all already downloaded, current packages that need no update are used for the merging process.
updatesce doesn't download new packages.
importsce needs to download new packages from the debian repository.

i'm lucky that i have working backups of my meta-packages, so there is no hurry

thank you for your help.

[Jason W]

Ok, I see. 

Which Debian packages, or data.tar.gz files, or startup scripts is it re-downloading?  Knowing that will help pinpoint the issue.

[Jason W]

I re-imported my main desktop file, nothing new was downloaded and all worked as expected on reboot.

I will be heading out of town in a couple hours, likely I won't be peeking back in til Wed, so if you post some more info maybe I can fix it today.

Thanks

[netnomad]

these packages were freshly downloaded:

tc@box:~/tmp/updated_pkgs$ ls -la
total 12076
drwxr-xr-x  2 tc   staff     460 Jan 11 18:05 ./
drwxrwxrwt 11 root staff     760 Jan 11 18:06 ../
-rw-rw-r--  1 tc   staff   71378 Jan 11 16:35 bind9-host_9.9.5.dfsg-8_i386.deb
-rw-rw-r--  1 tc   staff 2940614 Jan 11 11:55 dpkg_1.17.23_i386.deb
-rw-rw-r--  1 tc   staff 4850612 Jan 11 16:45 libavcodec56_11.1-1_i386.deb
-rw-rw-r--  1 tc   staff 1104252 Jan 11 16:44 libavformat56_11.1-1_i386.deb
-rw-rw-r--  1 tc   staff  118188 Jan 11 16:45 libavresample2_11.1-1_i386.deb
-rw-rw-r--  1 tc   staff  182420 Jan 11 16:45 libavutil54_11.1-1_i386.deb
-rw-rw-r--  1 tc   staff   44514 Jan 11 16:35 libbind9-90_9.9.5.dfsg-8_i386.deb
-rw-rw-r--  1 tc   staff   86890 Jan 11 12:01 libbluetooth3_5.23-2+b1_i386.deb
-rw-rw-r--  1 tc   staff  732256 Jan 11 16:35 libdns100_9.9.5.dfsg-8_i386.deb
-rw-rw-r--  1 tc   staff  160418 Jan 11 11:54 libevent-2.0-5_2.0.21-stable-2_i386.deb
-rw-rw-r--  1 tc   staff  176264 Jan 11 16:35 libisc95_9.9.5.dfsg-8_i386.deb
-rw-rw-r--  1 tc   staff   36644 Jan 11 16:35 libisccc90_9.9.5.dfsg-8_i386.deb
-rw-rw-r--  1 tc   staff   56458 Jan 11 16:35 libisccfg90_9.9.5.dfsg-8_i386.deb
-rw-rw-r--  1 tc   staff   53934 Jan 11 16:34 liblwres90_9.9.5.dfsg-8_i386.deb
-rw-rw-r--  1 tc   staff   58674 Jan 11 12:04 liblzo2-2_2.08-1.2_i386.deb
-rw-rw-r--  1 tc   staff  196648 Jan 11 16:42 libswscale3_11.1-1_i386.deb
-rw-rw-r--  1 tc   staff   50890 Jan 11 16:36 libwebpdemux1_0.4.1-1.2+b2_i386.deb
-rw-rw-r--  1 tc   staff   58202 Jan 11 16:36 libwebpmux1_0.4.1-1.2+b2_i386.deb
-rw-rw-r--  1 tc   staff 1007854 Jan 11 11:53 man-db_2.7.0.2-5_i386.deb
-rw-rw-r--  1 tc   staff  307042 Jan 11 16:36 python-pil_2.6.1-1+b1_i386.deb
-rw-rw-r--  1 tc   staff   26250 Jan 11 16:35 python-reportlab-accel_3.1.8-3_i386.deb

[Jason W]

One thing I noticed is that importsce will create smaller SCEs now than it did before as noted that it now correctly processes the "this package OR that package OR that package, etc" where before all those packages were imported rather than the first one.

How is your system broken?  I noticed that Xprogs had to be imported and loaded or my install was broken upon startx.  But Xprogs was not listed in the file list I re-imported as I lost the old one.

And is anyone else seeing this issue?

[netnomad]

hi jason,

this is a good hint, cause only xorg seems to be broken and perhaps not the whole system.
unfortunately i use already Xprogs in my 100-desktop-jessie-file

my main problem is that startx doesn't work anymore.
in this thread you can find my actual file-lists.

do you have another idea?

[netnomad]

hi jason,

if i re-importsce only 000-base-jessie, startx doesn' t work anymore.
Xporgs is in my untouched second file 100-desktop-jessie.

you can find my file-list in this thread.

[Jason W]

Ok, I imported a system based on your 200-multimedia-jessie which depends on 100-desktop-jessiej which depends on 000-base jessie.  All works like a charm.

I just now see you mean you did not re-import the 100* and 200* SCEs but only the 000-base-jessie.  I am not surprised it that 100* and 200* SCEs that depend on 000* do not work..  As mentioned, there are changes in the dependency routine which result in smaller number of packages being brought in to each SCE.  Though the extra Debian packages originally imported are unneeded by that 000-base-jessie SCE, that results in a dependency being satisfied in an SCE that depends on 000-base-jessie that is no longer there upon a nre-import of 000-base-jessie, and when you re-import 000-base-jessie, those deps are no longer there as not needed by 000-base-jessie but then the 100-desktop-jessie is broken by their absence.

Please re-import in this order and then report back:  000-base-jessie, 100-desktop-jessie, 200-multimedia-jessie.   This change in dependency resolution means that to be accurate, each SCE needs to be re-imported on it's own and then later we can test the update function.  Starting with the SCEs that depend on no other, and then the ones that depend on existing SCEs.

I don't plan on another intrusion in our SCE directory again especially as it affects the release cuts, if so, we just revert to Robert's awk routine once and forever which is slower on the main Packages list but works every time.  But I believe this one is working. 

[netnomad]

hi jason,

now it worked fine.

so, do i understand it right that not all packages should be re-imported in one line...
so at first 000-base-jessie needs to be re-imported,
then the system needs a reboot for the reloading of the 000-base-package,
then the second 100-desktop-jessie can be re-imported based on the freshly loaded 000-base-package,
then after a further reboot 200-multimedie-jessie gets the right updated dependencies for its re-import!?

so in this way i succeeded :-)

thank you for your help.

[Jason W]

Great.  I now reread my last post and it appears way more harsh than I meant it, I guess I was banging my head on the keyboard by then trying to find the problem and solution. 

Thanks for the instructions on how you corrected your SCE directory, I will mention in the release thread to refer to here on how to update existing SCE collections.

Also, I will try to make a script that will give a visual tree of dep file contents to make it easier.

[Jason W]

On second thought, if anyone is having issue on updating their existing SCE directory, please post here and we will work through specifices rather than me spending the time with a script to tell the order of SCEs to update in a given SCE directory. 

[netnomad]

hi jason,

actually everything seems to work flawless, but i'm not sure whether updatesce really notices all needed updates.

tc@box:~$ updatesce -c -a
000-base-jessie
100-desktop-jessie
200-multimedia-jessie
libreoffice
original-modules-3.8.13-tinycore
vbox
No updates available for chosen SCEs.


but importsce wants to download some files:

tc@box:~/.TCE/sce$ importsce -s -d -l 100-desktop-jessie
Using the -d option.
Using the -s option.
Using the -u option.
debian
#################### 100.0% 0.0 kBps DONE   
verifying download...checksum matches OK
used 10708992 local, fetched 0
Using the repo http://ftp.us.debian.org/debian debian jessie main
Do you want to create 100-desktop-jessie.sce from package list /mnt/sdb2/tce/sce/100-desktop-jessie? (y/N): y
Using Package Index: /etc/sysconfig/tcedir/debian_jessie_main_i386_Packages
Using debian Mirror: http://ftp.us.debian.org/debian
100-desktop-jessie is from your own custom package list:
Gathering dependency info..
The below SCE's in your SCE directory will be used as
to provide dependencies for 100-desktop-jessie.sce.
000-base-jessie
Determining HD and RAM space needed..
0.15 MB of downloads required.
460.75 MB needed for unpacking archives.
169.17 MB of compressed archives will be used.
799.23 MB is a good estimate of /mnt/sdb2/tce space needed, 2763.80 MB is available.


additionaly i don't understand that updatesce -c -a checks huge packages in less then a small part of a second...
000*, 100* and 200* are checked so fast, after libre office it takes some time to check original-modules-3.8.13-tinycore and vbox. this odd behavior let me doubt whether the big packages are really checked.

by the way do we need the md5.txt-files... i delete them to speed up the boot process?!
do you need that md5-files for your updatesce-routine?

thank you for your help.