One command update of the sce directory.

[netnomad]

hi jason,

the last cut looks really good.
i successfully imported my base-package twice!

there are only some little issues that are probably easier to solve:

cat: md5sum: No such file or directory
Merging b43-fwcutter:
cat: md5sum: No such file or directory
Merging zd1211-firmware:
cat: md5sum: No such file or directory
Merging prism2-usb-firmware-installer:
cat: md5sum: No such file or directory
Merging libertas-firmware:
cat: md5sum: No such file or directory
Merging intel-microcode-amd64:
cat: md5sum: No such file or directory
Merging intel-microcode:
cat: md5sum: No such file or directory
Merging firmware-realtek:
cat: md5sum: No such file or directory
Merging firmware-ralink:
cat: md5sum: No such file or directory
Merging firmware-qlogic:
cat: md5sum: No such file or directory
Merging firmware-netxen:
cat: md5sum: No such file or directory
Merging firmware-myricom:
cat: md5sum: No such file or directory
Merging firmware-linux-nonfree:
cat: md5sum: No such file or directory
Merging firmware-linux-free:
cat: md5sum: No such file or directory
Merging firmware-libertas:
cat: md5sum: No such file or directory
Merging firmware-iwlwifi:
cat: md5sum: No such file or directory
Merging firmware-ivtv:
cat: md5sum: No such file or directory
Merging firmware-ipw2x00:
cat: md5sum: No such file or directory
Merging firmware-intelwimax:
cat: md5sum: No such file or directory
Merging firmware-brcm80211:
cat: md5sum: No such file or directory
Merging firmware-bnx2x:
cat: md5sum: No such file or directory
Merging firmware-bnx2:
cat: md5sum: No such file or directory
Merging firmware-b43legacy-installer:
cat: md5sum: No such file or directory
Merging firmware-b43-lpphy-installer:
cat: md5sum: No such file or directory
Merging firmware-b43-installer:
cat: md5sum: No such file or directory
Merging firmware-atheros:
cat: md5sum: No such file or directory
Merging bluez-firmware:
cat: md5sum: No such file or directory
...
Merging wireless-tools.
cat: md5sum: No such file or directory
...
Merging man-db.
cat: md5sum: No such file or directory
...
Merging fluxbox
cat: md5sum: No such file or directory
Merging wbar:
cat: md5sum: No such file or directory
Merging fltk-1.1.10:
cat: md5sum: No such file or directory
Merging Xtc:
cat: md5sum: No such file or directory
...

the rest seems to be really promising
thank you for all your efforts!

[Jason W]

Ok, great.  What you are seeing is cosmetic and I will upload the fix sometime today.

[netnomad]

even "updatesce all" works now without problems

[Jason W]

Uploaded what hopefully is the final fix for this set of changes. 

[netnomad]

hi jason,

i can confirm that the packaging with updatesce works flawless

the last cut
http://tinycorelinux.net/5.x/x86/release_candidates/dCore-jessie/dCore-jessie.gz
de6dd77599c7f04477e4eecf2fda1541  dCore-jessie.gz
has new cosmetical error messages like:

...
Fetching updated firmware-all.tar.gz..
md5sum: can't open 'firmware-all.tar.gz': No such file or directory
md5sum: can't open 'firmware-all.tar.gz': No such file or directory
Merging firmware-all:
tar: firmware-all.tar.gz: Cannot open: No such file or directory
tar: Error is not recoverable: exiting now
...
Merging tzdata
ash: 1c34c5663fdaeea6f48f90d18228f398: unknown operand
Merging Tiny Core custom start script for util-linux: util-linux.deb2sce
...
Merging tar
ash: ccee8de1757937762d805539a708a4cd: unknown operand
Merging grep
...
Merging libdb5.3
ash: a69a6dfee236962dc0b94b5199aa11dc: unknown operand
Merging perl-modules
ash: 8b9049162e4b704f4b3f393766eb8d3a: unknown operand
Merging perl
...
Merging libssh2-1
ash: 21da1a3d46929b916271ddcdb818e6b3: unknown operand
Merging libslang2
...
Merging base-files
ash: 07a436e0a80dbdc7e0b71a446677460e: unknown operand
Merging bash
...
Merging sensible-utils
ash: 4dfe7f79e86e92f01f9173875ca8cf64: unknown operand
Merging Tiny Core custom start script for debianutils: debianutils.deb2sce
...

the result is still a good working package


perhaps the cut before had some advantages?

tc@box:~/.MNT/sdb1/live/dcore-current/boot$ md5sum dCore-jessie.gz
1d9b0bc6aa86aa2468c24d3c0caa4c75  dCore-jessie.gz

as you see in my message above there was no process-problem,
only few specific packages caused an error-message:
the firmware-files, wireless-tools, man-db, fluxbox, wbar, fltk, xtc.

i guess that the new cut causes more random process-errors?

at the end the packaging itself works flawless now and that's good

[Jason W]

Ok, I will check it out when I get in tonight.

It has been a bumpy road with this latest set of changes, but the performance increase and updatesce is going to be worth it.

[Onyarian]

Yes, I can confirm that in the last cut (5d94df6684badea0fa8494ce9896f7af  ub-dCore-trusty.gz)

tc@ubt-dC5x-ordjd:~$ updatesce jduLO1t
Existing dep file found and will be used.
Using the -s option.
Using the -n option.
 
ubuntu
#################### 100.0% 11.7 kBps DONE     

verifying download...checksum matches OK
used 11321344 local, fetched 0
Using the repo http://us.archive.ubuntu.com/ubuntu trusty multiverse
Using the repo http://archive.ubuntu.com/ubuntu trusty universe
Using the repo http://archive.canonical.com/ precise partner
Using the repo http://archive.getdeb.net/ubuntu trusty-getdeb apps
Using the repo http://ppa.launchpad.net/webupd8team/y-ppa-manager/ubuntu trusty main
Using the repo http://us.archive.ubuntu.com/ubuntu ubuntu trusty main
 
Creating jduLO1t.sce from package list /mnt/sda1/ubtdc5/sce/jduLO1t.sce.lstchmod: invalid mode: 'tc:staff'
Try 'chmod --help' for more information.
Using Package Index: /etc/sysconfig/tcedir/ubuntu_trusty_main_i386_Packages
Using ubuntu Mirror: http://us.archive.ubuntu.com/ubuntu

jduLO1t is from your own custom package list:

Gathering dependency info..

The below SCE's in your SCE directory will be used as
to provide dependencies for jduLO1t.sce.

jdudesk1t

Determining HD and RAM space needed..
 
0.00 MB of downloads required.
648.52 MB needed for unpacking archives.
246.00 MB of compressed archives will be used.
 
1140.52 MB is a good estimate of /mnt/sda1/ubtdc5 space needed, 13707.20 MB is available.

Merging libreoffice4.1-es-langpack:
Merging ure
Merging uno-libs3
Merging libmhash2
Merging libgmp10
Merging librasqal3
Merging libyajl2
Merging libxslt1.1
Merging libraptor2-0
Merging librdf0
Merging libneon27-gnutls
Merging libmythes-1.2-0
Merging libhyphen0
Merging libhunspell-1.3-0

ash: f6781b7b808b6887c6f8db3818c43ac0: unknown operand
Merging libdb5.1
Merging libsystemd-login0
Merging libapparmor1
Merging Tiny Core custom start script for dbus: dbus.deb2sce
Merging dbus
Merging dbus-x11
Merging psmisc
Merging gconf2
Merging gconf2-common
Merging libgconf-2-4
Merging gconf-service-backend
Merging gconf-service
Merging fonts-opensymbol
Merging libatk-wrapper-java
Merging libatk-wrapper-java-jni
Merging libxtst6
Merging openjdk-7-jre
Merging libnss3-1d
Merging java-common
Merging tzdata-java
Merging libnss3-nssdb

ash: 98d239c9f0e9416a21c415cab791edcf: unknown operand
Merging libnspr4-0d
Merging libnspr4
Merging libnss3
Merging ca-certificates-java
Merging openjdk-7-jre-headless
Merging default-jre-headless
Merging default-jre
Merging libreoffice4.1:
Parallel mksquashfs: Using 2 processors
Creating 4.0 filesystem on /etc/sysconfig/tcedir/sce/update/jduLO1t.sce, block size 4096.
[=========================================================\] 167046/167046 100%
Exportable Squashfs 4.0 filesystem, gzip compressed, data block size 4096
        compressed data, compressed metadata, compressed fragments, no xattrs
        duplicates are removed
Filesystem size 298060.18 Kbytes (291.07 Mbytes)
        45.91% of uncompressed filesystem size (649236.93 Kbytes)
Inode table size 397329 bytes (388.02 Kbytes)
        42.14% of uncompressed inode table size (942839 bytes)
Directory table size 80686 bytes (78.79 Kbytes)
        38.23% of uncompressed directory table size (211042 bytes)
Number of duplicate files found 1388
Number of inodes 9068
Number of files 7916
Number of fragments 1362
Number of symbolic links  129
Number of device nodes 0
Number of fifo nodes 0
Number of socket nodes 0
Number of directories 1023
Number of ids (unique uids + gids) 2
Number of uids 1
        root (0)
Number of gids 2
        root (0)
        staff (50)
Done.
tc@ubt-dC5x-ordjd:~$

[Jason W]

Ok, updated to 5.x/x86/release_candidates with what I hope is the conclusion of the fixes of this latest set of improvements.  All 4 x86 dCore ports updated, I updated the dCore Wheezy iso as I have some confidence in this fix. 

[netnomad]

hi jason,

hopefully you are not offended by my post.

the last cut has remarkable improvements:
all firmware-files, virtual or non-existing files are handled fine,
but some packages still cause this "unknown operand"-error message.

i guess that this happens always wtih the same package, so it's no random mistake:
...
Merging tzdata
ash: 1c34c5663fdaeea6f48f90d18228f398: unknown operand
Merging Tiny Core custom start script for util-linux: util-linux.deb2sce
...
Merging tar
ash: ccee8de1757937762d805539a708a4cd: unknown operand
Merging grep
...
Merging libdb5.3
ash: a69a6dfee236962dc0b94b5199aa11dc: unknown operand
Merging perl-modules
ash: 8b9049162e4b704f4b3f393766eb8d3a: unknown operand
Merging perl
...
Merging libssh2-1
ash: 21da1a3d46929b916271ddcdb818e6b3: unknown operand
Merging libslang2
...
Merging base-files
ash: 07a436e0a80dbdc7e0b71a446677460e: unknown operand
Merging bash
...
Merging sensible-utils
ash: 4dfe7f79e86e92f01f9173875ca8cf64: unknown operand
Merging Tiny Core custom start script for debianutils: debianutils.deb2sce
...

thank you for your patience and all your efforts.

####
i can confirm that always the same packages are affected, i tested it 3 times.
####

[Jason W]

Ok, please list what you are importing as I can't get any of those to issue an error message.

[netnomad]

hi jason.

these are my main 3 lists, especially the first one, 000-base-jessie.sce.lst, causes the error messages i mentioned above.

000-base-jessie.sce.lst:
##############
console-setup
console-data
bash
mc
ssh
rsync
screen
grep
tar
zip
unzip
gzip
bzip2
xz-utils
p7zip-full
nmap
iptables
fail2ban
redsocks
pdnsd
tcpdump
gnupg
laptop-mode-tools
pm-utils
importupdatecheck
man-db
wifi
wpasupplicant
firmware-all
ntfs-3g
lvm2
cryptsetup
libsmartcols1

100-desktop-jessie.sce.lst:
################
xorg-all
Xprogs
wbar
fluxbox
iceweasel
icedove
evince
jpilot
xvnc4viewer

200-multimedia.sce.lst:
##############
alsa-base
alsa-utils
alsamixergui
cdparanoia
vlc
faad
lame
cups
cups-driver-gutenprint
hplip
avahi-daemon
gimp
xsane
minitube
pulseaudio
pavucontrol
gnucash
gthumb
gnome-calculator

[netnomad]

hi jason,

the last cut broke my system.

the importsce does merge many packages under ../import/debs (i guess that wasn't your purpose).
so they are not merged in the path ../import/<package-name>.
the result are small, broken packages that miss some packages of the filelist.
i guess that the files merged under ../import/debs are not included in the merged package.

[Jason W]

Ok, I will check into it tonight when I get in (8pm EST).

[Jason W]

Netnomad, I don't see the untarring of packages under import/debs, but I did find a few bugs dealing with the md5sum function.  Uplolading a new copy, please test, and also please keep a good copy of a working dCore-jessie.gz and your sce's before testing just to be sure.  Thanks. 

[Jason W]

I see one more bug whe dealing with USB tce directory.  Bear with me, I have about 2 hours available each night to deal with this, I want to get it right so allow me a few days to try and test and I will soon upload a good working copy of dCore.