Debian Jessie dCore

[Jason W]

Bugfix.

http://tinycorelinux.net/dCore/x86/release_candidates/dCore-jessie/

[netnomad]

hi jason,

very stable cuts, congratulations!

thank you for your work.

[Jason W]

Updated.  Import creates an md5.txt file for created SCE's, and loadsce checks for it's existence and it's md5 if it exists.  This won't break existing SCE directories, it will simply add an md5.txt file for future imported SCE's.

http://tinycorelinux.net/dCore/x86/release_candidates/dCore-jessie/

[netnomad]

hi jason,

this cut produces no error messages,
but nevertheless some packages are not merged, are missing after an import without errors.

my base-package works flawless,

###
000-base-jessie:
console-setup
console-data
bash
mc
ssh
rsync
screen
grep
tar
zip
unzip
gzip
bzip2
xz-utils
p7zip-full
nmap
iptables
fail2ban
redsocks
pdnsd
###

but my based-on-package lacks of icedove and some more packages (the size is 50mb smaller)

###
100-desktop-jessie:
xorg-all
Xprogs
wbar
fluxbox
iceweasel
icedove
evince
jpilot
xvnc4viewer
###

[Jason W]

Ok, I see the issue.  Grep only allows you to search a fixed number of lines and not until the next line like sed or awk.  Both "original awk" in Debian as well as Busybox awk are slow but accurate in searching the Packages file until the next line.  Gnu grep is the fastest tool, but as there are going to be new fields in the Packages file as well as some I see now I have not yet specified to be excluded (there are many) then grep is not going to be reliable for this task.

But sed is reliable and takes about a tenth of a second per dependency to produce it's dependency list.  Awk takes about a second, so sed is still very much a speed improvement but will not result in error if there are new or overlooked fields in the Packages file now or in the future. 

I will work it in to the md5 and dependency functions, may take a few days.

[netnomad]

thank you for your reply

[Jason W]

Grep and sed are not dealing with deleting parentheses and their contents which are often found in extra repos.  Sed works as it should for this function on the command line but for some reason snippets are getting through and are being listed as package names and stopping the dependency gathering routine in mid stream.

But using sed to parse the needed info from the main debinx packages file into it's own file is fast and 100% accurate so far, and then using the awk command on that file is also fast and 100% accurate.  I hope to finish testing tonight and will post the results soon.

[Jason W]

Updated, please test.

Import and load the "sed" package for better performance during import.

http://tinycorelinux.net/dCore/x86/release_candidates/dCore-jessie/

[netnomad]

hi jason,

the last cut produces still a broken package for me
twice i ended up to the same result: around 7mb are missing...

tc@box:~/.TCE/sce/update$ ls -la 000-base-jessie.sce   
-rw-r--r-- 1 root root 90062848 Nov 27 14:56 000-base-jessie.sce
tc@box:~/.TCE/sce$ ls -la 000-base-jessie.sce
-rw-rw-r-- 1 tc staff 97030144 Nov 23 21:45 000-base-jessie.sce

one thing is interesting:
my 000-base-jessie worked fine in the last cuts, i had only problems with my 100-desktop-jessie-package.

thank you for all your efforts.

[Jason W]

Is you 000-base-jessie list the same as before?

I am getting this size when I import that list now. 

me@box:/mnt/sda3/tceimport-jessie/sce$ ls -l 000-base-jessie.sce
-rw-rw-r-- 1 peter staff 50831360 Nov 27 18:50 000-base-jessie.sce
me@box:/mnt/sda3/tceimport-jessie/sce$

[netnomad]

hi jason,

you are right, i didn't changed it:

tc@box:~/.TC/tce/sce$ cat 000-base-jessie.sce.lst
console-setup
console-data
bash
mc
ssh
rsync
screen
grep
tar
zip
unzip
gzip
bzip2
xz-utils
p7zip-full
nmap
iptables
fail2ban
redsocks
pdnsd
tcpdump
gnupg
laptop-mode-tools
pm-utils
man-db
ntfs-3g
lvm2
cryptsetup
firmware-all
wifi
wireless
wpasupplicant
checkmissingdebs
importupdatecheck
libsmartcols1

[Jason W]

Ok, I see the same difference, 97mb versus 90.

This has been a massive set of changes recently as far as code, hopefully in the coming days I will fix what we are seeing lately.

[netnomad]

Ok, I see the same difference, 97mb versus 90.

hi jason,

good news that you can reproduce this error.

keep on hacking, we appreciate your good work

[Jason W]

Updated, reverting to using grep for the md5 and dependency routines, sed no longer used.  Turns out I went around my elbow to get to my ear on that one, though grep itself can't search until next new line, a simple grep trick can. 


http://tinycorelinux.net/dCore/x86/release_candidates/dCore-jessie/

[netnomad]

hi jason,

the last cut looks very promising, stable and flawless for me

thank you for your contributions.