Regression in sce-update regarding debextra-repositories?

[sm8ps]

Hi all!

As you may have noticed, I am re-launching my dCore ventures after half a year of absence. After having upgraded to the actual initrd, I noticed the following strange behavior regarding the Owncloud client software.

I had successfully used their official repo on the OpenSuse servers (cf. http://forum.tinycorelinux.net/index.php/topic,18408.0.html) with a file in 'debextra/' containing, in my case,

Code: [Select]

http://download.opensuse.org/repositories/isv:/ownCloud:/desktop/xUbuntu_14.04
After switching to the current release dCore-trusty:2016.07.31.00.47 of the initrd, ''sce-update'' found a new version and installed it. That resulted in a totally unfunctional extension, meaning it provided no ''owncloud'' command. After that, I did ''sce-import owncloud-client'' which tried to download three packages, namely libowncloudsync0, owncloud-client, owncloud-client-l10n. (I have the extension depend on LXDE so that seemed okay but it is not, see far below.) All but the first were recognized as meta-packages and therefore the extension did not contain anything useful, i.e. no executable at all.

I tried all sorts of things but could not come up with any explanation or solution. There are some more extra repos but they should not provide any conflicting packages. Specifically, there are PPAs for CherryTree (a note-taking app), for Midor browser and the Canonical partner repo. So AFAICT there is no overlap between these repos.

Since it had worked before, I switched back to the initrd release 2015.12.20.21.27. To my surprise, the import worked without a flaw. It imported 28 packages, mostly related to Qt.

So either there is something wrong or I missed some change to the behavior of sce-import. I did read the section about repo precedence in the wiki but that did not explain the behavior as it states: "Extra repositories in /opt/debextra/ take precedence over the standard Debian and Ubuntu repositories when importing software."

I also tried disabling the repo from debextra. This does indeed change the behavior with the new release as it imports the full of the Owncloud client from the regular repos.

Does this make sense to anybody?

Cheers!
sm

[Jason W]

http://download.opensuse.org/repositories/isv:/ownCloud:/desktop/xUbuntu_14.04

The above is a dead link, at least in my trying to access it right now, but the below is not:

http://download.opensuse.org/repositories/isv:/ownCloud:/desktop/Ubuntu_14.04/

Does using the second link work?  And if not, please try with the release candidate of dCore-trusty though there shouldn't be any changes to cause this, there has been a lot of activity in the last month in the RCs.  Thanks.

[sm8ps]

Thanks for double-checking! I did use the correct link on the system, however. It was only for this forum entry that I copied the link from the old thread about the repo.

I just tried it with RC dCore-trusty:2016.08.24.13.02 and got the same faulty behavior (three packages, two of which meta packages).

[Jason W]

I found a bug in the dependency routine involving extra repo packages, should be fixed in the RC I am uploading now.

And below is the syntax of the entry of my repo file in /opt/debextra, as specified by the web page of this repo.  The entries in /opt/debextra files needs to be exactly like what would be in Debian/Ubuntu but for the "deb" that they put in front of the http address:

Code: [Select]

http://download.opensuse.org/repositories/isv:/ownCloud:/community/xUbuntu_14.04/ /


[sm8ps]

I see some change with the new release candidate. It does recognize 28 packages which sounds good but it is not able to pull them in.

Code: [Select]

sm@aa1:~$ sce-import owncloud-client
 
Using nice level 19.
 
Using the -u option.
 
Existing dependency file found.
 
* Fetching updated DEBINX.
* Distro: ubuntu
 
* Syncing Debian Index: ubuntu_trusty_main_i386_Packages
#################### 100.0% 0.0 kBps DONE   

verifying download...checksum matches OK
used 11880448 local, fetched 0
 
* Syncing Debian Security Index: ubuntu_trusty_security_i386_Packages
#################### 100.0% 0.0 kBps DONE   

verifying download...checksum matches OK
used 1261568 local, fetched 0
 
* Using the repo http://ppa.launchpad.net/giuspen/ppa/ubuntu trusty main
* Using the repo http://ppa.launchpad.net/midori/ppa/ubuntu trusty main
* Using the repo http://download.opensuse.org/repositories/isv:/ownCloud:/desktop/Ubuntu_14.04/ trusty /
* Using the repo http://archive.canonical.com/ubuntu trusty partner
* Using the repo http://security.ubuntu.com/ubuntu trusty main
 
Existing list file found.
 
Create owncloud-client.sce from /mnt/sda6/tce/sce/owncloud-client.sce.lst?
 
Press Enter to use this package list or enter (n)o to import a standard
'owncloud-client' package if it exists, Ctrl-C aborts.
 
Warning: Entering (n)o will delete /mnt/sda6/tce/sce/owncloud-client.sce.lst:
 
Using Package Index:
/etc/sysconfig/tcedir/import/debinx/ubuntu_trusty_main_i386_Packages
 
Using Security Index:
/etc/sysconfig/tcedir/import/debinx/ubuntu_trusty_security_i386_Packages
 
Using ubuntu Mirror: http://ch.archive.ubuntu.com/ubuntu
 
Using ubuntu Security Mirror: http://ch.archive.ubuntu.com/ubuntu
 
owncloud-client is made from your own custom package list.

Gathering dependencies.
 
lxde
 
Press Enter to use the existing owncloud-client.sce.dep entries above
for dependencies or enter (n)o to remove or modify dependencies.

 
WARNING: Entering (n)o will delete existing owncloud-client.sce.dep file: 
The SCE(s) below will provide dependencies for owncloud-client.sce.
 
lxde
 
Merging 28 packages (112 - 84 dependency provided):
 
Fetching updated owncloud-client-l10n_1.5.0+dfsg-4ubuntu1_all.deb...
Connecting to download.opensuse.org (195.135.221.134:80)
wget: server returned error: HTTP/1.1 404 Not Found
Failed on download of pool/universe/o/owncloud-client/owncloud-client-l10n_1.5.0+dfsg-4ubuntu1_all.deb.
wget: server returned error: HTTP/1.1 404 Not Found
ar: can't open '/etc/sysconfig/tcedir/import/debs/owncloud-client-l10n_1.5.0+dfsg-4ubuntu1_all.deb': No such file or directory
ar: can't open '/etc/sysconfig/tcedir/import/debs/owncloud-client-l10n_1.5.0+dfsg-4ubuntu1_all.deb': No such file or directory
/usr/bin/debExtract: line 43: can't create /tmp/: Is a directory
 
Failure to extract owncloud-client-l10n_1.5.0+dfsg-4ubuntu1_all.deb, exiting..
There are the following files in the tce-directory

Code: [Select]

sce/owncloud-client.sce.debinx
sce/owncloud-client.sce.dep
sce/owncloud-client.sce.lst
sce/owncloud-client.sce.md5.txt
with the following content (cat'ed)

Code: [Select]

08d5d8de286852c2c94adb37f42f3b68
lxde
owncloud-client
owncloud-client-l10n
fcdca3a5164620986ab5a68a428f8104  owncloud-client.sce
I had corrected the line for the repo as stated. (It had worked without that, though.)

[Jason W]

Does your changed /opt/debextra entry work with your dCore-trusty release from last year, it does not work on the latest RC but the entry I posted does and pulls in 112 packages and the resulting owncloud-client package works, or at least launches.

[Jason W]

Also, I reverted debGetPkgList to it's previous state which is probably the same as in your old dCore-trusty as the newer routine overwrote file locations in the entries in /tmp/work and could potentially cause issue.   So try the latest RC just uploaded, I see a change in failure with your extra repo entry as it now just imports an empty SCE, but it still works and downloads the 112 packages with mine. 

[sm8ps]

Does your changed /opt/debextra entry work with your dCore-trusty release from last year, it does not work on the latest RC but the entry I posted does and pulls in 112 packages and the resulting owncloud-client package works, or at least launches.

To clear out the confusion, I tested all four cases: old release (2015.12.20.21.27) and new release candidate (2016.08.28.21.06; not very newest of today). There is no difference in behavior with the repo line containing a trailing slash or not.

• old release: works fine either way; import 28 packages
• new release candidate: either way discovers 28 packages but wget throws 404 error as stated before

Will try the release candidate of today as mentioned in your second message.

[sm8ps]

Also, I reverted debGetPkgList to it's previous state which is probably the same as in your old dCore-trusty as the newer routine overwrote file locations in the entries in /tmp/work and could potentially cause issue.   So try the latest RC just uploaded, I see a change in failure with your extra repo entry as it now just imports an empty SCE, but it still works and downloads the 112 packages with mine.

Tried the release candidate 2016.08.29.15.27 with the correct repo line (including a trailing slash). This brings me back to the start of the issue, namely that sce-import only wants to import three packages, two of which are meta packages.

Code: [Select]

sm@aa1:~$ cat /opt/debextra/owncloud_client-opensuse
http://download.opensuse.org/repositories/isv:/ownCloud:/desktop/Ubuntu_14.04/ /
sm@aa1:~$ sce-import owncloud-client
 
Using nice level 19.
 
Using the -u option.
 
Existing dependency file found.
 
* Fetching updated DEBINX.
* Distro: ubuntu
 
* Syncing Debian Index: ubuntu_trusty_main_i386_Packages
#################### 100.0% 0.0 kBps DONE   

verifying download...checksum matches OK
used 11880448 local, fetched 0
 
* Syncing Debian Security Index: ubuntu_trusty_security_i386_Packages
#################### 100.0% 0.0 kBps DONE   

verifying download...checksum matches OK
used 1267712 local, fetched 0
 
* Using the repo http://ppa.launchpad.net/giuspen/ppa/ubuntu trusty main
* Using the repo http://ppa.launchpad.net/midori/ppa/ubuntu trusty main
* Using the repo http://download.opensuse.org/repositories/isv:/ownCloud:/desktop/Ubuntu_14.04/ trusty /
* Using the repo http://archive.canonical.com/ubuntu trusty partner
* Using the repo http://security.ubuntu.com/ubuntu trusty main
 
Existing list file found.
 
Create owncloud-client.sce from /mnt/sda6/tce/sce/owncloud-client.sce.lst?
 
Press Enter to use this package list or enter (n)o to import a standard
'owncloud-client' package if it exists, Ctrl-C aborts.
 
Warning: Entering (n)o will delete /mnt/sda6/tce/sce/owncloud-client.sce.lst:
 
Using Package Index:
/etc/sysconfig/tcedir/import/debinx/ubuntu_trusty_main_i386_Packages
 
Using Security Index:
/etc/sysconfig/tcedir/import/debinx/ubuntu_trusty_security_i386_Packages
 
Using ubuntu Mirror: http://ch.archive.ubuntu.com/ubuntu
 
Using ubuntu Security Mirror: http://ch.archive.ubuntu.com/ubuntu
 
owncloud-client is made from your own custom package list.

Gathering dependencies.
 
lxde
 
Press Enter to use the existing owncloud-client.sce.dep entries above
for dependencies or enter (n)o to remove or modify dependencies.
 
WARNING: Entering (n)o will delete existing owncloud-client.sce.dep file:
 
The SCE(s) below will provide dependencies for owncloud-client.sce.
 
lxde
 
Merging 3 packages:
 
1/3 libowncloudsync0 is a Debian/Ubuntu meta package or does not exist.
2/3 owncloud-client-l10n
3/3 owncloud-client is a Debian/Ubuntu meta package or does not exist.
Parallel mksquashfs: Using 2 processors
Creating 4.0 filesystem on /etc/sysconfig/tcedir/sce/owncloud-client.sce, block size 4096.
[===============================================================/] 661/661 100%
Exportable Squashfs 4.0 filesystem, gzip compressed, data block size 4096
compressed data, compressed metadata, compressed fragments, no xattrs
duplicates are removed
Filesystem size 973.55 Kbytes (0.95 Mbytes)
37.96% of uncompressed filesystem size (2564.62 Kbytes)
Inode table size 1901 bytes (1.86 Kbytes)
46.48% of uncompressed inode table size (4090 bytes)
Directory table size 476 bytes (0.46 Kbytes)
47.70% of uncompressed directory table size (998 bytes)
Number of duplicate files found 0
Number of inodes 46
Number of files 38
Number of fragments 2
Number of symbolic links  0
Number of device nodes 0
Number of fifo nodes 0
Number of socket nodes 0
Number of directories 8
Number of ids (unique uids + gids) 1
Number of uids 1
root (0)
Number of gids 1
root (0)
 
Imported owncloud-client.sce.
sm@aa1:~$ version
dCore-trusty:2016.08.29.15.27
I wonder where these meta packages come from as the extra repo does not contain any, AFAICT.

[Jason W]

I have found what it is, a bug in an exit of a function to prevent error upon multiple package entries in the same Packages file.  I will test it a bit and upload later today.

[Jason W]

Uploaded to new RC, please test, should be good now.

[sm8ps]

I have found what it is, a bug in an exit of a function to prevent error upon multiple package entries in the same Packages file.  I will test it a bit and upload later today.

Great! Sounds like quite an effort. Thanks a lot, Jason!
Will not be before the week-end that I get around to testing it. Will get back with results here.

[sm8ps]

Tested and working in my case on dCore-trusty:2016.09.02.21.10. Thanks again!