Hi, I've prepared yum-3.2.8-9 backport for Centos 4.x. Packages are in testing repos: http://fs12.vsb.cz/hrb33/el4/hrb/testing/i386/repodata/ http://fs12.vsb.cz/hrb33/el4/hrb/testing/x86_64/repodata/
I'd like to ask for QA tests. There are also test packages hrb-foo and hrb-bar which obsoletes the first one.
For yum install progress see: http://www.hrbac.cz/2009/03/running-yum-328-on-centos-47/
Thanks, David Hrbáč
David Hrbáč wrote:
Hi, I've prepared yum-3.2.8-9 backport for Centos 4.x. Packages are in testing repos: http://fs12.vsb.cz/hrb33/el4/hrb/testing/i386/repodata/ http://fs12.vsb.cz/hrb33/el4/hrb/testing/x86_64/repodata/
I'd like to ask for QA tests. There are also test packages hrb-foo and hrb-bar which obsoletes the first one.
For yum install progress see: http://www.hrbac.cz/2009/03/running-yum-328-on-centos-47/
David,
Shouldn't this go to centos-qa?
Phil
Phil Schaffner wrote:
David,
Shouldn't this go to centos-qa?
no; these are not centos packages! We will not be updating yum on c4 from 2.4.x tree.
David Hrbáč wrote:
Hi, I've prepared yum-3.2.8-9 backport for Centos 4.x. Packages are in testing repos: http://fs12.vsb.cz/hrb33/el4/hrb/testing/i386/repodata/ http://fs12.vsb.cz/hrb33/el4/hrb/testing/x86_64/repodata/
I'd like to ask for QA tests. There are also test packages hrb-foo and hrb-bar which obsoletes the first one.
For yum install progress see: http://www.hrbac.cz/2009/03/running-yum-328-on-centos-47/
Created the following .repo file:
# CentOS-DavidH # [dh-test] name=CentOS-$releasever - David H test packages baseurl=http://fs12.vsb.cz/hrb33/el$releasever/hrb/testing/$basearch gpgcheck=1 gpgkey=http://fs12.vsb.cz/hrb33/RPM-GPG-KEY-hrb.txt #gpgkey=/etc/yum.repos.d/RPM-GPG-KEY-hrb.txt enabled=0 protect=1 priority=1
Installed yum with "yum --enable dh-test install yum" OK, then ...
[root@c4 EL]# yum --enable dh-test install yum-priorities Loading "priorities" plugin Loading "fastestmirror" plugin Loading mirror speeds from cached hostfile * dh-test: fs12.vsb.cz * update: mirror.cs.vt.edu * base: mirror.nyi.net * centosplus: www.gtlib.gatech.edu * addons: mirror.atlanticmetro.net * extras: mirror.nyi.net 178 packages excluded due to repository priority protections Setting up Install Process Parsing package install arguments Resolving Dependencies --> Running transaction check ---> Package yum-priorities.noarch 0:1.1.10-9.el4.hrb.1 set to be updated --> Finished Dependency Resolution
Dependencies Resolved
============================================================================= Package Arch Version Repository Size ============================================================================= Installing: yum-priorities noarch 1.1.10-9.el4.hrb.1 dh-test 9.7 k
Transaction Summary ============================================================================= Install 1 Package(s) Update 0 Package(s) Remove 0 Package(s)
Total download size: 9.7 k Is this ok [y/N]: y Downloading Packages: Traceback (most recent call last): File "/usr/bin/yum", line 29, in ? yummain.main(sys.argv[1:]) File "/usr/share/yum-cli/yummain.py", line 183, in main base.doTransaction() File "/usr/share/yum-cli/cli.py", line 336, in doTransaction problems = self.downloadPkgs(downloadpkgs) File "/usr/lib/python2.3/site-packages/yum/__init__.py", line 909, in downloadPkgs cache=po.repo.http_caching != 'none', File "/usr/lib/python2.3/site-packages/yum/yumRepo.py", line 645, in getPackage basepath = package.basepath File "/usr/lib/python2.3/site-packages/yum/sqlitesack.py", line 118, in __getattr__ (self.pkgId,)) File "/usr/lib/python2.3/site-packages/yum/sqlutils.py", line 148, in executeSQLPyFormat return cursor.execute(q, p) File "/var/tmp/python-sqlite-root//usr/lib/python2.3/site-packages/sqlite/main.py", line 255, in execute _sqlite.DatabaseError: no such column: location_base
[root@c4 EL]# yum --enable dh-test update Loading "priorities" plugin Loading "fastestmirror" plugin Loading mirror speeds from cached hostfile * dh-test: fs12.vsb.cz * update: mirror.cs.vt.edu * base: mirror.myriadnetwork.com * centosplus: www.gtlib.gatech.edu * addons: mirror.atlanticmetro.net * extras: mirror.nyi.net 178 packages excluded due to repository priority protections Setting up Update Process Resolving Dependencies --> Running transaction check ---> Package vnc-server.i386 0:4.0-12.el4.1 set to be updated ---> Package openssl.i686 0:0.9.7a-43.17.el4_7.2 set to be updated ---> Package iptables.i386 0:1.2.11-3.1.RHEL4.el4.hrb set to be updated ---> Package firefox.i386 0:3.0.6-1.el4.centos set to be updated ---> Package pidgin.i386 0:2.5.2-6.el4 set to be updated ---> Package xterm.i386 0:192-8.el4_7.2 set to be updated ---> Package kernel.i686 0:2.6.9-78.0.13.EL set to be installed ---> Package netpbm.i386 0:10.25-2.1.el4.4 set to be updated ---> Package kernel-devel.i686 0:2.6.9-78.0.13.EL set to be installed ---> Package libpurple.i386 0:2.5.2-6.el4 set to be updated ---> Package python-urlgrabber.noarch 0:3.1.0-2.el4.hrb set to be updated --> Processing Dependency: m2crypto >= 0.16-5 for package: python-urlgrabber ---> Package kernel-hugemem-devel.i686 0:2.6.9-78.0.13.EL set to be updated ---> Package ntp.i386 0:4.2.0.a.20040617-8.el4_7.1 set to be updated ---> Package autofs.i386 1:4.1.3-234.el4.1 set to be updated ---> Package nss.i386 0:3.12.2.0-3.el4.centos set to be updated ---> Package ash.i386 0:0.3.8-20.el4_7.1 set to be updated ---> Package bind-utils.i386 20:9.2.4-30.el4_7.1 set to be updated ---> Package gnome-vfs2-smb.i386 0:2.8.2-8.7.el4_7.2 set to be updated ---> Package netpbm-progs.i386 0:10.25-2.1.el4.4 set to be updated ---> Package yum-priorities.noarch 0:1.1.10-9.el4.hrb.1 set to be updated ---> Package nspr.i386 0:4.7.3-1.el4 set to be updated ---> Package openssl-devel.i386 0:0.9.7a-43.17.el4_7.2 set to be updated ---> Package gnome-vfs2.i386 0:2.8.2-8.7.el4_7.2 set to be updated ---> Package gstreamer-plugins.i386 0:0.8.5-1.EL.2 set to be updated ---> Package bind-libs.i386 20:9.2.4-30.el4_7.1 set to be updated ---> Package enscript.i386 0:1.6.1-33.el4_7.1 set to be updated --> Finished Dependency Resolution --> Running transaction check ---> Package vnc-server.i386 0:4.0-12.el4.1 set to be updated ---> Package openssl.i686 0:0.9.7a-43.17.el4_7.2 set to be updated ---> Package iptables.i386 0:1.2.11-3.1.RHEL4.el4.hrb set to be updated ---> Package firefox.i386 0:3.0.6-1.el4.centos set to be updated ---> Package pidgin.i386 0:2.5.2-6.el4 set to be updated ---> Package xterm.i386 0:192-8.el4_7.2 set to be updated ---> Package kernel.i686 0:2.6.9-78.0.13.EL set to be installed ---> Package netpbm.i386 0:10.25-2.1.el4.4 set to be updated ---> Package kernel-devel.i686 0:2.6.9-67.EL set to be erased ---> Package kernel.i686 0:2.6.9-55.0.2.EL set to be erased ---> Package kernel-devel.i686 0:2.6.9-78.0.13.EL set to be installed ---> Package kernel-devel.i686 0:2.6.9-55.0.2.EL set to be erased ---> Package kernel-devel.i686 0:2.6.9-55.EL set to be erased ---> Package libpurple.i386 0:2.5.2-6.el4 set to be updated ---> Package kernel.i686 0:2.6.9-55.EL set to be erased ---> Package python-urlgrabber.noarch 0:3.1.0-2.el4.hrb set to be updated --> Processing Dependency: m2crypto >= 0.16-5 for package: python-urlgrabber ---> Package kernel-hugemem-devel.i686 0:2.6.9-78.0.13.EL set to be updated ---> Package ntp.i386 0:4.2.0.a.20040617-8.el4_7.1 set to be updated ---> Package autofs.i386 1:4.1.3-234.el4.1 set to be updated ---> Package nss.i386 0:3.12.2.0-3.el4.centos set to be updated ---> Package ash.i386 0:0.3.8-20.el4_7.1 set to be updated ---> Package bind-utils.i386 20:9.2.4-30.el4_7.1 set to be updated ---> Package gnome-vfs2-smb.i386 0:2.8.2-8.7.el4_7.2 set to be updated ---> Package netpbm-progs.i386 0:10.25-2.1.el4.4 set to be updated ---> Package kernel.i686 0:2.6.9-67.EL set to be erased ---> Package yum-priorities.noarch 0:1.1.10-9.el4.hrb.1 set to be updated ---> Package nspr.i386 0:4.7.3-1.el4 set to be updated ---> Package openssl-devel.i386 0:0.9.7a-43.17.el4_7.2 set to be updated ---> Package gnome-vfs2.i386 0:2.8.2-8.7.el4_7.2 set to be updated ---> Package gstreamer-plugins.i386 0:0.8.5-1.EL.2 set to be updated ---> Package bind-libs.i386 20:9.2.4-30.el4_7.1 set to be updated ---> Package enscript.i386 0:1.6.1-33.el4_7.1 set to be updated --> Finished Dependency Resolution Error: Missing Dependency: m2crypto >= 0.16-5 is needed by package python-urlgrabber radar0:LA1026AI LA1026AI$
No time to debug further right now - got to run home.
Phil
Phil Schaffner napsal(a):
Created the following .repo file:
Phil, repo files are in stable repository. http://fs12.vsb.cz/hrb33/el4/hrb/stable/i386/hrb-release-0.1-2.el4.hrb.i386.... http://fs12.vsb.cz/hrb33/el4/hrb/stable/x86_64/hrb-release-0.1-2.el4.hrb.x86...
Disable stable repo and enable testing repo within the file /etc/yum.repos.d/hrb.repo.
"/var/tmp/python-sqlite-root//usr/lib/python2.3/site-packages/sqlite/main.py", line 255, in execute _sqlite.DatabaseError: no such column: location_base
These are the things awaiting to be patched.
[root@c4 EL]# yum --enable dh-test update Loading "priorities" plugin
Please to no use update or upgrade on testing repo without package statement. Do not forget - it's testing repository.
Error: Missing Dependency: m2crypto >= 0.16-5 is needed by package python-urlgrabber radar0:LA1026AI LA1026AI$
This should be resolved today, since it turns out, that we do not need urlgrubber >= 3.1.0, Centos 4 python-urlgrabber-2.9.8-2 works pretty fine. Package will be deleted from repo. David Hrbáč
David Hrbáč wrote: ...
ok, what about 'yum update yum' or 'yum upgrade yum'? Does it work for you? Don't forget to tun 'yum clean all' after update.
David,
After a "yum clean all" either update or upgrade yum will update to your latest:
yum-3.2.8-9.el4.hrb.2.1.2
Currently have the following hrb packages installed: python-iniparse-0.2.3-4.el4.hrb yum-fastestmirror-1.1.10-9.el4.hrb.1 yum-metadata-parser-1.1.2-2.el4.hrb yum-3.2.8-9.el4.hrb.2.1.2 yum-priorities-1.1.10-9.el4.hrb.1
This test VM had not been updated since Dec. 11, 2008. Running a "yum update" using your new yum installed new kernel and kernel-devel, removed 3 sets of old kernel packages, and updated 21 other packages without incident.
Running either yum update or upgrade with your testing repo enabled now offers only to update iptables.
Phil
Phil Schaffner napsal(a):
David Hrbáč wrote: David,
After a "yum clean all" either update or upgrade yum will update to your latest:
yum-3.2.8-9.el4.hrb.2.1.2
Currently have the following hrb packages installed: python-iniparse-0.2.3-4.el4.hrb yum-fastestmirror-1.1.10-9.el4.hrb.1 yum-metadata-parser-1.1.2-2.el4.hrb yum-3.2.8-9.el4.hrb.2.1.2 yum-priorities-1.1.10-9.el4.hrb.1
This test VM had not been updated since Dec. 11, 2008. Running a "yum update" using your new yum installed new kernel and kernel-devel, removed 3 sets of old kernel packages, and updated 21 other packages without incident.
Running either yum update or upgrade with your testing repo enabled now offers only to update iptables.
Phil
Phil, thank you for testing it out. I have prepared a new release, yum-3.2.8-9.el4.hrb.2.1.3 which improves catchSqliteException and resolves sqlite location_base error, so there's no need to run 'yum clean all'. Now it upgrades itself and installs/updates then smoothly.
One thing to point out for everyone: do not forget to remove any old plugins in /etc/yum/pluginconf.d/ you have "installed" here by hand. Regards, David
David Hrbáč wrote: ...
thank you for testing it out. I have prepared a new release, yum-3.2.8-9.el4.hrb.2.1.3 which improves catchSqliteException and resolves sqlite location_base error, so there's no need to run 'yum clean all'. Now it upgrades itself and installs/updates then smoothly.
One thing to point out for everyone: do not forget to remove any old plugins in /etc/yum/pluginconf.d/ you have "installed" here by hand.
David,
Updated to your latest yum OK. As an additional test I tried installing all the yum-* packages in your testing repo. Got the following error:
Error: Missing Dependency: yum-updatesd is needed by package yum-refresh-updatesd
Excluded that one and installed the rest, then tried the following: [root@c4 ~]# yum --enable hrb-testing search updatesd Loading "protectbase" plugin Loading "kmod" plugin Loading "changelog" plugin Loading "kernel-module" plugin Loading "aliases" plugin Loading "priorities" plugin Loading "skip-broken" plugin Loading "upgrade-helper" plugin Loading "filter-data" plugin Loading "security" plugin Loading "list-data" plugin Loading "downloadonly" plugin Loading "fastestmirror" plugin Loading "protect-packages" plugin Loading "tsflags" plugin Loading "basearchonly" plugin Loading "merge-conf" plugin Loading "allowdowngrade" plugin Determining fastest mirrors * update: mirror.atlanticmetro.net * extras: mirror.nyi.net * base: centos.aol.com * hrb-testing: fs12.vsb.cz * centosplus: mirror.nyi.net * addons: centos.aol.com * hrb-stable: fs12.vsb.cz update 100% |=========================| 951 B 00:00 primary.xml.gz 100% |=========================| 109 kB 00:00 update : ################################################## 367/367 extras 1.1 kB 00:00 primary.xml.gz 37 kB 00:00 extras : ################################################## 164/164 base 100% |=========================| 1.1 kB 00:00 primary.xml.gz 100% |=========================| 608 kB 00:00 base : ################################################## 1591/1591 centosplus 951 B 00:00 primary.xml.gz 77 kB 00:00 centosplus: ################################################## 250/250 addons 100% |=========================| 951 B 00:00 primary.xml.gz 100% |=========================| 190 B 00:00 hrb-stable 100% |=========================| 951 B 00:00 primary.xml.gz 100% |=========================| 58 kB 00:00 hrb-stable: ################################################## 229/229 30 packages excluded due to repository protections 175 packages excluded due to repository priority protections Traceback (most recent call last): File "/usr/bin/yum", line 29, in ? yummain.main(sys.argv[1:]) File "/usr/share/yum-cli/yummain.py", line 105, in main result, resultmsgs = base.doCommands() File "/usr/share/yum-cli/cli.py", line 293, in doCommands return self.yum_cli_commands[self.basecmd].doCommand(self, self.basecmd, self.extcmds) File "/usr/share/yum-cli/yumcommands.py", line 383, in doCommand return base.search(extcmds) File "/usr/share/yum-cli/cli.py", line 867, in search for (po, matched_value) in matching: File "/usr/lib/python2.3/site-packages/yum/__init__.py", line 1313, in searchGenerator for sack in self.pkgSack.sacks.values(): File "/usr/lib/python2.3/site-packages/yum/__init__.py", line 537, in <lambda> pkgSack = property(fget=lambda self: self._getSacks(), File "/usr/lib/python2.3/site-packages/yum/__init__.py", line 404, in _getSacks self.plugins.run('exclude') File "/usr/lib/python2.3/site-packages/yum/plugins.py", line 169, in run func(conduitcls(self, self.base, conf, **kwargs)) File "/usr/lib/yum-plugins/filter-data.py", line 260, in exclude_hook opts, info = fd_check_func_enter(conduit) File "/usr/lib/yum-plugins/filter-data.py", line 216, in fd_check_func_enter if len(getattr(opts, 'filter_' + vattrs)): AttributeError: Values instance has no attribute 'filter_vendors' [root@c4 ~]#
Phil
David Hrbáč wrote:
Hi, I've prepared yum-3.2.8-9 backport for Centos 4.x. Packages are in testing repos: http://fs12.vsb.cz/hrb33/el4/hrb/testing/i386/repodata/ http://fs12.vsb.cz/hrb33/el4/hrb/testing/x86_64/repodata/
Please keep in mind that yum-3.0.x and 3.2.8 have had quite a few issues, and in our testing within CentOS we found yum 2.4.x to be the best release to use on CentOS-4.
There was a potential move to 2.6.x planned at one point; but dropped due to total and complete lack of interest and demand :)
Karanbir Singh wrote:
Please keep in mind that yum-3.0.x and 3.2.8 have had quite a few issues, and in our testing within CentOS we found yum 2.4.x to be the best release to use on CentOS-4.
Having said that while the main distro yum wont move from 2.4.x - these might make for a good centosplus addition in c4. I'm guessing most of your porting work was to adapt to the older python and the slightly different rpm on c4, How much of that could be pushed back upstream ?
on 3-3-2009 3:41 PM Karanbir Singh spake the following:
Karanbir Singh wrote:
Please keep in mind that yum-3.0.x and 3.2.8 have had quite a few issues, and in our testing within CentOS we found yum 2.4.x to be the best release to use on CentOS-4.
Having said that while the main distro yum wont move from 2.4.x - these might make for a good centosplus addition in c4. I'm guessing most of your porting work was to adapt to the older python and the slightly different rpm on c4, How much of that could be pushed back upstream ?
Will upstream even accept anything like this on EL4 anymore? Isn't it too late in the cycle for feature additions?
Scott Silva wrote:
Will upstream even accept anything like this on EL4 anymore? Isn't it too late in the cycle for feature additions?
there isnt any yum upstream in EL4, its a CentOS thing - and so far down the road and considering yum-3.x is completely different from yum-2.4.x; its going to be hard to get into the main distro - but there is always CentOS Plus...
Karanbir Singh napsal(a):
Having said that while the main distro yum wont move from 2.4.x - these might make for a good centosplus addition in c4. I'm guessing most of your porting work was to adapt to the older python and the slightly different rpm on c4, How much of that could be pushed back upstream ?
Well, this is something that is definitely not meant to be included in the main tree. Even if we polish yum-3.2.8 to run on C4 we are not able to prepare smooth yum update process. Problem is with older plugins from yum-utils, we have problem with sqlite: Traceback (most recent call last): File "/usr/bin/yum", line 29, in ? yummain.main(sys.argv[1:]) File "/usr/share/yum-cli/yummain.py", line 183, in main base.doTransaction() File "/usr/share/yum-cli/cli.py", line 336, in doTransaction problems = self.downloadPkgs(downloadpkgs) File "/usr/lib/python2.3/site-packages/yum/__init__.py", line 909, in downloadPkgs cache=po.repo.http_caching != 'none', File "/usr/lib/python2.3/site-packages/yum/yumRepo.py", line 645, in getPackage basepath = package.basepath File "/usr/lib/python2.3/site-packages/yum/sqlitesack.py", line 118, in __getattr__ (self.pkgId,)) File "/usr/lib/python2.3/site-packages/yum/sqlutils.py", line 148, in executeSQLPyFormat return cursor.execute(q, p) File "/var/tmp/python-sqlite-root//usr/lib/python2.3/site-packages/sqlite/main.py", line 255, in execute _sqlite.DatabaseError: no such column: location_base
This is running yum first time after update. 'yum clean all' resolves.
Etc. To sum it up, yes I guess we'll work the issues out and can think about including into CentOS Plus, maybe, but I do not see what to push upstream. What upstream do you mean? Yum or RH? I guess both of them don’t bother yum running on RHEL 4. :o)
I was too surprised how easy it was for me to run 3.2.8 that I had to publish. I'm not pushing on including, I just thought it might be interesting to share.
I'd like to move further and take look at yum-updatesd and dbus communication to work on C4. I like the idea of having better (faster) yum on C4 and also enable dbus events on available updates, having C4/5 running the very same peace of sw. Finally we can use it for central updates managing. Cacti plugin, etc. Regards, David Hrbáč
Set reply-to to yum-devel list.
On Tue, 2009-03-03 at 23:25 +0100, David Hrbáč wrote:
Hi, I've prepared yum-3.2.8-9 backport for Centos 4.x. Packages are in testing repos: http://fs12.vsb.cz/hrb33/el4/hrb/testing/i386/repodata/ http://fs12.vsb.cz/hrb33/el4/hrb/testing/x86_64/repodata/
I'd like to ask for QA tests. There are also test packages hrb-foo and hrb-bar which obsoletes the first one.
For yum install progress see: http://www.hrbac.cz/2009/03/running-yum-328-on-centos-47/
Ok, so a couple of things:
1. Props. for trying this :)
2. Just commenting out @catchSqliteException is obviously fine for a first attempt, but needs a better fix before you give it to random people IMO.
3. This is a lot smaller than I expected, even for a beta, although there are some more things in the latest 3.2.x series that would need to change ... this certainly implies that it might not be as hard as we'd assumed to get the latest onto RHEL-4.
4. Did you run "make check", or just use it until you hit a failure? -- just wondering how much extra stuff might be lurking.
James Antill napsal(a):
Props. for trying this :)
Just commenting out @catchSqliteException is obviously fine for a
first attempt, but needs a better fix before you give it to random people IMO.
James, this is really first attempt. I was too surprised, I had to publish for others to test. I have to find better solution for sqlite exceptions handling then comment it out, it's clear. But for the first attempt it's enough. Do not forget, that @catchSqliteException is upstream backport to 3.8.2 from newer version.
- This is a lot smaller than I expected, even for a beta, although
there are some more things in the latest 3.2.x series that would need to change ... this certainly implies that it might not be as hard as we'd assumed to get the latest onto RHEL-4.
This is TOO small :o), surprisingly small. Still remains dbus, sqllie exceptions.
- Did you run "make check", or just use it until you hit a failure? --
just wondering how much extra stuff might be lurking.
I had to build python-nose for C4 and event that it ain't enough. Some tests are meant for python > 2.3. DH