Greetings everyone,
I spent a little bit of time to see if pyrpkg (https://fedorahosted.org/rpkg/) could help with the "building RPMS from a git repo" workflow. Pyrpkg includes methods that can interact with git (cloning, downloading sources etc), koji, and the local mock/rpmbuild build processes among other things. You may know pyrpkg better as the backend for fedpkg in Fedora.
I have a very bare-bones configuration at https://bitbucket.org/bstinsonmhk/centpkg that I thought I would share. Is the community interested in such a tool? If so I'm happy to keep working on it, perhaps with the help of others who are interested?
Cheers! Brian
On 06/14/2014 08:07 AM, Brian Stinson wrote:
Greetings everyone,
I spent a little bit of time to see if pyrpkg (https://fedorahosted.org/rpkg/) could help with the "building RPMS from a git repo" workflow. Pyrpkg includes methods that can interact with git (cloning, downloading sources etc), koji, and the local mock/rpmbuild build processes among other things. You may know pyrpkg better as the backend for fedpkg in Fedora.
this is awesome, i think we've wanted to have something like this based on the rpkg stuff. Thanks for taking it up,
I have a very bare-bones configuration at https://bitbucket.org/bstinsonmhk/centpkg that I thought I would share. Is the community interested in such a tool? If so I'm happy to keep working on it, perhaps with the help of others who are interested?
I'm certainly interested, but stuff is bit flat-out at the moment. so might not be able to participate much at the moment. Mike also has insight into rpkg and might be able to contribute, plus i am sure quite a few people in the commnuity would. Having this work for us, automatically opens up a lot of interesting possibilities.
- KB
On 06/14/2014 02:07 AM, Brian Stinson wrote:
Greetings everyone,
I spent a little bit of time to see if pyrpkg (https://fedorahosted.org/rpkg/) could help with the "building RPMS from a git repo" workflow. Pyrpkg includes methods that can interact with git (cloning, downloading sources etc), koji, and the local mock/rpmbuild build processes among other things. You may know pyrpkg better as the backend for fedpkg in Fedora.
I agree with KB, this is great. We had kicked around the idea of this for something to investigate once 7 was out the door and the frenzy around a new major release had died down a bit. That you've gone and started it already is fantastic.
I have a very bare-bones configuration at https://bitbucket.org/bstinsonmhk/centpkg that I thought I would share. Is the community interested in such a tool? If so I'm happy to keep working on it, perhaps with the help of others who are interested?
I'm certainly very interested in this, as it would help make things simpler and more consistent across the various communities.
We have a number of users who contribute or build for both fedora and centos. Giving them a common tool keeps the complexity down. Good work and please continue!
There are a few variants out there, goosepkg ( https://github.com/gooseproject/goosepkg), which I wrote for doing the same sort of things with koji. I was convinced of doing this by Mathieu Bridon, who wrote nbpkg (https://github.com/network-box/nbpkg) for his former company.
I just thought it might be helpful for bugs and other ideas when dealing with lookaside and git repo issues. One thing I think would be nicer than it currently is would be to rewrite the git portions into libgit2. When rpkg and fedpkg came to be, this ilibrary was not a real option.
Hope this helps.
Cheers,
herlo
On Mon, Jun 16, 2014 at 6:47 AM, Jim Perrin jperrin@centos.org wrote:
On 06/14/2014 02:07 AM, Brian Stinson wrote:
Greetings everyone,
I spent a little bit of time to see if pyrpkg (https://fedorahosted.org/rpkg/) could help with the "building RPMS from a git repo" workflow. Pyrpkg includes methods that can interact with git (cloning, downloading sources etc), koji, and the local mock/rpmbuild build processes among other things. You may know pyrpkg better as the backend for fedpkg in Fedora.
I agree with KB, this is great. We had kicked around the idea of this for something to investigate once 7 was out the door and the frenzy around a new major release had died down a bit. That you've gone and started it already is fantastic.
I have a very bare-bones configuration at https://bitbucket.org/bstinsonmhk/centpkg that I thought I would share. Is the community interested in such a tool? If so I'm happy to keep working on it, perhaps with the help of others who are interested?
I'm certainly very interested in this, as it would help make things simpler and more consistent across the various communities.
We have a number of users who contribute or build for both fedora and centos. Giving them a common tool keeps the complexity down. Good work and please continue!
-- Jim Perrin The CentOS Project | http://www.centos.org twitter: @BitIntegrity | GPG Key: FA09AD77 _______________________________________________ CentOS-devel mailing list CentOS-devel@centos.org http://lists.centos.org/mailman/listinfo/centos-devel
On 06/14/2014 12:37 PM, Brian Stinson wrote:
Greetings everyone,
I spent a little bit of time to see if pyrpkg (https://fedorahosted.org/rpkg/) could help with the "building RPMS from a git repo" workflow. Pyrpkg includes methods that can interact with git (cloning, downloading sources etc), koji, and the local mock/rpmbuild build processes among other things. You may know pyrpkg better as the backend for fedpkg in Fedora.
I have a very bare-bones configuration at https://bitbucket.org/bstinsonmhk/centpkg that I thought I would share. Is the community interested in such a tool? If so I'm happy to keep working on it, perhaps with the help of others who are interested?
Cheers! Brian
This looks interesting. It would be good to have something similar to fedpkg. Specially to SIGs as they are going to use koji. Are we planning something better than fedpkg, as I was thinking why not use same fedpkg after renaming it to centpkg or something similar?
Thanks, -Lala
On 06/17/2014 11:34 AM, Lalatendu Mohanty wrote:
This looks interesting. It would be good to have something similar to fedpkg. Specially to SIGs as they are going to use koji. Are we planning something better than fedpkg, as I was thinking why not use same fedpkg after renaming it to centpkg or something similar?
I believe this is the same codebase ( rpkg originated ) modified to work with the git.centos.org layout
On Tue, Jun 17, 2014, at 4:07, Karanbir Singh wrote:
On 06/17/2014 11:34 AM, Lalatendu Mohanty wrote:
This looks interesting. It would be good to have something similar to fedpkg. Specially to SIGs as they are going to use koji. Are we planning something better than fedpkg, as I was thinking why not use same fedpkg after renaming it to centpkg or something similar?
I believe this is the same codebase ( rpkg originated ) modified to work with the git.centos.org layout
Indeed, rpkg defines quite a few standard commands so the interface will be very similar to fedpkg. Having our own "site" (in rpkg parlance) will also allow us to define our own commands later as the workflow demands.
Thanks everyone for the comments so far! Brian
-- Brian Stinson bstinson@ksu.edu | IRC: bstinson
Awesome! Thanks for doing this.
Technical comments: 1) Not sure if we need all those directory rpmdefines. One of the nice things about the CentOS layout is that you can just --define "_topdir $PWD" and the rest of the dirs just fall into place.
2) I'm not sure about dead.package check in load_spec. We can't formally adopted that indicator, and if we do, we would probably not put the dead.package file in the SPECS dir. Probably either drop the check entirely, or move it out in front of the loop and check for it in the top directory.
3) Splitting in the metadata. I wonder if we shouldn't just use the default whitespace split .split(None, 1) instead of splitting specifically on a single space. It's a little more forgiving if someone tries to manually edit a metadata file. Also removes the need for stripping.
4) NotImplemented. You have a number of overrides that raise NotImplementedError. I think perhaps some of these (the non-koji ones) would "just work" if we did not override them (or maybe I'm being overly optimistic).
On Sat, Jun 14, 2014 at 3:07 AM, Brian Stinson bstinson@ksu.edu wrote:
Greetings everyone,
I spent a little bit of time to see if pyrpkg (https://fedorahosted.org/rpkg/) could help with the "building RPMS from a git repo" workflow. Pyrpkg includes methods that can interact with git (cloning, downloading sources etc), koji, and the local mock/rpmbuild build processes among other things. You may know pyrpkg better as the backend for fedpkg in Fedora.
I have a very bare-bones configuration at https://bitbucket.org/bstinsonmhk/centpkg that I thought I would share. Is the community interested in such a tool? If so I'm happy to keep working on it, perhaps with the help of others who are interested?
Cheers! Brian
-- Brian Stinson bstinson@ksu.edu | IRC: bstinson _______________________________________________ CentOS-devel mailing list CentOS-devel@centos.org http://lists.centos.org/mailman/listinfo/centos-devel
On Tue, Jun 17, 2014 at 02:36:28PM -0400, Mike McLean wrote:
Technical comments: 1) Not sure if we need all those directory rpmdefines. One of the nice things about the CentOS layout is that you can just --define "_topdir $PWD" and the rest of the dirs just fall into place.
- I'm not sure about dead.package check in load_spec. We can't formally
adopted that indicator, and if we do, we would probably not put the dead.package file in the SPECS dir. Probably either drop the check entirely, or move it out in front of the loop and check for it in the top directory.
- Splitting in the metadata. I wonder if we shouldn't just use the default
whitespace split .split(None, 1) instead of splitting specifically on a single space. It's a little more forgiving if someone tries to manually edit a metadata file. Also removes the need for stripping.
Thanks for the insight! My package building experience has all been outside the distribution, so I'm looking forward to learning the "CentOS Core way". I will make these changes tonight
- NotImplemented. You have a number of overrides that raise
NotImplementedError. I think perhaps some of these (the non-koji ones) would "just work" if we did not override them (or maybe I'm being overly optimistic).
I'm sure most of them will probably work. I was using NotImplementedError as a signifier for checking the behavior of each method one-by-one. My thinking was to remove the definitions for the ones we can use from upstream and redefine the ones that need tweaking.
Cheers! Brian
-- Brian Stinson bstinson@ksu.edu | IRC: bstinson
Hi All,
I've done a little bit of work on centpkg and quite a few of the commands that don't require the cbs are unmasked and ready for more extensive testing (most of the default ones provided by rpkg worked fine).
The README is updated: https://bitbucket.org/bstinsonmhk/centpkg/overview
And I've started some notes that resemble a task list: https://bitbucket.org/bstinsonmhk/centpkg/wiki/Home
Brian
-- Brian Stinson bstinson@ksu.edu | IRC: bstinson | Bitbucket/Twitter: bstinsonmhk
On 06/27/2014 10:03 AM, Brian Stinson wrote:
Hi All,
I've done a little bit of work on centpkg and quite a few of the commands that don't require the cbs are unmasked and ready for more extensive testing (most of the default ones provided by rpkg worked fine).
The README is updated: https://bitbucket.org/bstinsonmhk/centpkg/overview
And I've started some notes that resemble a task list: https://bitbucket.org/bstinsonmhk/centpkg/wiki/Home
I'm very much interested in pushing this as the long-term replacement for the current script-based tools. Perhaps we should consider hosting this on git.centos (or within the CentOS github) as well?
On Jun 27 10:09, Jim Perrin wrote:
I'm very much interested in pushing this as the long-term replacement for the current script-based tools. Perhaps we should consider hosting this on git.centos (or within the CentOS github) as well?
+1 for moving this into the project. Bitbucket was easy so I didn't have to bug you guys during the 7 builds. Could we do a sig-like wiki page for this too?
-- Brian Stinson bstinson@ksu.edu | IRC: bstinson | Bitbucket/Twitter: bstinsonmhk
On 06/27/2014 04:16 PM, Brian Stinson wrote:
On Jun 27 10:09, Jim Perrin wrote:
I'm very much interested in pushing this as the long-term replacement for the current script-based tools. Perhaps we should consider hosting this on git.centos (or within the CentOS github) as well?
+1 for moving this into the project. Bitbucket was easy so I didn't have to bug you guys during the 7 builds. Could we do a sig-like wiki page for this too?
+1 from me as well
On 06/27/2014 08:46 PM, Brian Stinson wrote:
On Jun 27 10:09, Jim Perrin wrote:
I'm very much interested in pushing this as the long-term replacement for the current script-based tools. Perhaps we should consider hosting this on git.centos (or within the CentOS github) as well?
+1 for moving this into the project. Bitbucket was easy so I didn't have to bug you guys during the 7 builds. Could we do a sig-like wiki page for this too?
+1, looks good.
-Lala
On 06/27/2014 10:16 AM, Brian Stinson wrote:
On Jun 27 10:09, Jim Perrin wrote:
I'm very much interested in pushing this as the long-term replacement for the current script-based tools. Perhaps we should consider hosting this on git.centos (or within the CentOS github) as well?
+1 for moving this into the project. Bitbucket was easy so I didn't have to bug you guys during the 7 builds. Could we do a sig-like wiki page for this too?
I've clone this and moved it into git.centos.org, so it currently lives right beside centos-git-common. I'd like to make this the new 'upstream' for centpkg if that's okay with you (as the originator of the package).
Please double check that everything is as you expect it to be. -> https://git.centos.org/summary/centpkg.git
I've clone this and moved it into git.centos.org, so it currently lives right beside centos-git-common. I'd like to make this the new 'upstream' for centpkg if that's okay with you (as the originator of the package).
Please double check that everything is as you expect it to be. -> https://git.centos.org/summary/centpkg.git
-- Jim Perrin The CentOS Project | http://www.centos.org twitter: @BitIntegrity | GPG Key: FA09AD77
Looks great! I've decommissioned the bitbucket repository and pointed it at the new home. I should hopefully have a couple more patches later this week which I'll send to the list.
-- Brian Stinson bstinson@ksu.edu | IRC: bstinson | Bitbucket/Twitter: bstinsonmhk
On 07/01/2014 01:45 PM, Brian Stinson wrote:
I've clone this and moved it into git.centos.org, so it currently lives right beside centos-git-common. I'd like to make this the new 'upstream' for centpkg if that's okay with you (as the originator of the package).
Please double check that everything is as you expect it to be. -> https://git.centos.org/summary/centpkg.git
-- Jim Perrin The CentOS Project | http://www.centos.org twitter: @BitIntegrity | GPG Key: FA09AD77
Looks great! I've decommissioned the bitbucket repository and pointed it at the new home. I should hopefully have a couple more patches later this week which I'll send to the list.
Brian,
Thank you very much for doing this, we greatly appreciate it.
-- Johnny Hughes