devel

devel@lists.centos.org

11 participants
4618 discussions

[PATCH] Added script to turn a git.centos.org repo into a source rpm, using these tools.
by Pat Riehecky 20 Jun '14

20 Jun '14

From: Pat Riehecky <riehecky(a)fnal.gov> --- into_srpm.sh | 173 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 1 files changed, 173 insertions(+), 0 deletions(-) create mode 100755 into_srpm.sh diff --git a/into_srpm.sh b/into_srpm.sh new file mode 100755 index 0000000..2e254c4 --- /dev/null +++ b/into_srpm.sh @@ -0,0 +1,173 @@ +#!/bin/bash -u +# +# Turn a centos git repo into a .src.rpm file +# +# Might want to drop this in ~/bin/ and chmod u+x it + +# +# License: GPLv3 +# +# Initial Author: Pat Riehecky <riehecky(a)fnal.gov> +# + +##################################################################### +usage() { + echo '' >&2 + echo "$0 [-hq] [-b branch] [-c shasum]" >&2 + echo '' >&2 + echo 'You need to run this from inside a sources git repo' >&2 + echo '' >&2 + echo ' -h: This help message' >&2 + echo ' -q: Suppress warnings' >&2 + echo '' >&2 + echo ' -b: specify a branch to examine' >&2 + echo " defaults to repo's current branch" >&2 + echo " NOTE: your repo will be set to this branch">&2 + echo '' >&2 + echo ' -c: specify a commit id' >&2 + echo " defaults to repo's current commit id" >&2 + echo " NOTE: your repo will be set to this commit">&2 + echo '' >&2 + echo " $0" >&2 + echo " $0 -b c7" >&2 + echo " $0 -b remotes/origin/c7" >&2 + echo " $0 -c 865ae5909b2b5d5fb37971b7ad7960f1fd5a5ffa" >&2 + echo " $0 -b c7 -c 865ae5909b2b5d5fb37971b7ad7960f1fd5a5ffa" >&2 + exit 1 +} + +##################################################################### + +QUIET=0 +COMMITHASH="" +BRANCH="" + +##################################################################### +# setup args in the right order for making getopt evaluation +# nice and easy. You'll need to read the manpages for more info +# utilizing 'while' construct rather than 'for arg' to avoid unnecessary +# shifting of program args +args=$(getopt -o hqb:c: -- "$@") +eval set -- "$args" + +while [[ 0 -eq 0 ]]; do + case $1 in + -- ) + # end of getopt args, shift off the -- and get out of the loop + shift + break + ;; + -q ) + # suppress warnings + QUIET=1 + shift + ;; + -c ) + # Use this commit id + COMMITHASH=$2 + shift + shift + ;; + -b ) + # Check this particular branch + BRANCH=$2 + shift + shift + ;; + -h ) + # get help + usage + ;; + esac +done + +if [[ ! -d .git ]] || [[ ! -d SPECS ]]; then + echo 'You need to run this from inside a sources git repo' + exit 1 +fi + +which return_disttag.sh >/dev/null 2>&1 +if [[ $? -ne 0 ]]; then + echo 'You need return_disttag.sh from centos-git-common in PATH' + exit 1 +fi + +which get_sources.sh >/dev/null 2>&1 +if [[ $? -ne 0 ]]; then + echo 'You need get_sources.sh from centos-git-common in PATH' + exit 1 +fi + +if [[ "x${BRANCH}" != 'x' ]]; then + if [[ $QUIET -eq 1 ]]; then + git fetch >/dev/null + git checkout ${BRANCH} >/dev/null + else + git fetch + git checkout ${BRANCH} + fi +fi + +if [[ "x${COMMITHASH}" != 'x' ]]; then + if [[ $QUIET -eq 1 ]]; then + git fetch >/dev/null + git checkout ${COMMITHASH} >/dev/null + else + git fetch + git checkout ${COMMITHASH} + fi +fi + +if [[ $QUIET -eq 1 ]]; then + get_sources.sh +else + get_sources.sh -q +fi + +if [[ $QUIET -eq 1 ]]; then + rpmbuild --define "%_topdir `pwd`" --define "%dist `return_disttag.sh -q`" -bs --nodeps SPECS/*.spec +else + rpmbuild --define "%_topdir `pwd`" --define "%dist `return_disttag.sh`" -bs --nodeps SPECS/*.spec +fi + + + +exit 1 + +# commit message contains white space, set IFS to \n +IFS=' +' + +if [[ "x${BRANCH}" != 'x' ]]; then + loglist=$(git log ${BRANCH} --pretty="%H|%s" | filter) + if [[ $? -ne 0 ]]; then + exit 1 + fi +else + loglist=$(git log --pretty="%H|%s" | filter) + if [[ $? -ne 0 ]]; then + exit 1 + fi +fi + +# flag for if nothing is found +FOUND=False +for entry in $loglist; do + FOUND=True + + pkg=$(echo ${entry} | cut -d' ' -f2) + # strip .src.rpm if present + nvr="${pkg%.src.rpm}" + if [[ ${WITHCOMMITHASH} -eq 1 ]]; then + shasum=$(echo ${entry} | cut -d'|' -f1) + echo "${shasum}:${nvr}.src.rpm" + else + echo "${nvr}.src.rpm" + fi +done + +if [ "${FOUND}" != "True" ] +then + warn "No SRPMs found" +fi + -- 1.7.1

2 2

RDO on CentOS
by Rich Bowen 20 Jun '14

20 Jun '14

Hi, I work with the RDO project - http://openstack.redhat.com/ - where we're trying to make OpenStack as easy as possible to deploy on CentOS, RHEL, Fedora, et al. Since CentOS is (at least anecdotally) the leading platform that we're seeing used with RDO, we're wondering what we can do to make RDO easier to consume on CentOS, and, more generally, what we can do to make OpenStack easier on CentOS. -- Rich Bowen - rbowen(a)redhat.com OpenStack Community Liaison http://openstack.redhat.com/

8 10

2 golang SRPMS fail to build
by Johnny Hughes 20 Jun '14

20 Jun '14

All, We are also trying to build the extras tree (which contains docker). Part of the build requirements are golang and its helpers. I am having issues getting 2 of the golang SRPMs to build .. can anyone see what I am doing wrong? Repo trying to build is c7-extras here: http://buildlogs.centos.org/c7-extras/ Specifically, trying to build golang* on x86_64 and these 2 keep failing x86_64: http://buildlogs.centos.org/c7-extras/golang-github-syndtr-gocapability/ http://buildlogs.centos.org/c7-extras/golang-github-gorilla-context/ All the other golang things seem to build OK. All the SRPMs are available in git.centos.org rpms: https://git.centos.org/project/rpms How to get SRPMs from git: http://wiki.centos.org/Sources Can anyone get a good x86_64 build of those 2 packages? Thanks, Johnny Hughes

3 3

Live Media issue with language other than English (help/fix wanted)
by Fabian Arrotin 20 Jun '14

20 Jun '14

Hi all, We received a bug report for the Live Media for Seven, and it was confirmed : http://bugs.centos.org/view.php?id=7217 So basically, selecting any other language than English makes anaconda/liveinst unhappy. I'm asking for help to find the root cause/issue/fix/patch, assuming people would be interested in helping to have a 7 release :-) I'm currently working on various things at the same time, but my initial '5 minutes search' leads me to multiple bug reports against anaconda version and liveinst. Consider for example that one : https://bugzilla.redhat.com/show_bug.cgi?format=multiple&id=1009278 It seems that some patches were added to anaconda to have it working correctly in the Fedora 20 Live ISO images. So if someone has enough time to browse/find particular patches included in anaconda to make it happy, feel free to browse the anaconda git (https://git.fedorahosted.org/cgit/anaconda.git/) and tell us what needs to be fixed/patched. Or if the issue is happening at another level (livecd-tools, or kickstart being used) , let us know too ! As a reminder : https://github.com/CentOS/sig-core-livemedia contains the kickstarts being used, and the tools we currently use to produce those live images are there : http://people.centos.org/arrfab/CentOS7/LiveMedia/RPMS/ , while SRPMS are there : http://people.centos.org/arrfab/CentOS7/SRPMS/ Happy hunting ! :-) -- Fabian Arrotin gpg key: 56BEC54E | twitter: @arrfab

2 1

DKMS for C-7?
by Fred Smith 19 Jun '14

19 Jun '14

Just wondering if/when DKMS packages will appear in the -latest tree? thanks! -- ---- Fred Smith -- fredex(a)fcshome.stoneham.ma.us ----------------------------- "And he will be called Wonderful Counselor, Mighty God, Everlasting Father, Prince of Peace. Of the increase of his government there will be no end. He will reign on David's throne and over his kingdom, establishing and upholding it with justice and righteousness from that time on and forever." ------------------------------- Isaiah 9:7 (niv) ------------------------------

2 2

/etc/redhat-release
by Fred Smith 19 Jun '14

19 Jun '14

Hi all! I think it was on this list, in the last week or so I saw some comment about how some apps may grope the contents of /etc/redhat-release when installing themselves, so as to figure how which OS they're running on, and there was some mention of this not being the best of all possible ideas. What I'm not sure of is what would be a better way for an app installer to find out which OS version it's being installed on. Can someone offer me some enlightenment Thanks! -- ---- Fred Smith -- fredex(a)fcshome.stoneham.ma.us ----------------------------- "For the word of God is living and active. Sharper than any double-edged sword, it penetrates even to dividing soul and spirit, joints and marrow; it judges the thoughts and attitudes of the heart." ---------------------------- Hebrews 4:12 (niv) ------------------------------

13 26

[PATCH] Starting talks about licenses for the centos-git-common files
by Pat Riehecky 19 Jun '14

19 Jun '14

From: Pat Riehecky <riehecky(a)fnal.gov> I realized the scripts I've been sending in weren't licensed. So, I've added one to show_possible_srpms.sh. Perhaps we should talk about getting the rest of the tools under an open source license. Pat Riehecky (1): Realized this was missing a license, added show_possible_srpms.sh | 6 ++++++ 1 files changed, 6 insertions(+), 0 deletions(-)

3 5

On rhn tools and subscription manager
by Bryan Kearney 19 Jun '14

19 Jun '14

Coming late to the meeting.. sorry :) Ideally, I would ilke to see subscription-manager and python-rhsm carried in CentOS. There is no need to make it part of @base as it is upstream, but it would be nice to have them there. -- bk

4 6

[PATCH] brand_hunter.py that works with existing directories
by Kay Williams 19 Jun '14

19 Jun '14

The previous brand-hunter.py let you provide package patterns. It would then search SRPM repositories to find SRPMs matching those patterns (using the magic of yum), download and install them, and search content (expanding gzip/bz2 files as it goes) for possible branding issues. This version is a bit more modest. It assumes you have already downloaded content, e.g. using git clone/get_sources.sh. Then you run brand_hunter.py, providing the path to the directory (or directories), and it searches files (still expanding zipped files as before). --- brand_hunter.py | 153 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 1 file changed, 153 insertions(+) create mode 100755 brand_hunter.py diff --git a/brand_hunter.py b/brand_hunter.py new file mode 100755 index 0000000..64bbe9f --- /dev/null +++ b/brand_hunter.py @@ -0,0 +1,153 @@ +#!/usr/bin/python +# +# This program is free software; you can redistribute it and/or modify +# it under the terms of the GNU General Public License as published by +# the Free Software Foundation; either version 2 of the License, or +# (at your option) any later version. +# +# This program is distributed in the hope that it will be useful, +# but WITHOUT ANY WARRANTY; without even the implied warranty of +# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the +# GNU General Public License for more details. +# +# You should have received a copy of the GNU General Public License +# along with this program. If not, see <http://www.gnu.org/licenses/> +# + +""" +brand_hunter + +searches spec and source files for possible Red Hat branding issues +""" + +try: + import magic +except ImportError as e: + raise ImportError("%s: please install the 'python-magic' package" % e) + +import os +import re +import sys +import tarfile + +from optparse import OptionParser + +DEVNULL=open('/dev/null', 'w') + +MIME = magic.open(magic.MAGIC_MIME) +MIME.load() + +RE = re.compile(r'[Rr][Ee][Dd]\s?[Hh][Aa][Tt]', flags=re.M) +RE_EMAIL = re.compile(r'<[^@]+@redhat.com>', flags=re.M) + +TAR_OPEN_MODE = { + 'application/x-bzip2' : 'r:bz2', + 'application/x-gzip' : 'r:gz', + } + + +def main(opts, args): + # validate directory + for topdir in args: + if not ('SPECS' in os.listdir(topdir) and 'SOURCES' in os.listdir(topdir)): + print ("Error: The specified directory does not contain SPECS and " + "SOURCES folders") + sys.exit(1) + + # setup + print "\nprocessing %s" % topdir + issues_file = os.path.join(topdir, 'issues.txt') + + # search files + issues = [] + for dir in ['SPECS', 'SOURCES']: + searchdir = os.path.join(topdir, dir) + for path,_,files in os.walk(searchdir, topdown=False): + for file in files: + fp = os.path.join(path, file) + if opts.verbose: print fp + find_issues(issues, topdir, fp) + + # output results + if issues: + with open(issues_file, 'w') as f: + f.write("\n".join(issues) + '\n') + print "- issues found: see %s" % issues_file + else: + print "- no issues found" + + print "\n" # blank line at end for readability + + +def find_issues(issues, topdir, file): + relpath = file.replace(topdir + '/', '') + + if not os.path.exists(file): + return + + mimetype=MIME.file(file) + + if 'application/x-empty' in mimetype: + return + + elif not 'charset=binary' in mimetype: + with open(file, 'r') as fo: + s = fo.read() + for m in RE.finditer(s): + lineno = s.count('\n',0,m.start()) + line = s.split('\n')[lineno] + + # filter out lines with email only matches + if opts.ignore_email: + email = RE_EMAIL.findall(line) + if email and len(email) == len(RE.findall(line)): + continue + + issues.append('%s:%s:%s' % (relpath, lineno+1, line)) + + elif ('application/x-bzip2' in mimetype or + 'application/x-gzip' in mimetype): + try: + tf = tarfile.open(file, TAR_OPEN_MODE[mimetype.split(';')[0]]) + except tarfile.ReadError: + # we can't decompress the file, so treat it as an unknown binary file + issues.append('%s:binary file' % relpath) + else: + tf.extractall(os.path.dirname(file)) + os.remove(file) + for n in tf.getnames(): + mp = os.path.join(os.path.dirname(file), n) + if not os.path.isdir(mp): + find_issues(issues, topdir, mp) + + else: + issues.append('%s:binary file' % relpath) + +if __name__ == '__main__': + + parser = OptionParser("usage: %prog [options] directory...", + description=( + "Searches SPEC and SOURCE folders in one or more directories for possible " + "Red Hat branding issues." + )) + + parser.add_option('--ignore-email', + dest='ignore_email', + action='store_true', + default=False, + help="ignore text that matches '<email(a)redhat.com>'") + + parser.add_option('--verbose', '-v', + dest='verbose', + action='store_true', + default=False, + help="print the names of files as they are processed") + + opts,args = parser.parse_args(args=sys.argv[1:]) + + if not args: + print "Error: no directory specified" + sys.exit(1) + + main(opts, args) + sys.exit() -- 1.8.3.1

3 2

docker package missing
by 彭勇 19 Jun '14

19 Jun '14

docker is in *rhel-7-server-extras-rpms of *RHEL 7. and it's missing from CentOS 7 -- Peng Yong

9 13

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

devel