Hello,
Please let me introduce myself. I am Beth Lynn Eicher with the FAS username of bethlynn. My background is a career in engineering systems deployments in research computing. I have worked at the Carnegie Mellon University, the Department of Energy, and the University of Chicago. Currently, I am a High Performance Computing consultant with clients like Pittsburgh Supercomputing Center and the University of Wyoming. There, I worked with Bridges, an XSEDE participating site.
Bridges uses CentOS 7 as do many other large installations. If you look at the top500, CentOS is the most popular named distribution. I hypothesize that CentOS is in the majority of the overall market share. It is a solid choice for all HPC systems.
The tools for use with HPC are often built by our greater community but seldom packaged by EPEL. I am unware of rpm builds for the following Free Software projects: https://github.com/OSC/Open-OnDemand https://www.psc.edu/hpn-ssh https://portal.tacc.utexas.edu/tutorials/multifactor-authentication https://github.com/TACC/Lmod
As an industry contributor from a small company, I am unencumbered by institutional politics which may cause reluctance to collaboration. Therefore, I believe that I would be a very useful contributor to a HPC SIG within the CentOS community.
Yesterday, I spoke about cybersecurity in HPC at the CentOS Dojo. There we had a significant amount of energy around HPC and I would like to see this conversation continue. Today, I sought out the HPC SIG of CentOS. While there is evidence of activity, I have not seen anything more recent than Fall of 2017. Where is everybody?
Thanks,
Beth Lynn Eicher Arcutek | Solutions Consultant beicher@arcutek.commailto:beicher@arcutek.com W: 312-767-2894 M: 312-566-8947
The information transmitted is intended only for the person or entity to which it is addressed and may contain proprietary, business-confidential and/or privileged material. If you are not the intended recipient of this message you are hereby notified that any use, review, retransmission, dissemination, distribution, reproduction or any action taken in reliance upon this message is prohibited. If you received this in error, please contact the sender and delete the material from any computer.
On Fri, Aug 17, 2018 at 04:16:22PM +0000, Beth Lynn Eicher wrote:
Please let me introduce myself. I am Beth Lynn Eicher with the FAS username of bethlynn. My background is a career in engineering systems deployments in research computing. I have worked at the Carnegie Mellon University, the Department of Energy, and the University of Chicago. Currently, I am a High Performance Computing consultant with clients like Pittsburgh Supercomputing Center and the University of Wyoming. There, I worked with Bridges, an XSEDE participating site.
Bridges uses CentOS 7 as do many other large installations. If you look at the top500, CentOS is the most popular named distribution. I hypothesize that CentOS is in the majority of the overall market share. It is a solid choice for all HPC systems.
The tools for use with HPC are often built by our greater community but seldom packaged by EPEL. I am unware of rpm builds for the following Free Software projects: https://github.com/OSC/Open-OnDemand https://www.psc.edu/hpn-ssh https://portal.tacc.utexas.edu/tutorials/multifactor-authentication https://github.com/TACC/Lmod
As an industry contributor from a small company, I am unencumbered by institutional politics which may cause reluctance to collaboration. Therefore, I believe that I would be a very useful contributor to a HPC SIG within the CentOS community.
Yesterday, I spoke about cybersecurity in HPC at the CentOS Dojo. There we had a significant amount of energy around HPC and I would like to see this conversation continue. Today, I sought out the HPC SIG of CentOS. While there is evidence of activity, I have not seen anything more recent than Fall of 2017. Where is everybody?
Everybody is probably only me right now. Good to see more interest in the HPC SIG.
Let me give an overview of the HPC SIG from my point of view.
When we initially created the HPC SIG my goal was to use OpenHPC as a basis and provide those packages also from the HPC SIG, directly as part of CentOS. I build all OpenHPC packages for aarch64, ppc64le and x86_64.
To better integrate the OpenHPC packages into CentOS I was using the devtoolset-7 gcc instead of using the gcc-7 from OpenHPC.
With this done it would have not been much to have the packages on all mirrors (which is one of the advantages of being a CentOS SIG) as well as easy installation (yum install centos-hpc-sig-packages-something).
So there were a few advantages providing the OpenHPC packages as part of the HPC SIG, but in the end I decided against it as I feared it would divide the HPC community around CentOS further.
From my point of view it makes more sense to work together at OpenHPC than to duplicate packaging efforts. OpenHPC has an excellent test infrastructure to make sure everything they release works as expected.
It is also already a point where a lot of HPC experience is gathered which I do not believe the CentOS HPC SIG can easily match.
Looking at the examples you provided:
* Lmod is part of EPEL and as TACC is part of OpenHPC it is also the base of OpenHPC * Open-OnDemand was discussed in OpenHPC but it looks not as something that is easy to package as it has dependencies which are not provided by CentOS or EPEL, if upstream does not provide something easy to consume it would probably be a good candidate for containerization. * multifactor-authentication does not look like something to be packaged, it probably needs documentation how to set it up * Concerning hpn-ssh. Not sure about that. But PSC is also part of OpenHPC and other SSH based tools are also part of OpenHPC
My main point on not continuing with the HPC SIG is that I think that it makes more sense to collaborate on the OpenHPC level. But that is also only my opinion and if anybody else has different plans how the HPC SIG could be used I am happy to help. Right now I do not see what it could achieve.
Adrian
I am very happy to see we have a HPC SIG within CentOS project. I was reading the SIG list[1] and did not find this SIG listed.
For those leading this SIG, please add into that list so everyone can read more about your activities.
[1] https://wiki.centos.org/SpecialInterestGroup On Fri, Aug 17, 2018 at 2:40 PM Adrian Reber adrian@lisas.de wrote:
On Fri, Aug 17, 2018 at 04:16:22PM +0000, Beth Lynn Eicher wrote:
Please let me introduce myself. I am Beth Lynn Eicher with the FAS username of bethlynn. My background is a career in engineering systems deployments in research computing. I have worked at the Carnegie Mellon University, the Department of Energy, and the University of Chicago. Currently, I am a High Performance Computing consultant with clients like Pittsburgh Supercomputing Center and the University of Wyoming. There, I worked with Bridges, an XSEDE participating site.
Bridges uses CentOS 7 as do many other large installations. If you look at the top500, CentOS is the most popular named distribution. I hypothesize that CentOS is in the majority of the overall market share. It is a solid choice for all HPC systems.
The tools for use with HPC are often built by our greater community but seldom packaged by EPEL. I am unware of rpm builds for the following Free Software projects: https://github.com/OSC/Open-OnDemand https://www.psc.edu/hpn-ssh https://portal.tacc.utexas.edu/tutorials/multifactor-authentication https://github.com/TACC/Lmod
As an industry contributor from a small company, I am unencumbered by institutional politics which may cause reluctance to collaboration. Therefore, I believe that I would be a very useful contributor to a HPC SIG within the CentOS community.
Yesterday, I spoke about cybersecurity in HPC at the CentOS Dojo. There we had a significant amount of energy around HPC and I would like to see this conversation continue. Today, I sought out the HPC SIG of CentOS. While there is evidence of activity, I have not seen anything more recent than Fall of 2017. Where is everybody?
Everybody is probably only me right now. Good to see more interest in the HPC SIG.
Let me give an overview of the HPC SIG from my point of view.
When we initially created the HPC SIG my goal was to use OpenHPC as a basis and provide those packages also from the HPC SIG, directly as part of CentOS. I build all OpenHPC packages for aarch64, ppc64le and x86_64.
To better integrate the OpenHPC packages into CentOS I was using the devtoolset-7 gcc instead of using the gcc-7 from OpenHPC.
With this done it would have not been much to have the packages on all mirrors (which is one of the advantages of being a CentOS SIG) as well as easy installation (yum install centos-hpc-sig-packages-something).
So there were a few advantages providing the OpenHPC packages as part of the HPC SIG, but in the end I decided against it as I feared it would divide the HPC community around CentOS further.
From my point of view it makes more sense to work together at OpenHPC than to duplicate packaging efforts. OpenHPC has an excellent test infrastructure to make sure everything they release works as expected.
It is also already a point where a lot of HPC experience is gathered which I do not believe the CentOS HPC SIG can easily match.
Looking at the examples you provided:
- Lmod is part of EPEL and as TACC is part of OpenHPC it is also the base of OpenHPC
- Open-OnDemand was discussed in OpenHPC but it looks not as something that is easy to package as it has dependencies which are not provided by CentOS or EPEL, if upstream does not provide something easy to consume it would probably be a good candidate for containerization.
- multifactor-authentication does not look like something to be packaged, it probably needs documentation how to set it up
- Concerning hpn-ssh. Not sure about that. But PSC is also part of OpenHPC and other SSH based tools are also part of OpenHPC
My main point on not continuing with the HPC SIG is that I think that it makes more sense to collaborate on the OpenHPC level. But that is also only my opinion and if anybody else has different plans how the HPC SIG could be used I am happy to help. Right now I do not see what it could achieve.
Adrian
CentOS-devel mailing list CentOS-devel@centos.org https://lists.centos.org/mailman/listinfo/centos-devel
Dear Richardo,
I, too, am interested in finding where HPC SIG conversations are happening. This SIG does not seem to be on the meeting calendar. If it has a separate mailman, I am not aware. I posted to this list with the !HPC as instructed on the wiki: https://wiki.centos.org/SpecialInterestGroup/HPC
If there is a more appropriate place to have these conversations, please point me to it. I am excited to becoming involved in the CentOS HPC SIG and helping out where I can.
Thanks,
Beth Lynn Eicher Arcutek | Solutions Consultant beicher@arcutek.com W: 312-767-2894 M: 312-566-8947
-----Original Message----- From: CentOS-devel centos-devel-bounces@centos.org On Behalf Of Ricardo Martinelli Oliveira Sent: Saturday, August 18, 2018 9:36 AM To: centos-devel@centos.org Subject: Re: [CentOS-devel] [!HPC] Request to join HPC Sig
I am very happy to see we have a HPC SIG within CentOS project. I was reading the SIG list[1] and did not find this SIG listed.
For those leading this SIG, please add into that list so everyone can read more about your activities.
[1] https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwiki.centos... On Fri, Aug 17, 2018 at 2:40 PM Adrian Reber adrian@lisas.de wrote:
On Fri, Aug 17, 2018 at 04:16:22PM +0000, Beth Lynn Eicher wrote:
Please let me introduce myself. I am Beth Lynn Eicher with the FAS username of bethlynn. My background is a career in engineering systems deployments in research computing. I have worked at the Carnegie Mellon University, the Department of Energy, and the University of Chicago. Currently, I am a High Performance Computing consultant with clients like Pittsburgh Supercomputing Center and the University of Wyoming. There, I worked with Bridges, an XSEDE participating site.
Bridges uses CentOS 7 as do many other large installations. If you look at the top500, CentOS is the most popular named distribution. I hypothesize that CentOS is in the majority of the overall market share. It is a solid choice for all HPC systems.
The tools for use with HPC are often built by our greater community but seldom packaged by EPEL. I am unware of rpm builds for the following Free Software projects: https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgit hub.com%2FOSC%2FOpen-OnDemand&data=02%7C01%7Cbeicher%40arcutek.c om%7C9a597eb65b1f482d678d08d6050f9798%7Cb6713a29a8dc4afbb339759302c3 21b1%7C0%7C0%7C636701961866152421&sdata=H3sgnp6vz2pbbVOoIJDYDPTP Y1A7vchUfvmjXZsWJzk%3D&reserved=0 https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww .psc.edu%2Fhpn-ssh&data=02%7C01%7Cbeicher%40arcutek.com%7C9a597e b65b1f482d678d08d6050f9798%7Cb6713a29a8dc4afbb339759302c321b1%7C0%7C 0%7C636701961866152421&sdata=5mX4mpJOKSy%2FHh2T%2FGWWvH6ODR5MOoe RXbSX8AnlB20%3D&reserved=0 https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fpor tal.tacc.utexas.edu%2Ftutorials%2Fmultifactor-authentication&dat a=02%7C01%7Cbeicher%40arcutek.com%7C9a597eb65b1f482d678d08d6050f9798 %7Cb6713a29a8dc4afbb339759302c321b1%7C0%7C0%7C636701961866152421& ;sdata=CLuUXkSKkL%2F4OyOUHOixOwvCqekMd0LVB6kC5IL%2B6gM%3D&reserv ed=0 https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgit hub.com%2FTACC%2FLmod&data=02%7C01%7Cbeicher%40arcutek.com%7C9a5 97eb65b1f482d678d08d6050f9798%7Cb6713a29a8dc4afbb339759302c321b1%7C0 %7C0%7C636701961866152421&sdata=oGEO24C%2BBPj5MBFcpvDuTCiBLebwkM cC6gzfOBgI%2Bm8%3D&reserved=0
As an industry contributor from a small company, I am unencumbered by institutional politics which may cause reluctance to collaboration. Therefore, I believe that I would be a very useful contributor to a HPC SIG within the CentOS community.
Yesterday, I spoke about cybersecurity in HPC at the CentOS Dojo. There we had a significant amount of energy around HPC and I would like to see this conversation continue. Today, I sought out the HPC SIG of CentOS. While there is evidence of activity, I have not seen anything more recent than Fall of 2017. Where is everybody?
Everybody is probably only me right now. Good to see more interest in the HPC SIG.
Let me give an overview of the HPC SIG from my point of view.
When we initially created the HPC SIG my goal was to use OpenHPC as a basis and provide those packages also from the HPC SIG, directly as part of CentOS. I build all OpenHPC packages for aarch64, ppc64le and x86_64.
To better integrate the OpenHPC packages into CentOS I was using the devtoolset-7 gcc instead of using the gcc-7 from OpenHPC.
With this done it would have not been much to have the packages on all mirrors (which is one of the advantages of being a CentOS SIG) as well as easy installation (yum install centos-hpc-sig-packages-something).
So there were a few advantages providing the OpenHPC packages as part of the HPC SIG, but in the end I decided against it as I feared it would divide the HPC community around CentOS further.
From my point of view it makes more sense to work together at OpenHPC than to duplicate packaging efforts. OpenHPC has an excellent test infrastructure to make sure everything they release works as expected.
It is also already a point where a lot of HPC experience is gathered which I do not believe the CentOS HPC SIG can easily match.
Looking at the examples you provided:
- Lmod is part of EPEL and as TACC is part of OpenHPC it is also the base of OpenHPC
- Open-OnDemand was discussed in OpenHPC but it looks not as something that is easy to package as it has dependencies which are not provided by CentOS or EPEL, if upstream does not provide something easy to consume it would probably be a good candidate for containerization.
- multifactor-authentication does not look like something to be packaged, it probably needs documentation how to set it up
- Concerning hpn-ssh. Not sure about that. But PSC is also part of OpenHPC and other SSH based tools are also part of OpenHPC
My main point on not continuing with the HPC SIG is that I think that it makes more sense to collaborate on the OpenHPC level. But that is also only my opinion and if anybody else has different plans how the HPC SIG could be used I am happy to help. Right now I do not see what it could achieve.
Adrian
CentOS-devel mailing list CentOS-devel@centos.org https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists .centos.org%2Fmailman%2Flistinfo%2Fcentos-devel&data=02%7C01%7Cbei cher%40arcutek.com%7C9a597eb65b1f482d678d08d6050f9798%7Cb6713a29a8dc4a fbb339759302c321b1%7C0%7C0%7C636701961866152421&sdata=zeWTSkUNTtql k47AgfErFrNLb%2BAtkYBgNsQDxIgZUqo%3D&reserved=0
_______________________________________________ CentOS-devel mailing list CentOS-devel@centos.org https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.cento... The information transmitted is intended only for the person or entity to which it is addressed and may contain proprietary, business-confidential and/or privileged material. If you are not the intended recipient of this message you are hereby notified that any use, review, retransmission, dissemination, distribution, reproduction or any action taken in reliance upon this message is prohibited. If you received this in error, please contact the sender and delete the material from any computer.
Beth,
As part of the CentOS PaaS SIG team, I think all the SIGs conversation is made by this mailing list and on #centos-devel in Freenode, so my suggestion is: As you already started the thread in here it would be good also join the IRC channel too.
Also, I reinforce my recommendation to the SIG members to add the HPC SIG to the list so everyone is aware of the SIG.
On Sat, Aug 18, 2018 at 12:44 PM Beth Lynn Eicher beicher@arcutek.com wrote:
Dear Richardo,
I, too, am interested in finding where HPC SIG conversations are happening. This SIG does not seem to be on the meeting calendar. If it has a separate mailman, I am not aware. I posted to this list with the !HPC as instructed on the wiki: https://wiki.centos.org/SpecialInterestGroup/HPC
If there is a more appropriate place to have these conversations, please point me to it. I am excited to becoming involved in the CentOS HPC SIG and helping out where I can.
Thanks,
Beth Lynn Eicher Arcutek | Solutions Consultant beicher@arcutek.com W: 312-767-2894 M: 312-566-8947
-----Original Message----- From: CentOS-devel centos-devel-bounces@centos.org On Behalf Of Ricardo Martinelli Oliveira Sent: Saturday, August 18, 2018 9:36 AM To: centos-devel@centos.org Subject: Re: [CentOS-devel] [!HPC] Request to join HPC Sig
I am very happy to see we have a HPC SIG within CentOS project. I was reading the SIG list[1] and did not find this SIG listed.
For those leading this SIG, please add into that list so everyone can read more about your activities.
[1] https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwiki.centos... On Fri, Aug 17, 2018 at 2:40 PM Adrian Reber adrian@lisas.de wrote:
On Fri, Aug 17, 2018 at 04:16:22PM +0000, Beth Lynn Eicher wrote:
Please let me introduce myself. I am Beth Lynn Eicher with the FAS username of bethlynn. My background is a career in engineering systems deployments in research computing. I have worked at the Carnegie Mellon University, the Department of Energy, and the University of Chicago. Currently, I am a High Performance Computing consultant with clients like Pittsburgh Supercomputing Center and the University of Wyoming. There, I worked with Bridges, an XSEDE participating site.
Bridges uses CentOS 7 as do many other large installations. If you look at the top500, CentOS is the most popular named distribution. I hypothesize that CentOS is in the majority of the overall market share. It is a solid choice for all HPC systems.
The tools for use with HPC are often built by our greater community but seldom packaged by EPEL. I am unware of rpm builds for the following Free Software projects: https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgit hub.com%2FOSC%2FOpen-OnDemand&data=02%7C01%7Cbeicher%40arcutek.c om%7C9a597eb65b1f482d678d08d6050f9798%7Cb6713a29a8dc4afbb339759302c3 21b1%7C0%7C0%7C636701961866152421&sdata=H3sgnp6vz2pbbVOoIJDYDPTP Y1A7vchUfvmjXZsWJzk%3D&reserved=0 https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww .psc.edu%2Fhpn-ssh&data=02%7C01%7Cbeicher%40arcutek.com%7C9a597e b65b1f482d678d08d6050f9798%7Cb6713a29a8dc4afbb339759302c321b1%7C0%7C 0%7C636701961866152421&sdata=5mX4mpJOKSy%2FHh2T%2FGWWvH6ODR5MOoe RXbSX8AnlB20%3D&reserved=0 https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fpor tal.tacc.utexas.edu%2Ftutorials%2Fmultifactor-authentication&dat a=02%7C01%7Cbeicher%40arcutek.com%7C9a597eb65b1f482d678d08d6050f9798 %7Cb6713a29a8dc4afbb339759302c321b1%7C0%7C0%7C636701961866152421& ;sdata=CLuUXkSKkL%2F4OyOUHOixOwvCqekMd0LVB6kC5IL%2B6gM%3D&reserv ed=0 https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgit hub.com%2FTACC%2FLmod&data=02%7C01%7Cbeicher%40arcutek.com%7C9a5 97eb65b1f482d678d08d6050f9798%7Cb6713a29a8dc4afbb339759302c321b1%7C0 %7C0%7C636701961866152421&sdata=oGEO24C%2BBPj5MBFcpvDuTCiBLebwkM cC6gzfOBgI%2Bm8%3D&reserved=0
As an industry contributor from a small company, I am unencumbered by institutional politics which may cause reluctance to collaboration. Therefore, I believe that I would be a very useful contributor to a HPC SIG within the CentOS community.
Yesterday, I spoke about cybersecurity in HPC at the CentOS Dojo. There we had a significant amount of energy around HPC and I would like to see this conversation continue. Today, I sought out the HPC SIG of CentOS. While there is evidence of activity, I have not seen anything more recent than Fall of 2017. Where is everybody?
Everybody is probably only me right now. Good to see more interest in the HPC SIG.
Let me give an overview of the HPC SIG from my point of view.
When we initially created the HPC SIG my goal was to use OpenHPC as a basis and provide those packages also from the HPC SIG, directly as part of CentOS. I build all OpenHPC packages for aarch64, ppc64le and x86_64.
To better integrate the OpenHPC packages into CentOS I was using the devtoolset-7 gcc instead of using the gcc-7 from OpenHPC.
With this done it would have not been much to have the packages on all mirrors (which is one of the advantages of being a CentOS SIG) as well as easy installation (yum install centos-hpc-sig-packages-something).
So there were a few advantages providing the OpenHPC packages as part of the HPC SIG, but in the end I decided against it as I feared it would divide the HPC community around CentOS further.
From my point of view it makes more sense to work together at OpenHPC than to duplicate packaging efforts. OpenHPC has an excellent test infrastructure to make sure everything they release works as expected.
It is also already a point where a lot of HPC experience is gathered which I do not believe the CentOS HPC SIG can easily match.
Looking at the examples you provided:
- Lmod is part of EPEL and as TACC is part of OpenHPC it is also the base of OpenHPC
- Open-OnDemand was discussed in OpenHPC but it looks not as something that is easy to package as it has dependencies which are not provided by CentOS or EPEL, if upstream does not provide something easy to consume it would probably be a good candidate for containerization.
- multifactor-authentication does not look like something to be packaged, it probably needs documentation how to set it up
- Concerning hpn-ssh. Not sure about that. But PSC is also part of OpenHPC and other SSH based tools are also part of OpenHPC
My main point on not continuing with the HPC SIG is that I think that it makes more sense to collaborate on the OpenHPC level. But that is also only my opinion and if anybody else has different plans how the HPC SIG could be used I am happy to help. Right now I do not see what it could achieve.
Adrian
CentOS-devel mailing list CentOS-devel@centos.org https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists .centos.org%2Fmailman%2Flistinfo%2Fcentos-devel&data=02%7C01%7Cbei cher%40arcutek.com%7C9a597eb65b1f482d678d08d6050f9798%7Cb6713a29a8dc4a fbb339759302c321b1%7C0%7C0%7C636701961866152421&sdata=zeWTSkUNTtql k47AgfErFrNLb%2BAtkYBgNsQDxIgZUqo%3D&reserved=0
CentOS-devel mailing list CentOS-devel@centos.org https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.cento... The information transmitted is intended only for the person or entity to which it is addressed and may contain proprietary, business-confidential and/or privileged material. If you are not the intended recipient of this message you are hereby notified that any use, review, retransmission, dissemination, distribution, reproduction or any action taken in reliance upon this message is prohibited. If you received this in error, please contact the sender and delete the material from any computer. _______________________________________________ CentOS-devel mailing list CentOS-devel@centos.org https://lists.centos.org/mailman/listinfo/centos-devel
The HPC SIG is listed under 'Future/Proposed SIGs' since it exists.
On Sat, Aug 18, 2018 at 10:36:02AM -0300, Ricardo Martinelli Oliveira wrote:
I am very happy to see we have a HPC SIG within CentOS project. I was reading the SIG list[1] and did not find this SIG listed.
For those leading this SIG, please add into that list so everyone can read more about your activities.
[1] https://wiki.centos.org/SpecialInterestGroup On Fri, Aug 17, 2018 at 2:40 PM Adrian Reber adrian@lisas.de wrote:
On Fri, Aug 17, 2018 at 04:16:22PM +0000, Beth Lynn Eicher wrote:
Please let me introduce myself. I am Beth Lynn Eicher with the FAS username of bethlynn. My background is a career in engineering systems deployments in research computing. I have worked at the Carnegie Mellon University, the Department of Energy, and the University of Chicago. Currently, I am a High Performance Computing consultant with clients like Pittsburgh Supercomputing Center and the University of Wyoming. There, I worked with Bridges, an XSEDE participating site.
Bridges uses CentOS 7 as do many other large installations. If you look at the top500, CentOS is the most popular named distribution. I hypothesize that CentOS is in the majority of the overall market share. It is a solid choice for all HPC systems.
The tools for use with HPC are often built by our greater community but seldom packaged by EPEL. I am unware of rpm builds for the following Free Software projects: https://github.com/OSC/Open-OnDemand https://www.psc.edu/hpn-ssh https://portal.tacc.utexas.edu/tutorials/multifactor-authentication https://github.com/TACC/Lmod
As an industry contributor from a small company, I am unencumbered by institutional politics which may cause reluctance to collaboration. Therefore, I believe that I would be a very useful contributor to a HPC SIG within the CentOS community.
Yesterday, I spoke about cybersecurity in HPC at the CentOS Dojo. There we had a significant amount of energy around HPC and I would like to see this conversation continue. Today, I sought out the HPC SIG of CentOS. While there is evidence of activity, I have not seen anything more recent than Fall of 2017. Where is everybody?
Everybody is probably only me right now. Good to see more interest in the HPC SIG.
Let me give an overview of the HPC SIG from my point of view.
When we initially created the HPC SIG my goal was to use OpenHPC as a basis and provide those packages also from the HPC SIG, directly as part of CentOS. I build all OpenHPC packages for aarch64, ppc64le and x86_64.
To better integrate the OpenHPC packages into CentOS I was using the devtoolset-7 gcc instead of using the gcc-7 from OpenHPC.
With this done it would have not been much to have the packages on all mirrors (which is one of the advantages of being a CentOS SIG) as well as easy installation (yum install centos-hpc-sig-packages-something).
So there were a few advantages providing the OpenHPC packages as part of the HPC SIG, but in the end I decided against it as I feared it would divide the HPC community around CentOS further.
From my point of view it makes more sense to work together at OpenHPC than to duplicate packaging efforts. OpenHPC has an excellent test infrastructure to make sure everything they release works as expected.
It is also already a point where a lot of HPC experience is gathered which I do not believe the CentOS HPC SIG can easily match.
Looking at the examples you provided:
- Lmod is part of EPEL and as TACC is part of OpenHPC it is also the base of OpenHPC
- Open-OnDemand was discussed in OpenHPC but it looks not as something that is easy to package as it has dependencies which are not provided by CentOS or EPEL, if upstream does not provide something easy to consume it would probably be a good candidate for containerization.
- multifactor-authentication does not look like something to be packaged, it probably needs documentation how to set it up
- Concerning hpn-ssh. Not sure about that. But PSC is also part of OpenHPC and other SSH based tools are also part of OpenHPC
My main point on not continuing with the HPC SIG is that I think that it makes more sense to collaborate on the OpenHPC level. But that is also only my opinion and if anybody else has different plans how the HPC SIG could be used I am happy to help. Right now I do not see what it could achieve.
Adrian
CentOS-devel mailing list CentOS-devel@centos.org https://lists.centos.org/mailman/listinfo/centos-devel
CentOS-devel mailing list CentOS-devel@centos.org https://lists.centos.org/mailman/listinfo/centos-devel
-
Adrian Reber -
Beth Lynn Eicher -
Ricardo Martinelli Oliveira