[CentOS] another bizarre thing...

Tue Aug 6 01:54:56 UTC 2019
Grant Street <Grant.Street at al.com.au>

Try checking your /var/log/messages for OOM killer log lines. If your machine is running low on memory the oom killer will start killing high memory usage programs.

From: CentOS <centos-bounces at centos.org> on behalf of Fred Smith <fredex at fcshome.stoneham.ma.us>
Sent: Tuesday, 6 August 2019 10:57 AM
To: centos at centos.org
Subject: [CentOS] another bizarre thing...

Hi all!

I'm stuck on something really bizarre that is happening to a product
I "own" at work. It's a C program, built on CentOS, runs on CentOs or
RHEL, has been in circulation since the early 00's, is in use at
hundreds of sites.

recently, at multiple customer sites it has started just going away.
no core file (yes, ulimit is configured), nothing in any of its
(several) log files. it's just gone.

running it under strace until it dies reveals that every thread has
been given a SIGKILL.

How does one figure out who deliverd a SIGKILL? For other, non-fatal,
signals it is possible to glean the PID of the sending process in a
signal  handler, but obviously you can't do that for SIGKILL because
the app doesn't survive the signal.

I'm grasping at straws here, and am open to almost any kind of
suggestion that can be followed-up (as compared to "beats me" which
is where I am now).

I'm even wondering if systemd has something to do with it.

Thanks in advance!
---- Fred Smith -- fredex at fcshome.stoneham.ma.us -----------------------------
               But God demonstrates his own love for us in this:
                         While we were still sinners,
                              Christ died for us.
------------------------------- Romans 5:8 (niv) ------------------------------
CentOS mailing list
CentOS at centos.org
Grant Street
Senior Systems Engineer

T: +61 2 9383 4800 (main)
D: +61 2 8310 3582 (direct)
E: Grant.Street at al.com.au

Building 54 / FSA #19, Fox Studios Australia, 38 Driver Avenue
Moore Park, NSW 2021

  [LinkedIn] <https://www.linkedin.com/company/animal-logic>   [Facebook] <https://www.facebook.com/Animal-Logic-129284263808191/>   [Twitter] <https://twitter.com/AnimalLogic>   [Instagram] <https://www.instagram.com/animallogicstudios/>

[Animal Logic]<http://www.animallogic.com>


This email is intended only to be read or used by the addressee. It is confidential and may contain privileged information. If you are not the intended recipient, any use, distribution, disclosure or copying of this email is strictly prohibited. Confidentiality and legal privilege attached to this communication are not waived or lost by reason of the mistaken delivery to you. If you have received this email in error, please delete it and notify us immediately by telephone or email.