Looking at my log, 90% of the entries are what you're seeing. So that should be normal traffic. Even see them in IPv6.
72.43.14.218 - - [15/Oct/2012:08:57:29 -0400] "GET /centos/5.8/os/i386/repodata/repomd.xml HTTP/1.1" 200 1140 "-" "urlgrabber/3.1.0 yum/3.2.22" 216.52.195.141 - - [15/Oct/2012:08:57:29 -0400] "GET /centos/5.8/extras/i386/repodata/repomd.xml HTTP/1.1" 200 1953 "-" "urlgrabber/3.1.0 yum/3.2.22" 168.85.177.70 - - [15/Oct/2012:08:57:30 -0400] "GET /centos/5.7/os/x86_64/repodata/repomd.xml HTTP/1.1" 404 319 "-" "urlgrabber/3.1.0 yum/3.2.22" 216.59.32.140 - - [15/Oct/2012:08:57:30 -0400] "GET /centos/5.8/updates/x86_64/repodata/repomd.xml HTTP/1.1" 200 1953 "-" "urlgrabber/3.1.0 yum/3.2.22" 66.7.207.80 - - [15/Oct/2012:08:57:31 -0400] "GET /centos/5.8/extras/x86_64/repodata/repomd.xml HTTP/1.1" 200 1953 "-" "urlgrabber/3.1.0 yum/3.2.22" 2607:fe50:0:f201:21e:68ff:fe49:9d70 - - [15/Oct/2012:08:57:31 -0400] "GET /centos/5/extras/x86_64/repodata/repomd.xml HTTP/1.1" 200 1953 "-" "urlgrabber/3.1.0 yum/3.2.22" 2607:fe50:0:f201:21e:68ff:fe49:9d70 - - [15/Oct/2012:08:57:31 -0400] "GET /centos/5/updates/x86_64/repodata/repomd.xml HTTP/1.1" 200 1953 "-" "urlgrabber/3.1.0 yum/3.2.22" 66.232.36.2 - - [15/Oct/2012:08:57:32 -0400] "GET /centos/5.8/extras/i386/repodata/repomd.xml HTTP/1.1" 200 1953 "-" "urlgrabber/3.1.0 yum/3.2.22"
Nick Olsen Network Operations (855) FLSPEED x106
---------------------------------------- From: fakrul@dhakacom.com Sent: Sunday, October 14, 2012 9:18 AM To: "Mailing list for CentOS mirrors." centos-mirror@centos.org Subject: Re: [CentOS-mirror] HTTP logs of mirror server
Hi Brian,
Thanks for your response. I am glad that people are using my mirror. But I am not sure whether these are legitimate request. All request is only fetching repomd.xml and urlgrabber attached to it from randomized IP.
If it is normal behavior, than it is ok. I am also hosting other public mirror, but there is no such http request for those flavors.
Regards, Fakrul Sent from my BlackBerry® smartphone - Airtel
-----Original Message----- From: Brian Rak brak@gameservers.com Date: Sat, 13 Oct 2012 17:56:14 To: Mailing list for CentOS mirrors.centos-mirror@centos.org Cc: Fakrul Alamfakrul@dhakacom.com Subject: Re: [CentOS-mirror] HTTP logs of mirror server
If your mirror is public (and listed with CentOS), then you're going to see traffic from random hosts.. that's kind of the point of the mirror.
Did I misunderstand what you are asking? It seems that you're confused that people are actually using your mirror.
On 10/13/2012 12:38 PM, Fakrul Alam wrote:
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1
Hi,
In my CentOS mirror server I am getting huge HTTP request from random IP's. Bellow are few sample logs:
14.140.162.178 - - [13/Oct/2012:22:35:13 +0600] "GET /centos/5.8/os/x86_64/repodata/repomd.xml HTTP/1.1" 200 1140 "-" "urlgrabber/3.1.0 yum/3.2.19" 124.7.36.144 - - [13/Oct/2012:22:35:16 +0600] "GET /centos/5.8/os/i386/repodata/repomd.xml HTTP/1.1" 200 1140 "-" "urlgrabber/3.1.0 yum/3.2.22" 124.7.36.144 - - [13/Oct/2012:22:35:18 +0600] "GET /centos/5.8/extras/i386/repodata/repomd.xml HTTP/1.1" 200 1953 "-" "urlgrabber/3.1.0 yum/3.2.22" 122.166.231.199 - - [13/Oct/2012:22:35:21 +0600] "GET /centos/5.8/os/x86_64/repodata/repomd.xml HTTP/1.1" 200 1140 "-" "urlgrabber/3.1.0 yum/3.2.22" 27.251.30.86 - - [13/Oct/2012:22:35:21 +0600] "GET /centos/5.8/extras/x86_64/repodata/repomd.xml HTTP/1.1" 200 1953 "-" "urlgrabber/3.1.0 yum/3.2.22" 122.166.231.199 - - [13/Oct/2012:22:35:23 +0600] "GET /centos/5.8/extras/x86_64/repodata/repomd.xml HTTP/1.1" 200 1953 "-" "urlgrabber/3.1.0 yum/3.2.22" 117.58.244.90 - - [13/Oct/2012:22:35:25 +0600] "GET /centos/5.8/os/x86_64/repodata/repomd.xml HTTP/1.1" 200 1140 "-" "urlgrabber/3.1.0 yum/3.2.22" 117.58.244.90 - - [13/Oct/2012:22:35:25 +0600] "GET /centos/5.8/extras/x86_64/repodata/repomd.xml HTTP/1.1" 200 1953 "-" "urlgrabber/3.1.0 yum/3.2.22" 117.58.244.90 - - [13/Oct/2012:22:35:25 +0600] "GET /centos/5.8/updates/x86_64/repodata/repomd.xml HTTP/1.1" 200 1953 "-" "urlgrabber/3.1.0 yum/3.2.22" 180.179.39.9 - - [13/Oct/2012:22:35:35 +0600] "GET /centos/5.8/os/i386/repodata/repomd.xml HTTP/1.1" 200 1140 "-" "urlgrabber/3.1.0 yum/3.2.22" 115.112.108.130 - - [13/Oct/2012:22:35:38 +0600] "GET /centos/5.8/os/x86_64/repodata/repomd.xml HTTP/1.1" 200 1140 "-" "urlgrabber/3.1.0 yum/3.2.22" 115.112.108.130 - - [13/Oct/2012:22:35:38 +0600] "GET /centos/5.8/extras/x86_64/repodata/repomd.xml HTTP/1.1" 200 1953 "-" "urlgrabber/3.1.0 yum/3.2.22" 180.179.39.9 - - [13/Oct/2012:22:35:40 +0600] "GET /centos/5.8/extras/i386/repodata/repomd.xml HTTP/1.1" 200 1953 "-" "urlgrabber/3.1.0 yum/3.2.22" 180.179.39.9 - - [13/Oct/2012:22:35:42 +0600] "GET /centos/5.8/updates/i386/repodata/repomd.xml HTTP/1.1" 200 1953 "-" "urlgrabber/3.1.0 yum/3.2.22" 182.71.223.79 - - [13/Oct/2012:22:35:43 +0600] "GET /centos/5.8/os/i386/repodata/repomd.xml HTTP/1.1" 200 1140 "-" "urlgrabber/3.1.0 yum/3.2.22" 182.71.223.79 - - [13/Oct/2012:22:35:44 +0600] "GET /centos/5.8/extras/i386/repodata/repomd.xml HTTP/1.1" 200 1953 "-" "urlgrabber/3.1.0 yum/3.2.22"
Is it normal phenomena or there is some thing wrong?
Fakrul -----BEGIN PGP SIGNATURE----- Version: GnuPG/MacGPG2 v2.0.18 (Darwin) Comment: GPGTools - http://gpgtools.org
iQEcBAEBAgAGBQJQeZkXAAoJEMrRrLU8Ar25vHwH/1Bwh7ZnNFaeADc8MkeyStRg 5OKz6DeTqRw3r9vUiQtU4qefjdZz7OJElhzIqaMhU5xBoWvyPzp3bsdEG5mBsD3s 9Oama6HSAJgt9luz6iR9Nq5P6AGKqRj0mOu/r+monlfV+rBDBEcY2JfyF11dmbJP JkqyQcmGKHUYjmr5CtYSr0p+oL/9q58vfh8aIGjf2+IPur/Bq6Rm7zQZf0zaqhIH lc3MX4abaB66jUFgMxaVLJUpaa6al+7uQfAm3BtmQ1dC9LEkm1z6r4mxLB77lsA3 tqGL4itcLq+PyYkeRMIASkW8I+6MazAGxbXpAothlx//7GkUQfI0C5zRinbpl/Y= =lAVa -----END PGP SIGNATURE----- _______________________________________________ CentOS-mirror mailing list CentOS-mirror@centos.org http://lists.centos.org/mailman/listinfo/centos-mirror
_______________________________________________ CentOS-mirror mailing list CentOS-mirror@centos.org http://lists.centos.org/mailman/listinfo/centos-mirror
These are the yum requests to see updates. Totally normal on servers mirrors seen by yum.
Att, Fábio Chicout
----- Original Message ----- From: "Nick Olsen" nick@flhsi.com To: "Mailing list for CentOS mirrors." centos-mirror@centos.org, "Mailing list for CentOS mirrors." centos-mirror@centos.org Sent: Monday, October 15, 2012 10:30:05 AM Subject: Re: [CentOS-mirror] HTTP logs of mirror server
Looking at my log, 90% of the entries are what you're seeing. So that should be normal traffic. Even see them in IPv6.
72.43.14.218 - - [15/Oct/2012:08:57:29 -0400] "GET /centos/5.8/os/i386/repodata/repomd.xml HTTP/1.1" 200 1140 "-" "urlgrabber/3.1.0 yum/3.2.22" 216.52.195.141 - - [15/Oct/2012:08:57:29 -0400] "GET /centos/5.8/extras/i386/repodata/repomd.xml HTTP/1.1" 200 1953 "-" "urlgrabber/3.1.0 yum/3.2.22" 168.85.177.70 - - [15/Oct/2012:08:57:30 -0400] "GET /centos/5.7/os/x86_64/repodata/repomd.xml HTTP/1.1" 404 319 "-" "urlgrabber/3.1.0 yum/3.2.22" 216.59.32.140 - - [15/Oct/2012:08:57:30 -0400] "GET /centos/5.8/updates/x86_64/repodata/repomd.xml HTTP/1.1" 200 1953 "-" "urlgrabber/3.1.0 yum/3.2.22" 66.7.207.80 - - [15/Oct/2012:08:57:31 -0400] "GET /centos/5.8/extras/x86_64/repodata/repomd.xml HTTP/1.1" 200 1953 "-" "urlgrabber/3.1.0 yum/3.2.22" 2607:fe50:0:f201:21e:68ff:fe49:9d70 - - [15/Oct/2012:08:57:31 -0400] "GET /centos/5/extras/x86_64/repodata/repomd.xml HTTP/1.1" 200 1953 "-" "urlgrabber/3.1.0 yum/3.2.22" 2607:fe50:0:f201:21e:68ff:fe49:9d70 - - [15/Oct/2012:08:57:31 -0400] "GET /centos/5/updates/x86_64/repodata/repomd.xml HTTP/1.1" 200 1953 "-" "urlgrabber/3.1.0 yum/3.2.22" 66.232.36.2 - - [15/Oct/2012:08:57:32 -0400] "GET /centos/5.8/extras/i386/repodata/repomd.xml HTTP/1.1" 200 1953 "-" "urlgrabber/3.1.0 yum/3.2.22"
Nick Olsen Network Operations (855) FLSPEED x106
From : fakrul@dhakacom.com
Sent : Sunday, October 14, 2012 9:18 AM To : "Mailing list for CentOS mirrors." centos-mirror@centos.org Subject : Re: [CentOS-mirror] HTTP logs of mirror server
Hi Brian,
Thanks for your response. I am glad that people are using my mirror. But I am not sure whether these are legitimate request. All request is only fetching repomd.xml and urlgrabber attached to it from randomized IP.
If it is normal behavior, than it is ok. I am also hosting other public mirror, but there is no such http request for those flavors.
Regards, Fakrul Sent from my BlackBerry® smartphone - Airtel
-----Original Message----- From: Brian Rak brak@gameservers.com Date: Sat, 13 Oct 2012 17:56:14 To: Mailing list for CentOS mirrors.centos-mirror@centos.org Cc: Fakrul Alamfakrul@dhakacom.com Subject: Re: [CentOS-mirror] HTTP logs of mirror server
If your mirror is public (and listed with CentOS), then you're going to see traffic from random hosts.. that's kind of the point of the mirror.
Did I misunderstand what you are asking? It seems that you're confused that people are actually using your mirror.
On 10/13/2012 12:38 PM, Fakrul Alam wrote:
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1
Hi,
In my CentOS mirror server I am getting huge HTTP request from random IP's. Bellow are few sample logs:
14.140.162.178 - - [13/Oct/2012:22:35:13 +0600] "GET /centos/5.8/os/x86_64/repodata/repomd.xml HTTP/1.1" 200 1140 "-" "urlgrabber/3.1.0 yum/3.2.19" 124.7.36.144 - - [13/Oct/2012:22:35:16 +0600] "GET /centos/5.8/os/i386/repodata/repomd.xml HTTP/1.1" 200 1140 "-" "urlgrabber/3.1.0 yum/3.2.22" 124.7.36.144 - - [13/Oct/2012:22:35:18 +0600] "GET /centos/5.8/extras/i386/repodata/repomd.xml HTTP/1.1" 200 1953 "-" "urlgrabber/3.1.0 yum/3.2.22" 122.166.231.199 - - [13/Oct/2012:22:35:21 +0600] "GET /centos/5.8/os/x86_64/repodata/repomd.xml HTTP/1.1" 200 1140 "-" "urlgrabber/3.1.0 yum/3.2.22" 27.251.30.86 - - [13/Oct/2012:22:35:21 +0600] "GET /centos/5.8/extras/x86_64/repodata/repomd.xml HTTP/1.1" 200 1953 "-" "urlgrabber/3.1.0 yum/3.2.22" 122.166.231.199 - - [13/Oct/2012:22:35:23 +0600] "GET /centos/5.8/extras/x86_64/repodata/repomd.xml HTTP/1.1" 200 1953 "-" "urlgrabber/3.1.0 yum/3.2.22" 117.58.244.90 - - [13/Oct/2012:22:35:25 +0600] "GET /centos/5.8/os/x86_64/repodata/repomd.xml HTTP/1.1" 200 1140 "-" "urlgrabber/3.1.0 yum/3.2.22" 117.58.244.90 - - [13/Oct/2012:22:35:25 +0600] "GET /centos/5.8/extras/x86_64/repodata/repomd.xml HTTP/1.1" 200 1953 "-" "urlgrabber/3.1.0 yum/3.2.22" 117.58.244.90 - - [13/Oct/2012:22:35:25 +0600] "GET /centos/5.8/updates/x86_64/repodata/repomd.xml HTTP/1.1" 200 1953 "-" "urlgrabber/3.1.0 yum/3.2.22" 180.179.39.9 - - [13/Oct/2012:22:35:35 +0600] "GET /centos/5.8/os/i386/repodata/repomd.xml HTTP/1.1" 200 1140 "-" "urlgrabber/3.1.0 yum/3.2.22" 115.112.108.130 - - [13/Oct/2012:22:35:38 +0600] "GET /centos/5.8/os/x86_64/repodata/repomd.xml HTTP/1.1" 200 1140 "-" "urlgrabber/3.1.0 yum/3.2.22" 115.112.108.130 - - [13/Oct/2012:22:35:38 +0600] "GET /centos/5.8/extras/x86_64/repodata/repomd.xml HTTP/1.1" 200 1953 "-" "urlgrabber/3.1.0 yum/3.2.22" 180.179.39.9 - - [13/Oct/2012:22:35:40 +0600] "GET /centos/5.8/extras/i386/repodata/repomd.xml HTTP/1.1" 200 1953 "-" "urlgrabber/3.1.0 yum/3.2.22" 180.179.39.9 - - [13/Oct/2012:22:35:42 +0600] "GET /centos/5.8/updates/i386/repodata/repomd.xml HTTP/1.1" 200 1953 "-" "urlgrabber/3.1.0 yum/3.2.22" 182.71.223.79 - - [13/Oct/2012:22:35:43 +0600] "GET /centos/5.8/os/i386/repodata/repomd.xml HTTP/1.1" 200 1140 "-" "urlgrabber/3.1.0 yum/3.2.22" 182.71.223.79 - - [13/Oct/2012:22:35:44 +0600] "GET /centos/5.8/extras/i386/repodata/repomd.xml HTTP/1.1" 200 1953 "-" "urlgrabber/3.1.0 yum/3.2.22"
Is it normal phenomena or there is some thing wrong?
Fakrul -----BEGIN PGP SIGNATURE----- Version: GnuPG/MacGPG2 v2.0.18 (Darwin) Comment: GPGTools - http://gpgtools.org
iQEcBAEBAgAGBQJQeZkXAAoJEMrRrLU8Ar25vHwH/1Bwh7ZnNFaeADc8MkeyStRg 5OKz6DeTqRw3r9vUiQtU4qefjdZz7OJElhzIqaMhU5xBoWvyPzp3bsdEG5mBsD3s 9Oama6HSAJgt9luz6iR9Nq5P6AGKqRj0mOu/r+monlfV+rBDBEcY2JfyF11dmbJP JkqyQcmGKHUYjmr5CtYSr0p+oL/9q58vfh8aIGjf2+IPur/Bq6Rm7zQZf0zaqhIH lc3MX4abaB66jUFgMxaVLJUpaa6al+7uQfAm3BtmQ1dC9LEkm1z6r4mxLB77lsA3 tqGL4itcLq+PyYkeRMIASkW8I+6MazAGxbXpAothlx//7GkUQfI0C5zRinbpl/Y= =lAVa -----END PGP SIGNATURE----- _______________________________________________ CentOS-mirror mailing list CentOS-mirror@centos.org http://lists.centos.org/mailman/listinfo/centos-mirror
_______________________________________________ CentOS-mirror mailing list CentOS-mirror@centos.org http://lists.centos.org/mailman/listinfo/centos-mirror
_______________________________________________ CentOS-mirror mailing list CentOS-mirror@centos.org http://lists.centos.org/mailman/listinfo/centos-mirror
I also found these rolling things...
That's normal.Dont worry.
And I have a new question,
If there are too many 400 errors in nginx, should I ignore them or change somethings?
-
Christopher Meng -
Fábio Chicout -
Nick Olsen