<span style="font-family: Arial, Helvetica, sans-serif; font-size: 10pt">Looking at my log, 90% of the entries are what you're seeing. So that should be normal traffic. Even see them in IPv6.<br />
<br />
<br />
72.43.14.218 - - [15/Oct/2012:08:57:29 -0400] "GET /centos/5.8/os/i386/repodata/repomd.xml HTTP/1.1" 200 1140 "-" "urlgrabber/3.1.0 yum/3.2.22"<br />
216.52.195.141 - - [15/Oct/2012:08:57:29 -0400] "GET /centos/5.8/extras/i386/repodata/repomd.xml HTTP/1.1" 200 1953 "-" "urlgrabber/3.1.0 yum/3.2.22"<br />
168.85.177.70 - - [15/Oct/2012:08:57:30 -0400] "GET /centos/5.7/os/x86_64/repodata/repomd.xml HTTP/1.1" 404 319 "-" "urlgrabber/3.1.0 yum/3.2.22"<br />
216.59.32.140 - - [15/Oct/2012:08:57:30 -0400] "GET /centos/5.8/updates/x86_64/repodata/repomd.xml HTTP/1.1" 200 1953 "-" "urlgrabber/3.1.0 yum/3.2.22"<br />
66.7.207.80 - - [15/Oct/2012:08:57:31 -0400] "GET /centos/5.8/extras/x86_64/repodata/repomd.xml HTTP/1.1" 200 1953 "-" "urlgrabber/3.1.0 yum/3.2.22"<br />
2607:fe50:0:f201:21e:68ff:fe49:9d70 - - [15/Oct/2012:08:57:31 -0400] "GET /centos/5/extras/x86_64/repodata/repomd.xml HTTP/1.1" 200 1953 "-" "urlgrabber/3.1.0 yum/3.2.22"<br />
2607:fe50:0:f201:21e:68ff:fe49:9d70 - - [15/Oct/2012:08:57:31 -0400] "GET /centos/5/updates/x86_64/repodata/repomd.xml HTTP/1.1" 200 1953 "-" "urlgrabber/3.1.0 yum/3.2.22"<br />
66.232.36.2 - - [15/Oct/2012:08:57:32 -0400] "GET /centos/5.8/extras/i386/repodata/repomd.xml HTTP/1.1" 200 1953 "-" "urlgrabber/3.1.0 yum/3.2.22"<br />
<div><br />
</div>
<br />
<div>Nick Olsen<br />
<span style="font-size: 10pt; font-family: arial, helvetica, sans-serif;">Network Operations</span>
<div>(855) FLSPEED x106<br />
<br />
<img alt="" height="56" width="168" src="http://www.flhsi.com/files/emaillogo.jpg" /></div>
</div>
<br />
<br />
<span style="font-size: 10pt; font-family: tahoma, arial, sans-serif;"><hr size="2" width="100%" align="center" />
<strong>From</strong>: fakrul@dhakacom.com<br />
<strong>Sent</strong>: Sunday, October 14, 2012 9:18 AM<br />
<strong>To</strong>: "Mailing list for CentOS mirrors." <centos-mirror@centos.org><br />
<strong>Subject</strong>: Re: [CentOS-mirror] HTTP logs of mirror server</span><br />
<br />
Hi Brian,<br />
<br />
Thanks for your response. I am glad that people are using my mirror. But I am not sure whether these are legitimate request. All request is only fetching repomd.xml and urlgrabber attached to it from randomized IP. <br />
<br />
If it is normal behavior, than it is ok. I am also hosting other public mirror, but there is no such http request for those flavors.<br />
<br />
Regards,<br />
Fakrul <br />
Sent from my BlackBerry® smartphone - Airtel<br />
<br />
-----Original Message-----<br />
From: Brian Rak <brak@gameservers.com><br />
Date: Sat, 13 Oct 2012 17:56:14 <br />
To: Mailing list for CentOS mirrors.<centos-mirror@centos.org><br />
Cc: Fakrul Alam<fakrul@dhakacom.com><br />
Subject: Re: [CentOS-mirror] HTTP logs of mirror server<br />
<br />
If your mirror is public (and listed with CentOS), then you're going to <br />
see traffic from random hosts.. that's kind of the point of the mirror.<br />
<br />
Did I misunderstand what you are asking? It seems that you're confused <br />
that people are actually using your mirror.<br />
<br />
On 10/13/2012 12:38 PM, Fakrul Alam wrote:<br />
> -----BEGIN PGP SIGNED MESSAGE-----<br />
> Hash: SHA1<br />
><br />
> Hi,<br />
><br />
> In my CentOS mirror server I am getting huge HTTP request from random<br />
> IP's. Bellow are few sample logs:<br />
><br />
> 14.140.162.178 - - [13/Oct/2012:22:35:13 +0600] "GET<br />
> /centos/5.8/os/x86_64/repodata/repomd.xml HTTP/1.1" 200 1140 "-"<br />
> "urlgrabber/3.1.0 yum/3.2.19"<br />
> 124.7.36.144 - - [13/Oct/2012:22:35:16 +0600] "GET<br />
> /centos/5.8/os/i386/repodata/repomd.xml HTTP/1.1" 200 1140 "-"<br />
> "urlgrabber/3.1.0 yum/3.2.22"<br />
> 124.7.36.144 - - [13/Oct/2012:22:35:18 +0600] "GET<br />
> /centos/5.8/extras/i386/repodata/repomd.xml HTTP/1.1" 200 1953 "-"<br />
> "urlgrabber/3.1.0 yum/3.2.22"<br />
> 122.166.231.199 - - [13/Oct/2012:22:35:21 +0600] "GET<br />
> /centos/5.8/os/x86_64/repodata/repomd.xml HTTP/1.1" 200 1140 "-"<br />
> "urlgrabber/3.1.0 yum/3.2.22"<br />
> 27.251.30.86 - - [13/Oct/2012:22:35:21 +0600] "GET<br />
> /centos/5.8/extras/x86_64/repodata/repomd.xml HTTP/1.1" 200 1953 "-"<br />
> "urlgrabber/3.1.0 yum/3.2.22"<br />
> 122.166.231.199 - - [13/Oct/2012:22:35:23 +0600] "GET<br />
> /centos/5.8/extras/x86_64/repodata/repomd.xml HTTP/1.1" 200 1953 "-"<br />
> "urlgrabber/3.1.0 yum/3.2.22"<br />
> 117.58.244.90 - - [13/Oct/2012:22:35:25 +0600] "GET<br />
> /centos/5.8/os/x86_64/repodata/repomd.xml HTTP/1.1" 200 1140 "-"<br />
> "urlgrabber/3.1.0 yum/3.2.22"<br />
> 117.58.244.90 - - [13/Oct/2012:22:35:25 +0600] "GET<br />
> /centos/5.8/extras/x86_64/repodata/repomd.xml HTTP/1.1" 200 1953 "-"<br />
> "urlgrabber/3.1.0 yum/3.2.22"<br />
> 117.58.244.90 - - [13/Oct/2012:22:35:25 +0600] "GET<br />
> /centos/5.8/updates/x86_64/repodata/repomd.xml HTTP/1.1" 200 1953 "-"<br />
> "urlgrabber/3.1.0 yum/3.2.22"<br />
> 180.179.39.9 - - [13/Oct/2012:22:35:35 +0600] "GET<br />
> /centos/5.8/os/i386/repodata/repomd.xml HTTP/1.1" 200 1140 "-"<br />
> "urlgrabber/3.1.0 yum/3.2.22"<br />
> 115.112.108.130 - - [13/Oct/2012:22:35:38 +0600] "GET<br />
> /centos/5.8/os/x86_64/repodata/repomd.xml HTTP/1.1" 200 1140 "-"<br />
> "urlgrabber/3.1.0 yum/3.2.22"<br />
> 115.112.108.130 - - [13/Oct/2012:22:35:38 +0600] "GET<br />
> /centos/5.8/extras/x86_64/repodata/repomd.xml HTTP/1.1" 200 1953 "-"<br />
> "urlgrabber/3.1.0 yum/3.2.22"<br />
> 180.179.39.9 - - [13/Oct/2012:22:35:40 +0600] "GET<br />
> /centos/5.8/extras/i386/repodata/repomd.xml HTTP/1.1" 200 1953 "-"<br />
> "urlgrabber/3.1.0 yum/3.2.22"<br />
> 180.179.39.9 - - [13/Oct/2012:22:35:42 +0600] "GET<br />
> /centos/5.8/updates/i386/repodata/repomd.xml HTTP/1.1" 200 1953 "-"<br />
> "urlgrabber/3.1.0 yum/3.2.22"<br />
> 182.71.223.79 - - [13/Oct/2012:22:35:43 +0600] "GET<br />
> /centos/5.8/os/i386/repodata/repomd.xml HTTP/1.1" 200 1140 "-"<br />
> "urlgrabber/3.1.0 yum/3.2.22"<br />
> 182.71.223.79 - - [13/Oct/2012:22:35:44 +0600] "GET<br />
> /centos/5.8/extras/i386/repodata/repomd.xml HTTP/1.1" 200 1953 "-"<br />
> "urlgrabber/3.1.0 yum/3.2.22"<br />
><br />
> Is it normal phenomena or there is some thing wrong?<br />
><br />
> Fakrul<br />
> -----BEGIN PGP SIGNATURE-----<br />
> Version: GnuPG/MacGPG2 v2.0.18 (Darwin)<br />
> Comment: GPGTools - http://gpgtools.org<br />
><br />
> iQEcBAEBAgAGBQJQeZkXAAoJEMrRrLU8Ar25vHwH/1Bwh7ZnNFaeADc8MkeyStRg<br />
> 5OKz6DeTqRw3r9vUiQtU4qefjdZz7OJElhzIqaMhU5xBoWvyPzp3bsdEG5mBsD3s<br />
> 9Oama6HSAJgt9luz6iR9Nq5P6AGKqRj0mOu/r+monlfV+rBDBEcY2JfyF11dmbJP<br />
> JkqyQcmGKHUYjmr5CtYSr0p+oL/9q58vfh8aIGjf2+IPur/Bq6Rm7zQZf0zaqhIH<br />
> lc3MX4abaB66jUFgMxaVLJUpaa6al+7uQfAm3BtmQ1dC9LEkm1z6r4mxLB77lsA3<br />
> tqGL4itcLq+PyYkeRMIASkW8I+6MazAGxbXpAothlx//7GkUQfI0C5zRinbpl/Y=<br />
> =lAVa<br />
> -----END PGP SIGNATURE-----<br />
> _______________________________________________<br />
> CentOS-mirror mailing list<br />
> CentOS-mirror@centos.org<br />
> http://lists.centos.org/mailman/listinfo/centos-mirror<br />
<br />
_______________________________________________<br />
CentOS-mirror mailing list<br />
CentOS-mirror@centos.org<br />
http://lists.centos.org/mailman/listinfo/centos-mirror<br /></span>