Hi all;
I would like to pull data from some specific web pages that have for sale ads and insert the data into a database. Anyone know ofany tools that can help me with this?
I assume you are looking for a "simple" way of doing this just real quick so you're going to want a scripting language.
Were I to do this, I would use Python and the urlgrabber.
http://linux.duke.edu/projects/urlgrabber
urlgrabber has some benefits over urllib2 or pycURL.
You could also use jython to get quick access to lots of fun Java libraries that handle XML/HTML and database (JDBC) and HTTP.
Regards, Greg
HTMLParser? Perl? Python?
A
-- Zope Managed Hosting Software Engineer Zope Corporation (540) 361-1700
-----Original Message----- From: centos-bounces@centos.org [mailto:centos-bounces@centos.org] On Behalf Of kevin.kempter@dataintellect.com Sent: Wednesday, September 21, 2005 4:49 PM To: CentOS mailing list Subject: [CentOS] OT - Tool to pull data from the web?
Hi all;
I would like to pull data from some specific web pages that have for sale ads and insert the data into a database. Anyone know ofany tools that can help me with this?
CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
-
Andrew Sawyers -
Greg Knaddison -
kevin.kempter＠dataintellect.com