Home Original page

Python web client anyone?

Richard Jones richard at bizarsoftware.com.au
Sun Oct 14 19:20:46 EDT 2001 
On Monday 15 October 2001 09:04, Paul Rubin wrote:
> "Fredrik Lundh" <fredrik at pythonware.com> writes:
> > > Anyone know if there are any web client modules written in Python,
> > > along the lines of the Perl LWP module?  Thanks.
> > >
> > >>> import urllib
> >
> > more info here:
> >
> > http://www.python.org/doc/current/lib/internet.html
>
> Thanks, this appears to include an HTTP client, which is a start, but
> I was looking for something that actually parses the HTML on the
> retrieved page like LWP does.  I wonder if there's some way to do that
> with the XML libraries (though HTML is generally not well-formed
> XML--for example it usually has unterminated <P> tags).  Any
> thoughts?

htmllib?

If you want quick and simple DOM extraction, I have a module that extends 
HTMLParser...


    Richard
More information about the Python-list mailing list