John J. Lee jjl at pobox.com
Wed Oct 17 16:13:01 EDT 2007

• Previous message (by thread): Stopping a fucntion from printing its output on screen
• Next message (by thread): urlgrabber cookie handling?
• Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]

---

Devraj <devraj at gmail.com> writes:

> Hi everyone,
>
> I have been battling to make my code work with a HTTPS proxy, current
> my code uses urllib2 to to most things and works well, except that
> urllib2 doesn't handle HTTPS proxies.
>
> Urlgrabber (http://linux.duke.edu/projects/urlgrabber/help/
> urlgrabber.grabber.html) looks very promising except that I can find a
> way to handle cookies in urlgrabber. Is there a way urlgrabber can use
> a HTTPCookieProcess or cookielib.CookieJar object to handle cookies?

I don't see a nice way.  But then I don't see any HTTPS proxy support
in urlgrabber... (I looked at version 3.1.0).

There is a recipe or two on ASPN showing how to support HTTPS proxies
with urllib2, which gives an idea how to do it, though the code is a
bit rough (I'd post some code myself, but I did it for work).


John

---

• Previous message (by thread): Stopping a fucntion from printing its output on screen
• Next message (by thread): urlgrabber cookie handling?
• Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]

---

More information about the Python-list mailing list