Rene Pijlman reply.in.the.newsgroup at my.address.is.invalid
Sat Oct 4 08:22:53 EDT 2003

• Previous message (by thread): Web-crawling
• Next message (by thread): Web-crawling
• Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]

---

John Bradbury:
>I am trying to develop a special putpose crawler using htmllib & urllib.
>How do you tell the server application that you are a modern browser and can
>handle frames?

I don't know of any "I can handle frames" header and I don't see why the
server would care, but you could mimic the User-agent header sent by a
modern browser.

-- 
René Pijlman

---

• Previous message (by thread): Web-crawling
• Next message (by thread): Web-crawling
• Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]

---

More information about the Python-list mailing list