Best approach to get data from web page continuously
Juan Christian
juan0christian at gmail.com
Thu Sep 18 09:30:46 EDT 2014
More information about the Python-list mailing list
Thu Sep 18 09:30:46 EDT 2014
- Previous message (by thread): Is there a canonical way to check whether an iterable is ordered?
- Next message (by thread): Best approach to get data from web page continuously
- Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]
I'll write a python (Python 3.4.1) script to fetch for new data (topics) from this page (http://steamcommunity.com/app/440/tradingforum) continuously. All the topics follow this structure: <a class="forum_topic_overlay" href=" http://steamcommunity.com/app/440/tradingforum/TOPIC_ID/"> </a> It will work like that: I'll get the last topics, do some background checking regarding user level, inventory value, account age, and other things, if the user pass in the checking, I'll print some info and links in the terminal. The only thing I need to know to start is: What's the better way the get this data? Beautiful Soup 4 + requests? urllib? Others? Thanks. -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.python.org/pipermail/python-list/attachments/20140918/66401ec0/attachment.html>
- Previous message (by thread): Is there a canonical way to check whether an iterable is ordered?
- Next message (by thread): Best approach to get data from web page continuously
- Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]
More information about the Python-list mailing list