#urllib2

django

POST requests

Also Cool:

Fixed Should I use urllib or urllib2 or requests? #dev #it #asnwer

Should I use urllib or urllib2 or requests?

In Python (2.5), should I use urllib or urllib2 or requests? What’s the difference? They seem to do the same thing.

Answer: Should I use urllib or urllib2 or requests?

urllib2.urlopen accepts an instance of the Request class or a url, whereas urllib.urlopen only accepts a url.

A similar discussion took place here: http://www.velocityreviews.com/forums…

Fixed How do I download a file over HTTP using Python? #dev #it #asnwer

How do I download a file over HTTP using Python?

I have a small utility that I use to download an MP3 from a website on a schedule and then builds/updates a podcast XML file which I’ve obviously added to iTunes.

The text processing that creates/updates the XML file is written in Python. I use wget inside a Windows .bat file to download the actual MP3 however. I would prefer to have the entire…

How to: Should I use urllib or urllib2 or requests?

Should I use urllib or urllib2 or requests?

In Python (2.5), should I use urllib or urllib2 or requests? What’s the difference? They seem to do the same thing.

Answer: Should I use urllib or urllib2 or requests?

urllib2.urlopen accepts an instance of the Request class or a url, whereas urllib.urlopen only accepts a url.

A similar discussion took place here: http://www.velocityreviews.com/forums…

How to: How do I download a file over HTTP using Python?

How do I download a file over HTTP using Python?

I have a small utility that I use to download an MP3 from a website on a schedule and then builds/updates a podcast XML file which I’ve obviously added to iTunes.

The text processing that creates/updates the XML file is written in Python. I use wget inside a Windows .bat file to download the actual MP3 however. I would prefer to have the entire…

I am continuing to poke around python this week looking the "standard way" to make HTTP requests and process HTTP responses. In Perl, there is the very complete LWP set of modules. In Java, there is the Apache HTTP client library. Python has several modules with related functionality, including httplib, urllib and urllib2 (which will change with Python 3.0).

What I need to do is create HTTP headers in the request and later read headers from the response. Oh, and I will want to look at the response's body too.

The code below makes an HTTP to a small PHP script I have on this server (use it as needed). It sets a header, which is echoed by the PHP script. Later all the headers from the response are also echoed.

One of the things I like about urllib2 is the Request class. In the things I want to do (web services, OAuth), it is very helpful to build the request and be able to inspect it apart from the mechanism that performs the HTTP fetch.

I've been using bottle.py a lot recently to quickly write REST-like APIs. I say 'REST-like' because at the moment they mostly only satisfy GET requests. Up until now actually. Now I want to write a full REST interface with support for GET, POST, PUT and DELETE.

As part of this I need the most basic of basic authentication on my server. I want to put a password on my POST, PUT and DELETE requests. I had a look at bottle-cork but it seemed overkill for what I needed. Digging into the bottle.py source code I found this little gem of a decorator called auth_basic(). So here is how you use it:

import bottle def check(user, passwd): if user == 'ben': return True return False @bottle.route('/') @bottle.auth_basic(check) def index(location): print 'auth', bottle.request.auth print 'remote_addr', bottle.request.remote_addr return "Yay - you made it!" if __name__ == '__main__': print "Starting server" bottle.run(host='0.0.0.0', port=8080, reloader=True)

That is a pretty simple demonstration. If you attempt to go to the page in a browser you will get a 401 Error back. To access the page in python, use this little code snippit from StackOverflow:

import urllib2, base64 (user, password) = ('ben', 'xyz') request = urllib2.Request("http://localhost:8080/") base64string = base64.encodestring('%s:%s' % (username, password)).replace('\n', '') request.add_header("Authorization", "Basic %s" % base64string) result = urllib2.urlopen(request) print result.read() 

And you should see "Yay - you made it" printed out.