Home Original page

Efficient MD5 (or similar) hashes

Kamus of Kadizhar yan at NsOeSiPnAeMr.com
Sun Dec 7 19:49:58 EST 2003 
ANother newbie question:

I have large files I'm dealing with.  Some 600MB -1.2 GB in size, over a 
slow network.  Transfer of one of these files can take 40 minutes or an 
hour.

I want to check the integrity of the files after transfer.  I can check 
the obvious - date, file size - quickly, but what if I want an MD5 hash?

 From reading the python docs, md5 reads the entire file as a string. 
That's not practical on a 1 GB file that's network mounted.

The only thing I can think of is to set up an inetd daemon on the server 
that will spit out the md5 hash if given the file path/name.

Any other ideas?

-Kamus

-- 
What am I on?
I'm on my bike,                         o__
6 hours a day, busting my ass.          ,>/'_
What are you on? --Lance Armstrong     (_)\(_)
More information about the Python-list mailing list