Rafael Darder Calvo darder at gmail.com
Sun Jun 10 17:44:00 EDT 2007

• Previous message (by thread): memory efficient set/dictionary
• Next message (by thread): memory efficient set/dictionary
• Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]

---

> > > Please recommend a module that allows persistent set/dict storage +
> > > fast query that best fits my problem,
> >
> > What is the problem you are trying to solve? How many keys do you have?
>
> Corpus processing. There are in the order of billions to tens of
> billions keys (64bit integers).
>
I would recommend you to use a database since it meets your
requirements (off-memory, fast, persistent). The bsdddb module
(berkeley db) even gives you a dictionary like interface.
http://www.python.org/doc/lib/module-bsddb.html

regards,
Rafa

---

• Previous message (by thread): memory efficient set/dictionary
• Next message (by thread): memory efficient set/dictionary
• Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]

---

More information about the Python-list mailing list