| WebSeitz/wikilog |
| Data Store |
|
| last edited by BillSeitz on Mar 8, 2008 10:49 am |
Engine/platform for handling data.
For Structured Data or Semi Structured Data?
Can you get by with just the File System or a Hash Table?
How much do you care about Scalabil Ity? When/why do you move from Scaling Up to Scaling Out?
notes from 2002-2005
In particular I'm interested in non-RDBMS models, since Everything Is A Graph, and it would be useful for my Object Browser ideas (could use term "Data Base" but that implies RDBMS to most people).
see [Jim Menard] http://www.io.com/~jimm/writing/alternate_storage.html - When the Relational Hammer Whacks Your Thumb
RoundUp's [Hyper Database] (which sits on top of Berkeley D B)
Dave Mc Cusker wrote the MorkDb which has been used in various pieces of MozIlla. Nearly everything is representable as objects with attributes. Attributes are cells, objects are rows, tables are collections.
ZoPe's ZODB, which can be used on its own. (Transparent Object Persistence)
PyThon-specific lite persistence options
PyThon and prevalence systems (persist transactions)
Cog is the Checkpointed Object Graph object database, providing semi-transparent persistence for large sets of interrelated Python objects. It handles automatic loading of objects on reference, and saving of modified objects back to disk. http://www.randomly.org/projects/cog/ - see z2002-12-10- Cog Persistence
Paul Fernhout's Pointrel datastore (in PyThon and other languages). Description and project
http://www.thekompany.com/embedded/tkcrekall/
book's on Intelligent Database
MailMan's [Hyper Database]? No, the hyper is a reference to [Hyper Mail] archiving. There's nothing generic about the code.
The File System!
pro: data safety (not likely to lose entire data set); can easily use many existing file-processing tools
con/risk: overhead of thousands of tiny files; search/index performance (could use hybrid: put indexes in some separate binary structure (but then you can't use file-processing tools because the index can't stay in Data Synch with the base data, though maybe there are some narrow cases where that's [OK]).
logical file system design$7919
Also worth remembering
[Py S Q Lite] http://pysqlite.sourceforge.net/
ZigZag (Ted Nelson), Gzz/[FenFire] storm
[Object Oriented Data Base] - see WikiWikiWeb:LetsUseAnObjectOrientedDatabase
| User Options Recent Changes Help Page |