mercredi 14 janvier 2015

Databases and how to deal with filesystems maximum filesize

I have to insert large data sets into a database, which would result in a database of the size of around 300GB. This would be completely fine with a sqlite3 database, as it can handle around 140TB (as stated here). However, I reach the filesystems maximum filesize which is 32GB.



  • What is a good style of dealing with such a large dataset concerening the database- filesystem relation?

  • Should I create several databases, say, for example a database per year?

  • Is there any option of partitioning the database in sqlite3 or other any other database management system?


Aucun commentaire:

Enregistrer un commentaire