samedi 24 octobre 2015

Using odo to migrate data to SQL

I have a large file 3gb so im using Blaze to investigate the data, select down to the data im interesting in analyzing, with the goal to migrate that data into a suitable computational backend such as SQlite, postgres etc.

import pandas as pd from blaze import CSV, Table, Data from odo import odo df = pd.read_csv('report_2015.csv') bdata = Data(df) now this is the part im having trouble with

db = odo(bdata, 'sqlite:///report.db::report')

not sure how to properly create a db file to open with sqlite.

Aucun commentaire:

Enregistrer un commentaire