All Projects → pboehm → django-data-migration

pboehm / django-data-migration

Licence: MIT license
Data migration framework for Django that migrates legacy data into your new django app

Programming Languages

python
139335 projects - #7 most used programming language

Labels

Projects that are alternatives of or similar to django-data-migration

dbt-databricks
A dbt adapter for Databricks.
Stars: ✭ 115 (+538.89%)
Mutual labels:  etl
neo4j-jdbc
JDBC driver for Neo4j
Stars: ✭ 110 (+511.11%)
Mutual labels:  etl
BETL-old
BETL. Meta data driven ETL generation using T-SQL
Stars: ✭ 17 (-5.56%)
Mutual labels:  etl
chronicle-etl
📜 A CLI toolkit for extracting and working with your digital history
Stars: ✭ 78 (+333.33%)
Mutual labels:  etl
dtd2mysql
MySQL / MariaDB import for DTD feeds (fares, timetable and routeing)
Stars: ✭ 25 (+38.89%)
Mutual labels:  etl
iex-stocks
ETL for the IEX Stocks API
Stars: ✭ 19 (+5.56%)
Mutual labels:  etl
krawler
A minimalist (geospatial) ETL
Stars: ✭ 51 (+183.33%)
Mutual labels:  etl
naas
⚙️ Schedule notebooks, run them like APIs, expose securely your assets: Jupyter as a viable ⚡️ Production environment
Stars: ✭ 219 (+1116.67%)
Mutual labels:  etl
link-move
A model-driven dynamically-configurable framework to acquire data from external sources and save it to your database.
Stars: ✭ 32 (+77.78%)
Mutual labels:  etl
zdh server
数据采集平台zdh,etl 处理服务
Stars: ✭ 53 (+194.44%)
Mutual labels:  etl
DataX-src
DataX 是异构数据广泛使用的离线数据同步工具/平台,实现包括 MySQL、Oracle、SqlServer、Postgre、HDFS、Hive、ADS、HBase、OTS、ODPS 等各种异构数据源之间高效的数据同步功能。
Stars: ✭ 21 (+16.67%)
Mutual labels:  etl
wikirepo
Python based Wikidata framework for easy dataframe extraction
Stars: ✭ 33 (+83.33%)
Mutual labels:  etl
FlowMaster
ETL flow framework based on Yaml configs in Python
Stars: ✭ 19 (+5.56%)
Mutual labels:  etl
pentaho-gis-plugins
🗺 GIS plugins for Pentaho Data Integration
Stars: ✭ 42 (+133.33%)
Mutual labels:  etl
YaEtl
Yet Another ETL in PHP
Stars: ✭ 60 (+233.33%)
Mutual labels:  etl
DIRECT
DIRECT, the Data Integration Run-time Execution Control Tool, is a data logistics framework that can be used to monitor, log, audit and control data integration / ETL processes.
Stars: ✭ 20 (+11.11%)
Mutual labels:  etl
awesome-integration
A curated list of awesome system integration software and resources.
Stars: ✭ 117 (+550%)
Mutual labels:  etl
morph-kgc
Powerful RDF Knowledge Graph Generation with [R2]RML Mappings
Stars: ✭ 77 (+327.78%)
Mutual labels:  etl
google-sheets-etl
Live import all your Google Sheets to your data warehouse
Stars: ✭ 15 (-16.67%)
Mutual labels:  etl
openrefine-batch
Shell script to run OpenRefine in batch mode (import, transform, export). It orchestrates OpenRefine (server) and a python client that communicates with the OpenRefine API.
Stars: ✭ 76 (+322.22%)
Mutual labels:  etl

django-data-migration

Build Status Coverage PyPi version PyPi downloads License

django-data-migration is a reusable Django app that migrates your legacy data into your new django app. The only thing you have to supply is an appropriate SQL query that transforms your data from the old schema into your model structure. Dependencies between these migrations will be resolved automatically. Give it a try!

This extension is tested automatically against:

  • Django 1.5
  • Django 1.6
  • Django 1.7

on Python 2.7, 3.3 and 3.4.

Python 3.2 is not supported, due to a SyntaxError in the future library which is used to support both Python 2 and 3.

Installation

  1. Install using pip:

    pip install django-data-migration
    
  2. Add to INSTALLED_APPS:

    'data_migration',
    
  3. Run ./manage.py migrate or ./manage.py syncdb to create the included models

Alternatively, you can add django-data-migration to your requirements.txt.

Documentation

The documentation of django-data-migration is built by sphinx and can be edited in the docs/ directory of this project.

Go to the Documentation on Read The Docs

Status of project

This app has been extracted out of a production system and some work has been done, to write tests and refactor code. The project documentation is a work in progress.

Start participating

  • Fork the project on Github and clone it locally
  • Install Python 2.7 and 3.3, virtualenv and tox
  • Run the tests with tox against all supported versions of Python
  • Create a Pull Request on Github
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].