All Projects → finos → exodus

finos / exodus

Licence: Apache-2.0 license
Migration tools for Tabular Data to Oracle JSON/Tabular Data

Programming Languages

scheme
763 projects
PLSQL
303 projects
shell
77523 projects
Batchfile
5799 projects

Projects that are alternatives of or similar to exodus

code2pg
Tool to help migrate application code from Oracle to PostgreSQL
Stars: ✭ 18 (-5.26%)
Mutual labels:  oracle, migration
linkifier
Database reverse engineering
Stars: ✭ 32 (+68.42%)
Mutual labels:  schema, oracle
Experdb Db2pg
eXperDB-DB2PG is a data migration solution that transfers data extracted from various DBMSs to eXperDB or PostgreSQL. Currently, Oracle and Oracle Spatial, MySQL, SQL Server(MS-SQL) and Sybase data can be transferred.
Stars: ✭ 24 (+26.32%)
Mutual labels:  oracle, migration
pg global temp tables
Oracle-style global temporary tables for PostgreSQL
Stars: ✭ 16 (-15.79%)
Mutual labels:  oracle, migration
Mongo.migration
On-the-fly migrations with MongoDB C# Driver
Stars: ✭ 99 (+421.05%)
Mutual labels:  schema, migration
Fluentmigrator
Fluent migrations framework for .NET
Stars: ✭ 2,636 (+13773.68%)
Mutual labels:  oracle, migration
upscheme
Database migrations and schema updates made easy
Stars: ✭ 737 (+3778.95%)
Mutual labels:  schema, migration
migrana
Migrana is a Datomic migration tool that gives you the control over how your Datomic database evolves.
Stars: ✭ 22 (+15.79%)
Mutual labels:  schema, migration
transferdb
TransferDB 支持异构数据库 schema 转换、全量数据导出导入以及增量数据同步功能( Oracle 数据库 -> MySQL/TiDB 数据库)
Stars: ✭ 30 (+57.89%)
Mutual labels:  schema, oracle
schema-builder
Laravel/Lumen schema builder & migration generator
Stars: ✭ 51 (+168.42%)
Mutual labels:  schema, migration
Goose
A database migration tool. Supports SQL migrations and Go functions.
Stars: ✭ 2,112 (+11015.79%)
Mutual labels:  schema, migration
Fireway
A schema migration tool for firestore
Stars: ✭ 100 (+426.32%)
Mutual labels:  schema, migration
E Commerce Db
Database schema for e-commerce (webstores) sites.
Stars: ✭ 245 (+1189.47%)
Mutual labels:  schema, oracle
go2gql
graphql-go schema generator by proto files
Stars: ✭ 33 (+73.68%)
Mutual labels:  schema
garn-validator
Create validations with ease
Stars: ✭ 42 (+121.05%)
Mutual labels:  schema
graphql-compose-dataloader
Add DataLoader to graphql-composer resolvers.
Stars: ✭ 18 (-5.26%)
Mutual labels:  schema
schema-voyager
Visualize Datomic schema
Stars: ✭ 15 (-21.05%)
Mutual labels:  schema
weblogic honeypot
WebLogic Honeypot is a low interaction honeypot to detect CVE-2017-10271 in the Oracle WebLogic Server component of Oracle Fusion Middleware. This is a Remote Code Execution vulnerability.
Stars: ✭ 30 (+57.89%)
Mutual labels:  oracle
dbmisc
Tools for working with databases in R
Stars: ✭ 24 (+26.32%)
Mutual labels:  schema
metastore
A protobuf schema registry on steroids. It will keep track of the contracts throughout your organization, making sure no contract is broken.
Stars: ✭ 43 (+126.32%)
Mutual labels:  schema

EXODUS : Map > Document > Migrate > JSON & Tables

alt text

FINOS - Incubating

EXODUS - Migration Tools

Exodus is a mapping, documenting, and migration tool that has been especially designed with Oracle PL/SQL developers in mind, with particular focus on transporting tabular data into a JSON centric storage paradigm. If you are comfortable with Oracle PL/SQL then all your mapping and migration code can be constructed here without the need for non-Oracle external tools. There is no magic “black box” behavior. All of the auto-generated code (also in PL/SQL) is made available and viewable from within the tool, and because it’s in a language that seasoned Oracle developers are expert in, there will be no unexpected surprises with the technical approach.
It’s entirely possible to use Exodus to “just” document your mapping efforts (it will certainly be far less stressful and error prone than using a spreadsheet to capture mappings and relationships). With just a basic understanding of the tool tables you can write your own SQL reports to get information about how much you’ve mapped (in other words, report on SOURCE data that you have understood enough to express a connection to the target end state) in your migration.
Exodus can be used to do far more than documenting the migration. Exodus can form the core nucleus of your migration where all of the steps required to take data from a set of source tables to a set of target tables in multiple schemas can be defined and coded. Exodus can map table-to-table and table-to-JSON documents. You will be able to capture comments, questions, value translations, functions, and even SQL code to drive your migration.
There is an extensive run framework (including logging, introspection, and debugging instrumentation) to execute your migration to any level of concurrency that your hardware and licenses can support to maximize your compute resource.

Installation

Linux:

Verify your Oracle DB is set to EXTENDED data types Connect with a correctly privileged account.

SELECT value FROM v$parameter where name = 'max_string_size';

Run the SQL above it MUST return "EXTENDED". If it returns "STANDARD" then you CANNOT deploy this migration suite.

Update config file. Notable things to set are..

deploy_usr="pre_etl_owner"      * Leave this as pre_etl_owner.
deploy_pwd="pre_etl_owner"      * Whatever password you want pre_etl_owner to have.

admin_usr="admin"               * The high privilege account.  Could be SYS. (on AWS its admin).
admin_pwd="admin1234"           * The password for the high privilege account.
admin_ext=""                    * If you are using SYS in admin_usr then this needs to be "AS SYSDBA".

stg_types="DEMO"                * The staging contexts (might just be PROD).
                                  Comma separated.

temp_ts="TEMP"                  * The Temp TS (most likely left as TEMP).
tool_ts="TS_MIGTOOL"            * The Tools TS.       
                                  (whatever TableSpace you have created for the Tool)
stg_ts="TS_STAGED"              * The staging data TS.
                                  (whatever TableSpace you have created for the Staged Data)

target_db="MYDB"                * The db to connect to for deployment.  Your DB.

Run the shell script.

. deploy_master.sh

Video Guides

Imgur Imgur Imgur Imgur Imgur

Please take a look at the WIKI for further information.

Coming Soon !

  • Backing Up & Restoring Metadata
  • Transporting Metadata to Target Run-Platforms
  • Search tools
  • Handling and debugging migration errors Restarting
  • Introspection

Exodus : YouTube Channel

Installing Oracle Forms 12.2.1.4

Installing The Exodus Forms

Application Screenshots

Imgur

Usage example

See the supplied Exodus Manual.docx

Development setup

You will need an Oracle Database (12.1.0.2 or higher), and an Oracle Forms 11g (or higher) installation ( see : Installing Oracle Forms 12.2.1.4 ).

Contributing

We hope the community finds these tools useful. We welcome contributions in the form of request for changes; these can be submitted via GitHub issues. Feel free to look through the code base and submit a pull request. And if you like what you see maybe give the project a star in Github.

License

Copyright 2018 IHS Markit

Distributed under the Apache License, Version 2.0.

SPDX-License-Identifier: Apache-2.0

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].