All Projects → CreditEaseDBA → Themis

CreditEaseDBA / Themis

Licence: apache-2.0
数据库审核平台

Projects that are alternatives of or similar to Themis

Sqlfiddle3
New version based on vert.x and docker
Stars: ✭ 242 (-22.68%)
Mutual labels:  oracle, sql, mysql
Sqlfaker
轻量级、易拓展的数据库智能填充Java开源库
Stars: ✭ 109 (-65.18%)
Mutual labels:  oracle, sql, mysql
Ddlparse
DDL parase and Convert to BigQuery JSON schema and DDL statements
Stars: ✭ 52 (-83.39%)
Mutual labels:  oracle, sql, mysql
Fluentmigrator
Fluent migrations framework for .NET
Stars: ✭ 2,636 (+742.17%)
Mutual labels:  oracle, sql, mysql
Jsqlparser
JSqlParser parses an SQL statement and translate it into a hierarchy of Java classes. The generated hierarchy can be navigated using the Visitor Pattern
Stars: ✭ 3,405 (+987.86%)
Mutual labels:  oracle, sql, mysql
Eosio sql plugin
EOSIO sql database plugin
Stars: ✭ 21 (-93.29%)
Mutual labels:  oracle, sql, mysql
E Commerce Db
Database schema for e-commerce (webstores) sites.
Stars: ✭ 245 (-21.73%)
Mutual labels:  oracle, sql, mysql
Openrecord
Make ORMs great again!
Stars: ✭ 474 (+51.44%)
Mutual labels:  oracle, sql, mysql
Rom Sql
SQL support for rom-rb
Stars: ✭ 169 (-46.01%)
Mutual labels:  oracle, sql, mysql
Sqlcheck
Automatically identify anti-patterns in SQL queries
Stars: ✭ 2,062 (+558.79%)
Mutual labels:  oracle, sql, mysql
Ezsql
PHP class to make interacting with a database ridiculusly easy
Stars: ✭ 804 (+156.87%)
Mutual labels:  oracle, sql, mysql
Xo
Command line tool to generate idiomatic Go code for SQL databases supporting PostgreSQL, MySQL, SQLite, Oracle, and Microsoft SQL Server
Stars: ✭ 2,974 (+850.16%)
Mutual labels:  oracle, sql, mysql
Smartsql
SmartSql = MyBatis in C# + .NET Core+ Cache(Memory | Redis) + R/W Splitting + PropertyChangedTrack +Dynamic Repository + InvokeSync + Diagnostics
Stars: ✭ 775 (+147.6%)
Mutual labels:  oracle, sql, mysql
Liquibase
Main Liquibase Source
Stars: ✭ 2,910 (+829.71%)
Mutual labels:  oracle, sql, mysql
Sqlinjectionwiki
A wiki focusing on aggregating and documenting various SQL injection methods
Stars: ✭ 623 (+99.04%)
Mutual labels:  oracle, sql, mysql
Ebean
Ebean ORM
Stars: ✭ 1,172 (+274.44%)
Mutual labels:  oracle, sql, mysql
Dbeaver
Free universal database tool and SQL client
Stars: ✭ 23,752 (+7488.5%)
Mutual labels:  oracle, sql, mysql
Jooq
jOOQ is the best way to write SQL in Java
Stars: ✭ 4,695 (+1400%)
Mutual labels:  oracle, sql, mysql
Kangaroo
SQL client and admin tool for popular databases
Stars: ✭ 127 (-59.42%)
Mutual labels:  oracle, sql, mysql
Linq2db
Linq to database provider.
Stars: ✭ 2,211 (+606.39%)
Mutual labels:  oracle, sql, mysql

Themis

介绍

Themis,是宜信公司DBA团队开发的一款数据库审核产品。可帮助DBA、开发人员快速发现数据库质量问题,提升工作效率。

快速开始

注:mongo、redis、mysql都需要预先安装,mongo用来存储数据,redis用来作为celery的调度队列,mysql用来存储pt-query-digest的分析结果,如果大家对python不是很熟悉,强烈建议按照下面的步骤安装,关于mongo的启动,在测试环境建议直接使用root用户用mongod启动不要使用认证,生产环境可以加上认证,加上认证后用户连接需要授权,具体的用户授权方式请自行搜索

如果只想针对mysql数据库进行审核请参考dev分支:https://github.com/CreditEaseDBA/Themis/tree/dev

导入规则

mongoimport -h 127.0.0.1 --port 27017 -d sqlreview -c rule --file script/rule.json

根据实际情况配置账号密码,建议-d选项使用sqlreview,-c使用默认的rule

新建用户

注:下面的操作除了安装virtualenv在root用户下操作,其他都建议在themis-test用户下操作。celery在root用户启动时需要增加特殊配置。

adduser themis-test
su - themis-test

下载代码

git clone https://github.com/CreditEaseDBA/Themis

安装virtualenv最新版链接

创建虚拟环境:

cd /home/themis-test
virtualenv python-project --python=python2.7

初始化虚拟环境

source /home/themis-test/python-project/bin/activate

安装cx_Oracle的依赖项,参考

安装依赖包:

对于使用python2.6的用户,请安装importlib-1.0.3.tar.gz

tar -zxvf importlib-1.0.3.tar.gz
cd importlib-1.0.3
python setup.py install

安装其他依赖:

cd /home/themis-test/Themis
pip install -r requirement.txt

单独安装PyH==0.1,参考PyH

unzip pyh-master.zip
cd pyh-master
python setup.py install

配置settings.py文件包括oracle、mysql、redis、mongo、pt-query-digest存储数据的帐号密码

配置mongo

MONGO_SERVER = "127.0.0.1"
MONGO_PORT = 27017
MONGO_USER = ""
MONGO_PASSWORD = ""
MONGO_DB = "sqlreview"

运行命令

cd /home/themis-test/Themis
supervisord -c script/supervisord.conf

访问 http://ip:7000/ 是审核平台的管理页面,在这里暂时只能对对象类规则进行审核,其他类规则需要采集数据后才可以进行审核。

注: 针对上面安装virtualenv和依赖包时网络不通的情况可以从此处下载,提取码 3sy3,下载后解压然后运行下面的命令安装依赖包

pip install --no-index -f file:///home/themis-test/software -r requirement.txt

file:///home/themis-test/software指定安装包的位置

如有问题可以参考: https://tuteng.gitbooks.io/themis/content/chang-jian-wen-ti.html

WIKI

https://tuteng.gitbooks.io/themis/content/

正在完善

联系方式

EMail: [email protected]

微信群:

微信

qq群:

qq

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].