sql-to-redis
Very simple Java app. My first usage of JavaFx. Created for my tests and development reasons. Sql-to-redis can be used to export and transform data from SQL tables to Redis key-value.
How to run:
- (optional) Get the latest JRE from Oracle website.
- (optional) If you are using OpenJDK (instead of OracleJDK) you probably have to install javafx packages (they are not included by default in OpenJDK), for Debian/Ubuntu this should help:
aptitude install openjfx
- Get latest sql-to-redis JAR file from releases
- Just check Java version (should be "1.8.0_112" or greater):
user@localhost:~$ java -version
- Go to downloaded JAR file and run command:
java -jar sql-to-redis.jar
- JDBC for:
-
MYSQL: jdbc:mysql://HOST:PORT/DBNAME
-
PostgreSQL: jdbc:postgresql://HOST:PORT/DBNAME
DB support:
| SQL databases | Support |
|---|---|
| PostgreSQL | Yes |
| MySQL | Yes |
| Oracle | Not yet |
| SQL Server | Not yet |
Details:
- all queries run using Connection/ResultSets classes
- fetchSize of Statement is hardcoded and it is set to 40,000 rows (import 7 milion rows takes few minutes, but if you have bigger tables you can decrease this value)
- all connections to sql use Connection class from DriverManager
- all imports are run as background task , threads
How to use:
- prepare connection string and setup sql/redis hosts,
- choose table to import,
- modify (if you want) JSON schema
- choose redis key name (default value is table name)
- choose redis suffix (value should be unique if not then you will override previouse keys, you can choose column value - so your SQL PK can be saved, default value is autoincrement id from loop)
- in JSON schema, all
$$words$$ are variables, they will be replaced on the fly with row values
Thanks for drivers/dbs to:
- Jedis (https://github.com/xetorthio/jedis),
- PostgreSQL,
- Redis.