All Projects → WeBankBlockchain → Data-Export

WeBankBlockchain / Data-Export

Licence: Apache-2.0 license
Data-Export支持将链上数据导出到MySQL、ES等便于进行大数据处理的存储介质中,解决区块链数据复杂查询、分析、可视化和处理的问题。

Programming Languages

java
68154 projects - #9 most used programming language
shell
77523 projects
solidity
1140 projects

Projects that are alternatives of or similar to Data-Export

Data-Reconcile
Data-Reconcile是一款基于区块链的对账组件,提供基于区块链智能合约账本的通用化数据对账解决方案,并提供了一套可动态扩展的对账框架,支持定制化开发。
Stars: ✭ 24 (-35.14%)
Mutual labels:  consortium, data-governance, webank-blockchain
Data-Stash
Data-Stash是基于FISCO-BCOS的数据仓库组件,通过解析节点的binlog日志,生成该节点状态的全量备份,从而使节点能够实现冷热数据分离和数据裁剪。
Stars: ✭ 27 (-27.03%)
Mutual labels:  consortium, data-governance, webank-blockchain
xavc rtmd2srt
Extract real time meta-data and GPS tracks from Sony XAVC video
Stars: ✭ 29 (-21.62%)
Mutual labels:  export
pockexport
Export/access your Pocket data, including highlights!
Stars: ✭ 124 (+235.14%)
Mutual labels:  export
importer-exporter
3D City Database client for high-performance import and export of 3D city model data
Stars: ✭ 104 (+181.08%)
Mutual labels:  export
Samples-JS-PHP
JavaScript and PHP samples for Stimulsoft Reports.PHP reporting tool.
Stars: ✭ 17 (-54.05%)
Mutual labels:  export
datacatalog-tag-manager
Python package to manage Google Cloud Data Catalog tags, loading metadata from external sources -- currently supports the CSV file format
Stars: ✭ 17 (-54.05%)
Mutual labels:  data-governance
connect-backup
A tool to backup and restore AWS Connect, with some useful other utilities too
Stars: ✭ 19 (-48.65%)
Mutual labels:  export
ProcessMigrator
ProcessWire module that facilitates automated migration and sharing of page trees along with their templates and fields.
Stars: ✭ 29 (-21.62%)
Mutual labels:  export
sync-magento-2-migration
Release of rough proof of concept from 2018 that allows to import and export millions of products quickly
Stars: ✭ 51 (+37.84%)
Mutual labels:  export
svelte-datagrid
Svelte data grid spreadsheet best best features and performance from excel
Stars: ✭ 48 (+29.73%)
Mutual labels:  export
blender-xray
STALKER (aka xray-engine) import/export plugin for Blender 3D
Stars: ✭ 132 (+256.76%)
Mutual labels:  export
genshin-audio-exporter
Export audio files from Genshin Impact game data into different audio formats.
Stars: ✭ 83 (+124.32%)
Mutual labels:  export
calcardbackup
calcardbackup: moved to https://codeberg.org/BernieO/calcardbackup
Stars: ✭ 67 (+81.08%)
Mutual labels:  export
django-export-action
Generic export action for Django's Admin
Stars: ✭ 47 (+27.03%)
Mutual labels:  export
filefy
A javascript library to produce downloadable files such as in CSV, PDF, XLSX, DOCX formats
Stars: ✭ 39 (+5.41%)
Mutual labels:  export
format-imports-vscode
Format imports and exports for JavaScript and TypeScript in VS Code.
Stars: ✭ 60 (+62.16%)
Mutual labels:  export
exitwp-for-hugo
Exitwp is tool primarily aimed for making migration from one or more Wordpress blogs to the Hugo blog engine as easy as possible.
Stars: ✭ 43 (+16.22%)
Mutual labels:  export
Reports.JS
Stimulsoft Reports.JS is a reporting tool for Node.js and JavaScript applications.
Stars: ✭ 33 (-10.81%)
Mutual labels:  export
officeexport-java
三行代码导出自定义样式word
Stars: ✭ 68 (+83.78%)
Mutual labels:  export

WeBankBlockchain-Data-Export

License

穿花度柳飞如箭, 粘絮寻香似落星。 小小微躯能负重, 器器薄翅会乘风。 -- 吴承恩

WeBankBlockchain-Data-Export 是一个基于FISCO-BCOS平台的数据导出工具。

数据导出组件WeBankBlockchain-Data-Export的目的在于降低获取区块链数据的开发门槛,提升研发效率。研发人员几乎不需要编写任何代码,只需要进行简单配置,就可以把数据导出到Mysql数据库。

WeBankBlockchain-Data-Export可以导出区块链上的基础数据,如当前块高、交易总量等。如果配置了FISCO-BCOS上运行合约的相关信息,还可导出链上合约的业务数据,包括event、构造函数、合约地址、执行函数的信息等。

此版本只支持FISCO BCOS 2.0及以上版本。

关键特性

  • 支持JSON-RPC、Channel通道、数据仓库源等方式导出数据

  • 支持服务和docker方式部署

  • 支持多数据源,支持分库分表

  • 支持ES存储

  • 支持多活部署,多节点自动导出

  • 支持自定义导出数据内容

  • 提供SDK的集成方式

  • 支持可视化的监控页面

环境要求

在使用本组件前,请确认系统环境已安装相关依赖软件,清单如下:

依赖软件 说明 备注
FISCO-BCOS >= 2.0, 1.x版本请参考V0.5版本 dev分支
Bash 需支持Bash(理论上来说支持所有ksh、zsh等其他unix shell,但未测试)
Java JDK[1.8]
Git 下载的安装包使用Git
MySQL >= mysql-community-server[5.7] 理论上来说支持主流数据库,但未测试
zookeeper >= zookeeper[3.4] 只有在进行集群部署的时候需要安装
docker >= docker[18.0.0] 只有需要可视化监控页面的时候才需要安装
ElasticSearch >= elasticsearch [7.0] 只有在需要ES存储时安装

文档

贡献代码

欢迎参与本项目的社区建设:

  • 如项目对您有帮助,欢迎点亮我们的小星星(点击项目右上方Star按钮)。
  • 欢迎提交代码(Pull requests)。
  • 提问和提交BUG
  • 如果发现代码存在安全漏洞,请在这里上报。

License

license

开源协议为Apache License 2.0. 详情参考LICENSE

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].