es2postgresElasticSearch to PostgreSQL loader
Stars: ✭ 18 (-28%)
Discord feedbotMoved to https://gitlab.com/ffreiheit/discord_feedbot
Stars: ✭ 67 (+168%)
Bulk WriterProvides guidance for fast ETL jobs, an IDataReader implementation for SqlBulkCopy (or the MySql or Oracle equivalents) that wraps an IEnumerable, and libraries for mapping entites to table columns.
Stars: ✭ 210 (+740%)
AtomaAtom, RSS and JSON feed parser for Python 3
Stars: ✭ 67 (+168%)
astroAstro allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.
Stars: ✭ 79 (+216%)
Raspberry Osmc AutomatedMedia center (OSMC) with automated TV Shows and subtitles download. Once configured, sit and watch TV.
Stars: ✭ 57 (+128%)
Hale(Spatial) data harmonisation with hale studio (formerly HUMBOLDT Alignment Editor)
Stars: ✭ 84 (+236%)
DataXServer为DataX(https://github.com/alibaba/DataX) 提供远程多语言调用(ThriftServer,HttpServer) 分布式运行(DataX on YARN) 功能
Stars: ✭ 130 (+420%)
HuginnCreate agents that monitor and act on your behalf. Your agents are standing by!
Stars: ✭ 33,694 (+134676%)
simsttabSimple timetabling engine for schools
Stars: ✭ 21 (-16%)
Hfeed2atomPython functions to convert a h-feed to Atom 1.0
Stars: ✭ 11 (-56%)
SaynData processing and modelling framework for automating tasks (incl. Python & SQL transformations).
Stars: ✭ 79 (+216%)
LifereaLiferea (Linux Feed Reader), a news reader for GTK/GNOME
Stars: ✭ 612 (+2348%)
maxwell-sinkconsume maxwell generated message from kafka,export it to another mysql.
Stars: ✭ 16 (-36%)
News📰 RSS/Atom feed reader
Stars: ✭ 524 (+1996%)
CqlCategorical Query Language IDE
Stars: ✭ 196 (+684%)
Python FeedgenPython module to generate ATOM feeds, RSS feeds and Podcasts.
Stars: ✭ 501 (+1904%)
Jquery RssAn easy-to-use rss plugin for jquery with templating.
Stars: ✭ 443 (+1672%)
DataspherestudioDataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.
Stars: ✭ 1,195 (+4680%)
Front End Rss📙 根据 RSS 抓取最新前端技术文章,来源:前端早读课、前端大全、前端之巅、淘宝前端、张鑫旭博客、凹凸实验室等
Stars: ✭ 418 (+1572%)
dswarman open-source data management platform for knowledge workers (https://github.com/dswarm/dswarm-documentation/wiki)
Stars: ✭ 57 (+128%)
Stream DjangoDjango Client - Build Activity Feeds & Streams with GetStream.io
Stars: ✭ 415 (+1560%)
Transmission RssAdds torrents from RSS feeds to Transmission web frontend
Stars: ✭ 348 (+1292%)
Luigi WarehouseA luigi powered analytics / warehouse stack
Stars: ✭ 72 (+188%)
PodcastgeneratorOpen Source Podcast Publishing Solution since 2006
Stars: ✭ 344 (+1276%)
dflibIn-memory Java DataFrame library
Stars: ✭ 50 (+100%)
Elixir ScrapeScrape any website, article or RSS/Atom Feed with ease!
Stars: ✭ 306 (+1124%)
Mongo EsA MongoDB to Elasticsearch connector
Stars: ✭ 185 (+640%)
FreshrssA free, self-hostable aggregator…
Stars: ✭ 3,793 (+15072%)
mydataharbor🇨🇳 MyDataHarbor是一个致力于解决任意数据源到任意数据源的分布式、高扩展性、高性能、事务级的数据同步中间件。帮助用户可靠、快速、稳定的对海量数据进行准实时增量同步或者定时全量同步,主要定位是为实时交易系统服务,亦可用于大数据的数据同步(ETL领域)。
Stars: ✭ 28 (+12%)
Infomate.clubRSS feed collections with article summarization
Stars: ✭ 255 (+920%)
DataBridge.NETConfigurable data bridge for permanent ETL jobs
Stars: ✭ 16 (-36%)
feeds-to-pocketSends entries from RSS and Atom feeds to Pocket (https://getpocket.com)
Stars: ✭ 24 (-4%)
cobrixA COBOL parser and Mainframe/EBCDIC data source for Apache Spark
Stars: ✭ 109 (+336%)
microblogA very simple PHP app that stores twitter-like status updates in a sqlite database.
Stars: ✭ 30 (+20%)
Etl with pythonETL with Python - Taught at DWH course 2017 (TAU)
Stars: ✭ 68 (+172%)
Feedly-Export-Save4LaterWorking script for latest feedly design. Including title, url, summary, time, sourceTitle & sourceUrl
Stars: ✭ 23 (-8%)
DaFlowApache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple categories of transformation rules.
Stars: ✭ 24 (-4%)
modx-instagram-latest-postsThis snippet allows us to get the latest posts of any Instagram user. Access tokens are NOT required.
Stars: ✭ 20 (-20%)
mikThe Move to Islandora Kit is an extensible PHP command-line tool for converting source content and metadata into packages suitable for importing into Islandora (or other digital repository and preservations systems).
Stars: ✭ 32 (+28%)
atomLibrary for serializing the Atom web content syndication format https://crates.io/crates/atom_syndication
Stars: ✭ 68 (+172%)
wikirepoPython based Wikidata framework for easy dataframe extraction
Stars: ✭ 33 (+32%)
IITP-ConnectThe Android app for the IIT Patna student community by the student community. 📱
Stars: ✭ 22 (-12%)
DIRECTDIRECT, the Data Integration Run-time Execution Control Tool, is a data logistics framework that can be used to monitor, log, audit and control data integration / ETL processes.
Stars: ✭ 20 (-20%)
TransformalizeConfigurable Extract, Transform, and Load
Stars: ✭ 125 (+400%)
DatavecETL Library for Machine Learning - data pipelines, data munging and wrangling
Stars: ✭ 272 (+988%)
gtfstidyA tool for checking, sanitizing and minimizing GTFS feeds.
Stars: ✭ 75 (+200%)