595 Open source projects that are alternatives of or similar to PDAP-Scrapers

Using this tool you can easily add so many members from any group to your group. Less than 2 minutes. Super easy. Time saver. But this tool is only for educational purpose. You could be banned from Telegram. So be careful. Recommanded to use this tool only on Termux.

By serving course 📚 data that is more "edible" 🍰 for developers, we hope CourseCake offers a smooth approach to build useful tools for students.

A lib to transform data from jdbc,csv,json to ecah other.

ProxyCrawl Python library for scraping and crawling

Instagram get images 🌄 (hashtags, account, locations) with puppeteer

☁️ nodejs kafka connect connector for Google BigQuery

一款基于kettle的数据处理web调度控制平台，支持文档资源库和数据库资源库，通过web平台控制kettle数据转换，可作为中间件集成到现有系统中

Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple categories of transformation rules.

robots.txt file parsing and checking for R

Monitors for restocks

Web scraper for grabing data from Linkedin profiles or company pages (personal project)

Python API to extract data from rateyourmusic.com.

No description or website provided.

ETL for the NASDAQ symbol file

A free TVTime API based on scraping TVTime website. No API key required

Data ETL & Analysis on the global and Mexican datasets of the COVID-19 pandemic.

A CLI and library to run Singer Taps and Targets

Tools for downloading agendas, minutes and other documents produced by local government

A COBOL parser and Mainframe/EBCDIC data source for Apache Spark

Download public videos on TikTok using Python with Selenium

Create a ZIM file from a Youtube channel/username/playlist

Scrape all the media from an OnlyFans account - Updated regularly

A Go scraper that validates security.txt files and outputs them in the disclose.io JSON format.

Retrieve real (with Javascript executed) HTML code from an URL, ultra fast and supports multiple parallel loading of webs

🔄 Simple tool for ETL. From SQL to Redis.

数据质量控制系统

CVparser is software for parsing or extracting data out of CV/resumes.

Scrapers for many e-SAJ systems

Scraper for downloading the entire ebooks repository of project Gutenberg

Scrapes VK user's photos

Node.js based scraper using headless chrome

Page metadata as a service

Monitor instagram user account and automatically post new images to discord channel via a webhook. Working 2022!

Search and download mangas from the command line

At present contains scraped data from around 1500 problems present on the site. More to follow....

code, labs and lectures for the course

❄️ Extract links, ids, and names from a youtube playlist

CubETL - Framework and tool for data ETL (Extract, Transform and Load) in Python (PERSONAL PROJECT / SELDOM MAINTAINED)

Home Assistant custom component for scraping (html, xml or json) multiple values (from a single HTTP request) with a separate sensor/attribute for each value. Support for (login) form-submit functionality.

A PHP Scraping Class

csvplus extends the standard Go encoding/csv package with fluent interface, lazy stream operations, indices and joins.

Configurable data bridge for permanent ETL jobs

Extract rich metadata from URLs

京东App自动登录，在线商品自动下单

ETL jobs for Firefox Telemetry

A data transformation package for deep learning with Autonomio, Keras and TensorFlow.

StackExchange websites to ZIM scraper

No description or website provided.

Download subreddit comments

Wget-AT is a modern Wget with Lua hooks, Zstandard (+dictionary) WARC compression and URL-agnostic deduplication.

💾 YouTube video metadata archiver written in Golang

There was no free Dictionary API on the web when I wanted one for my friend, so I created one.

在线爬虫，online web scraper

The Move to Islandora Kit is an extensible PHP command-line tool for converting source content and metadata into packages suitable for importing into Islandora (or other digital repository and preservations systems).

A scalable general purpose micro-framework for defining dataflows. You can use it to create dataframes, numpy matrices, python objects, ML models, etc.

A simple web scraper built around the JavaFX WebEngine

bqloader is a simple ETL framework to load data from Cloud Storage into BigQuery.

A monadic web scraping library

EtlFlow is an ecosystem of functional libraries in Scala based on ZIO for writing various different tasks, jobs on GCP and AWS.

Open bank data for Leumi bank and Leumi card credit card