340 Open source projects that are alternatives of or similar to Babler

Command line program to download documents from web portals.

在 Issues 中建立的个人博客

Kuwala is the no-code data platform for BI analysts and engineers enabling you to build powerful analytics workflows. We are set out to bring state-of-the-art data engineering tools you love, such as Airbyte, dbt, or Great Expectations together in one intuitive interface built with React Flow. In addition we provide third-party data into data sc…

🌍 Dataset that shows the Internet affordability by country (a shocking reality!)

Open Graph Protocol Parser for Node.js

Download images from Google Image Search

Recurrent Neural Networks (RNN, GRU, LSTM) and their Bidirectional versions (BiRNN, BiGRU, BiLSTM) for word & character level language modelling in Theano

Mobile data collection app using the iOS Runtime SDK.

Just to keep track of nice content and new announcements related to Apple products and Swift

open-source intelligence gathering for SIEMs <3

嗨博客 ASP.NET Core2.0 + CentOS7.3 + MySql5.6.37 + Redis + nginx1.12.1

A Node.js library to easily manage and rotate a pool of web browsers, using any of the popular browser automation libraries like Puppeteer, Playwright, or SecretAgent.

A POSIX shell script to parse HTML

A series of distributed components for Scrapy. Including RabbitMQ-based components, Kafka-based components, and RedisBloom-based components for Scrapy.

Zyte Smart Proxy Manager (formerly Crawlera) middleware for Scrapy

🔥 One of the most comprehensive open-source data annotation platform.

📉 Uptime and error monitoring CLI

Web crawling and scraping framework for Golang

基于 GitHub 的个人博客

Rubium is a lightweight alternative to Selenium/Capybara/Watir if you need to perform some operations (like web scraping) using Headless Chromium and Ruby

Scape top GitHub repositories and users based on keywords

A toolkit for pre-processing large source code corpora

📍 🏢 🏦 🏣 🏪 🏬 LNEx: Location Name Extractor

No description or website provided.

All-in-one Python (And now Go!) module to help solve captchas with Capmonster, 2captcha and Anticaptcha API's!

MozoLM: A language model (LM) serving library

Scrape and take screenshots of dynamic and static webpages

A GUI for Instaloader to scrape users and hashtags with on Instagram

Proxy pool. Finds and checks proxies with rest api for querying results. Can find over 25k proxies in under 5 minutes.

Parse a human name string into salutation, first name, middle name, last name, suffix.

The XForms-derived specification used in the ODK ecosystem. If you are interested in building a tool that is compliant with the forms rendered by ODK tools, this is the place to start. ✨⚒✨

Twitter bot powering @arichduvet

Your good mornings ☀️

Papercut is a scraping/crawling library for Node.js built on top of JSDOM. It provides basic selector features together with features like Page Caching and Geosearch.

CHeSF is the Chrome Headless Scraping Framework, a very very alpha code to scrape javascript intensive web pages

🕸 List of mini projects that involve web scraping 🕸

A collection of useful links for Pentesters

Archive web pages with all relevant assets or save as a single file HTML

Asynchronous REST call with DeferredResult

Easily download the main content of a web page in html, markdown, and/or epub format from command line.

Implement Differentiable Architecture Search (DARTS) for RNN with fastai

A Scraper made 100% in Python using BeautifulSoup and Tor. It can be used to scrape both normal and onion links. Happy Scraping :)

👄 The most accurate natural language detection library for Go, suitable for long and short text alike

HTML parsing and processing tool for PowerShell.

Akvo Flow app

Screen scraping and web crawling framework

Wget-AT is a modern Wget with Lua hooks, Zstandard (+dictionary) WARC compression and URL-agnostic deduplication.

Library to download subtitles from subscene.com

Neural Networks for Protein Sequence Alignment

博客V3.0 目前使用的技术(Nuxtjs + Nestjs + Vue + Element ui + vuetify)，存储(MongoDB + Redis + COS)

This script is used to scrap images from the Internet to classify 5 common noodle "mee" dishes in Singapore. Wanton Mee, Bak Chor Mee, Lor Mee, Prawn Mee and Mee Siam.

Crawl sites for RSS, Atom, and JSON feeds.

Spin up Tor containers and then proxy HTTP requests via these Tor instances

List of Data Science and Machine Learning Resource that I frequently use

A platform for collective blogs and social media platform, forum, question and answer service. Catalog of sites (programs), site navigation and directories - facets. A community based on the PHP HLEB micro-framework.

A Scraper, Downloader, & Recorder for static open directories.

这阵子由于项目需要，需要从手机上采集用户的运动轨迹数据，这样的功能大家都见到的很多了，比如咕咚、悦动圈，对跑步运动轨迹数据进行采集，再如，微信运动、钉钉运动，对于每一天你走步进行计数，如果要记录轨迹就离不开的手机定位，如果要记录步数那就离不开陀螺仪（角速度传感器），花了一天多的时间实现了一个定位数据实时采集的功能。

Scraping the status of WhatsApp contacts

Collection of scrapy spiders which can scrape posts, images, and so on from public Facebook Pages.

Transform unstructured document collections to structured Linked Data