228 Open source projects that are alternatives of or similar to Mechaml

🧶 Extract data from any website without code, just clicks.

Crawlera middleware for Scrapy

Topic wise PDFs of Geeks for Geeks articles. (Last updated in October 2018)

Comic-dl is a command line tool to download manga and comics from various comic and manga sites. Supported sites : readcomiconline.to, mangafox.me, comic naver and many more.

ARGUS is an easy-to-use web scraping tool. The program is based on the Scrapy Python framework and is able to crawl a broad range of different websites. On the websites, ARGUS is able to perform tasks like scraping texts or collecting hyperlinks between websites. See: https://link.springer.com/article/10.1007/s11192-020-03726-9

Tools for various online judges. Downloading sample cases, generating additional test cases, testing your code, and submitting it.

Scrape any website, article or RSS/Atom Feed with ease!

[Unmaintained] A simple and clean video/music/image downloader 👾

Schedules tweets using TweetDeck

Crawly, a high-level web crawling & scraping framework for Elixir.

COVID-19 Coronavirus data scraped from government and curated data sources.

📓 Minicurso de raspagem de dados web com Python ministrado na Semana de Tecnologia da FATEC Jundiaí

Distributed crawler powered by Headless Chrome

Social media scraping / data collection library for Facebook, Twitter, Reddit, YouTube, Pinterest, and Tumblr APIs

Scrape the Instagram frontend. Inspired from twitter-scraper by @kennethreitz.

Scrapy Extension for monitoring spiders execution.

Scrape Facebook public pages without an API key

一个灵活、友好的爬虫框架

Tracking PG&E outages

[WIP] GOPA, a spider written in Golang, for Elasticsearch. DEMO: http://index.elasticsearch.cn

A framework for creating semi-automatic web content extractors

A collection of tools to (semi-)automatically collect and analyze data from online discussions on Facebook groups and pages.

Parsel lets you extract data from XML/HTML documents using XPath or CSS selectors

Building a model to recognize incentives for landscape restoration in environmental policies from Latin America, the US and India. Bringing NLP to the world of policy analysis through an extensible framework that includes scraping, preprocessing, active learning and text analysis pipelines.

Jekyll-based static site for The Programming Historian

Collection of useful data science topics along with code and articles

API for scrapping common meme sites

Tabula is a tool for liberating data tables trapped inside PDF files

Build and deploy a machine learning app from scratch 🚀

This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.

A Python Tool For google Hacking

🥫 The simple, fast, and modern web scraping library

A Smart, Automatic, Fast and Lightweight Web Scraper for Python

Creating Scrapy scrapers via the Django admin interface

📇 Extract social media profiles and more with regular expressions

Analyze facebook copy of your data with ruby language. Download zip file from facebook and get info about friends ranking by message, vocabulary, contacts, friends added statistics and more

Linkedin Scraper using Selenium Web Driver, Chromium headless, Docker and Scrapy

HTML scraping for Objective-C.

Generate Free Edu Mail(s) within minutes

Web scraping library made by the Phantombuster team. Modern, simple & works on all websites. (Deprecated)

🧹 Python package for text cleaning

Code for the collection and analysis of the MTNT dataset

Functional HTML scraping and rewriting with CSS in OCaml

Declarative web scraping

Apify SDK — The scalable web scraping and crawling library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.

✂️ High performance, multi-threaded image scraper

📷 An app to scrap instagram posts and analyze data.

Extract structured data from web sites. Web sites scraping.

The Scripting Engine that Combines Speed, Safety, and Simplicity

Public, free to use, repository with diggers configs for scraping / extracting data from various e-commerce websites and online stores

No description or website provided.

Mechanize is a ruby library that makes automated web interaction easy.

Nodejs web scraper. Contains a command line, docker container, terraform module and ansible roles for distributed cloud scraping. Supported databases: SQLite, MySQL, PostgreSQL. Supported headless clients: Puppeteer, Playwright, Cheerio, JSdom.

Free Web Scraping Tool with Java

Lookyloo is a web interface that allows users to capture a website page and then display a tree of domains that call each other.

自学入门 Python 优质中文资源索引，包含 书籍 / 文档 / 视频，适用于 爬虫 / Web / 数据分析 / 机器学习 方向

artoo.js - the client-side scraping companion.

Search for and retrieve US Patent and Trademark Office Patent Data

Simple but useful Python web scraping tutorial code.

Custom Selenium Chromedriver | Zero-Config | Passes ALL bot mitigation systems (like Distil / Imperva/ Datadadome / CloudFlare IUAM)