194 Open source projects that are alternatives of or similar to crawlzone

Automate the creation of Python Selenium Scripts by drawing coloured boxes on webpage elements

Web Scraping Framework

Android app for saving webpages for offline reading.

A library that enables programmatic interaction with daft.ie. Daft.ie has nationwide coverage and contains about 80% of the total available properties in Ireland.

Apify actor that opens a web page in headless Chrome and analyzes the HTML and JavaScript objects, looks for schema.org microdata and JSON-LD metadata, analyzes AJAX requests, etc.

Guide, reference and cheatsheet on web scraping using rvest, httr and Rselenium.

Turn large Web sites into tables and charts using simple SQLs.

A web application that generates timetables for university students at the University of Toronto

Netflix like full-stack application with SPA client and backend implemented in service oriented architecture

Receive an email or Telegram message as soon as Migros Sanalmarket is available for delivery in your neighborhood.

Fetch user's data across social media

Zillow Scraper for Python using Selenium

Selenium-python but lighter: Helium is the best Python library for web automation.

⚡️ Ayakashi.io - The next generation web scraping framework

Simple package to automatically restart application when file changes are detected!

A Devtools driver for web automation and scraping

Machine Learning Model for Sport Predictions (Football, Basketball, Baseball, Hockey, Soccer & Tennis)

Python Package for scraping NHL Play-by-Play and Shift data

Basic setup with random user agents and IP addresses for Python Scrapy Framework.

PHP Library for detecting CMS

This repository provides everything you need to get started with Python for (social science) research.

Go cascadia package command line CSS selector

`scrape_linkedin` is a python package that allows you to scrape personal LinkedIn profiles & company pages - turning the data into structured json.

A Chrome extension for writing custom web scraping programs and web automation programs. Just demonstrate how to collect the first row of data, then let the extension write the program for collecting all rows.

Web Scraping Craigslist's Engineering Jobs in NY with Scrapy

Apify actor that crawls Google Search result pages (SERPs) and extracts a list of organic results, ads, related queries and more. It supports selection of custom country, language and location.

Simple Query Scraping with CSS and Go Reflection (MOVED to Gitlab)

Scrape, standardize and share public meetings from local government websites

MetaData html scraper and parser for Node.js (supports Promises and callback style)

Building a Concurrent Web Scraper with Python and Selenium

Learn Python for the next 30 (or so) Days.

Python scripts for building 'Short Jokes' dataset, featured on Kaggle

General Assembly's 2015 Data Science course in Washington, DC

Kattis demo solutions with unit testing

Set up free and scalable Scrapyd cluster for distributed web-crawling with just a few clicks. DEMO 👉

Tutorial: Web scraping in Python with Beautiful Soup

⏪ Tools to Work with the Various Internet Archive Wayback Machine APIs

📈 Regression and Classification with UC Davis student quiz data and exam data

💦 Tools to Work with the 'Splash' JavaScript Rendering Service in R

Twitter Intelligence OSINT project performs tracking and analysis of the Twitter

Node.js package to bypass CloudFlare's anti-bot JavaScript challenges

Crawling and scraping the Web for fun and profit

Simple web scraping for R

Web scrapping and related analytics using Python tools

Extract clean(er), readable text from web pages via Mercury Web Parser.

An unofficial API for Quora.

Powerful web scraping framework for Crystal

Scrapy Training companion code

Headless 'Chrome' Orchestration in R

A Programming language for Web Scraping

Download/access photos, videos, stories, story highlights, postlives, following and followers of Instagram

Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC, LME, SHFE and news data crawlers on BBC, Wall Street Journal, Al Jazeera, Reuters, Financial Times, Bloomberg, CNN, Fortune, The Economist

A Router WiFi key recovery/cracking tool with a twist.

A command-line utility and Scrapy middleware for scraping time series data from Archive.org's Wayback Machine.

Scrapy crawler to collect data on the back catalog of songs listed for sale.

Exercises, data, and more for our 2017 summer workshop (funded by the Estes Fund and in partnership with Project Jupyter and Berkeley's D-Lab)

C# command line tool for running tests on Android / iOS / tvOS devices and simulators

Powerful Framework for Backend Automation Testing on Java (Rest, Soap, WebSocket)

Công cụ quét và phân tích từ khoá các trang báo mạng Việt Nam

PHP Scraper - an highly opinionated web-interface for PHP