130 Open source projects that are alternatives of or similar to pyCreeper

基于C#.NET+PhantomJS+Sellenium的高级网络爬虫程序。可执行Javascript代码、触发各类事件、操纵页面Dom结构。

A collection of awesome web scaper, crawler.

📷 Automate full website screenshots and PDF generation with multiple viewport support.

Capture screenshot of a website and return it as a stream

Karma runner plugin for detecting all browsers installed on the current system.

动漫之家漫画站电脑版原图爬虫

Scrape bot, to get you an offline copy of tutorials

An API for your Kindle data

Pipe stdin to Phantom.JS

A Composer Package which installs the PhantomJS binary (Linux, Windows, Mac) into /bin of your project.

PhantomJS resource pool based on generic-pool

A PhantomJS-powered headless test runner for QUnit

gevent compatibility for inotifyx

This is a project of build knowledge graph course. The project leverages historical stock price, and integrates social media listening from customers to predict market Trend On Dow Jones Industrial Average (DJIA).

Just a simple web crawler which return crawled links as IObservable using reactive extension and async await.

Async WebDriver implementation for asyncio and asyncio-compatible frameworks

Fork of Meteor Spiderable with longer timeout, caching, better server handling

A lightweight commandline tool for visual regression testing of UI components.

A crawler based on Phantom. Allows discovery of dynamic content and supports custom scrapers.

Report management package in PHP that aims to help you export information in a variety of formats

A web crawler for Go

Biblioteca feita em Python com o objetivo de facilitar o acesso a dados de seus investimentos na bolsa de valores(B3/CEI) através do Portal CEI.

💦 Tools to Work with the 'Splash' JavaScript Rendering Service in R

server frontend for lmdb

Karma + Webpack + Mocha + Chai + Istanbul

Yet Another Web Spider

Behavioural driven development UI automation framework using selenium, cucumber-java, testng, maven, phantomjs

Use JSON to list all elements (with css 3 and jquery selector) that you want to crawl.

Python Web Crawler with Selenium and PhantomJS

Handy API for Headless Chromium

Framework for testing ExtJs applications

It is a web crawler which crawls the stackoverfolw website (http://stackoverflow.com/) and finds the most popular technologies at current point of time by getting the tags info of the newest questions asked on the website.

Explore a website recursively and download all the wanted documents (PDF, ODT…)

run client-side Mocha tests with PhantomJS

A web crawler that uses Firefox and js injection to interact with webpages and crawl their content, written in nodejs.

Universal scrapping tool, which allows you to extract data using multiple environments

扫描“微信读书”已购图书并下载本地PDF的爬虫

Website style analyzer for designers. This is the service part that does the analyzation etc.

Install Selenium-compatible Chrome/Firefox/Opera/PhantomJS/Edge webdrivers automatically.

✅ js微信聊天机器人（使用个人账号，非公众号） Wechat chat robot write by js.

Raspagem de dados para iniciante usando Scrapy e outras libs básicas

Go-like features for Python and Cython. (mirror of https://lab.nexedi.com/kirr/pygolang)

Phantomjs for raspberry pi (armv6/armv7) and aarch64/arm64

Automation Tools for PHP

🕶️ A curated list of resources around the topic: visual regression testing

Automate Javascript/Ajax websites with Perl and PhantomJS

PhantomJS/Node.js web scraper for AWS Lambda

pip install funboost，python全功能分布式函数调度框架,。支持python所有类型的并发模式和全球一切知名消息队列中间件，python函数加速器，框架包罗万象，一统编程思维，兼容50% python编程业务场景，适用范围广。只需要一行代码即可分布式执行python一切函数。旧名字是function_scheduling_distributed_framework

👻 Create screenshots or previews of web pages

Concurrent browser tests with elixir

Commandline tool for automated downloads of echo360 videos hosted by university

（已不適用新版臺鐵訂票系統，且不再更新）台灣鐵路訂票應用程式（臺鐵 / 台鐵 / 訂單程票 / 訂來回票），基於 Selenium + PyQt4。

Contains all the public APIs listed in Phantombuster's API store. Pull requests welcome!

Repl.it Discord security bot, ready to srop crime!

今日校园/体温签到/海南大学/QQ机器人

A tutorial-based introduction to web scraping with Python.

Proxy pool. Finds and checks proxies with rest api for querying results. Can find over 25k proxies in under 5 minutes.

📻 An OLX Scraper using Scrapy + MongoDB. It Scrapes recent ads posted regarding requested product and dumps to NOSQL MONGODB.

Distributed task redisqueue(最简单python分布式函数调度框架)

Taking a screenshot of a webpage.