1518 Open source projects that are alternatives of or similar to Polite

Tools for summarizing/visualizing regressions and other helpful stuff

java framework for prerender

GitHub actions for R and accompanying R package

Creates an XML-Sitemap by crawling a given site.

Soccer/football analytics blog posts & data viz from the World Cup, Premier League, Copa America, and beyond. Using ggplot2, ggsoccer, & more. (Est. June 2018) ****Please look at the README for best version of the code!****

An open database of international sanctions data, persons of interest and politically exposed persons

A instagram scraper wrote in python. Similar to instagram-php-scraper.Usages are in example.py. Enjoy it!

B站用户爬虫 好耶~是爬虫

🛠️ 📊 Tools for Exploring and Comparing Data Frames

一款分布式爬虫平台，帮助你更好的管理和开发爬虫。 内置一套爬虫定义规则（模版），可使用模版快速定义爬虫，也可当作框架手动开发爬虫。(兴趣使然的项目，用的不爽了就更新)

🎬 电影资源爬虫,电影图片抓取脚本,Flask|Nginx|wsgi

scrapy专利爬虫（停止维护）

COVID-19 Mobility Data Aggregator. Scraper of Google, Apple, Waze and TomTom COVID-19 Mobility Reports🚶🚘🚉

Golang爬虫 爬取豆瓣电影Top250

Google search results crawler, get google search results that you need

`scrape_linkedin` is a python package that allows you to scrape personal LinkedIn profiles & company pages - turning the data into structured json.

本仓库收集整理爬虫相关资源，开发语言以Java为主

京东口罩库存监控爬虫(非selenium)，扫码登录、查价、加购、下单、秒杀

Implementation of BERT in R

Portara directive is a rate limiter / throttler for GraphQL

Machine Learning in R

R ggplot2 "bindings" for Vega-Lite

爬取北大法宝网http://www.pkulaw.cn/Case/

Seamless embedding of R in C++ programs

YouTube video downloader in javascript.

DownZemAll! is a download manager for Windows, MacOS and Linux

一只优雅的正方教务系统爬虫。

R functions for reading and writing from the system clipboard

Code for the second edition Web Scraping with Python book by Packt Publications

Web crawler.

A Go package for working with headless Chrome. Run interactive JavaScript commands on web pages with Go and Chrome.

Cross Platform C# web crawler framework built for speed and flexibility. Please star this project! +1.

Scrape job websites into a single spreadsheet with no duplicates.

Extra functionality for leaflet R package.

GraphQuery is a query language and execution engine tied to any backend service.

BaiduSpider，一个爬取百度搜索结果的爬虫，目前支持百度网页搜索，百度图片搜索，百度知道搜索，百度视频搜索，百度资讯搜索，百度文库搜索，百度经验搜索和百度百科搜索。

🎓 Tidy tools for academics

💻 Quickly crawl the information (e.g. followers, tags, etc...) of an instagram profile. No login required!

⏲ countdown timer for R Markdown slides and HTML docs

cowsay w/ more animals, in R

Scraper for oEmbed, Twitter Cards and Open Graph metadata - fast and Promise-based ⚡️

An easy to use, powerful crawler implemented in PHP. Can execute Javascript.

pylinkvalidator is a standalone and pure python link validator and crawler that traverses a web site and reports errors (e.g., 500 and 404 errors) encountered.

Cross-platform persistent and distributed web crawler 🔗

Demeter is a tool for scraping the calibre web ui

A collection of Shiny applications (links shared on Twitter)

Animated icons for R markdown and Shiny apps

根据关键词抓取微博数据，再生成词云

A lua library to provide distributed rate measurement using nginx + redis, you can use it to do a throttling system within many nodes.

An automated website accessibility scanner and cli

SEO python scraper to extract data from major searchengine result pages. Extract data like url, title, snippet, richsnippet and the type from searchresults for given keywords. Detect Ads or make automated screenshots. You can also fetch text content of urls provided in searchresults or by your own. It's usefull for SEO and business related research tasks.

Fawkes is a tool to search for targets vulnerable to SQL Injection. Performs the search using Google search engine.

Gorecon is a All in one Reconnaissance Tool , a.k.a swiss knife for Reconnaissance , A tool that every pentester/bughunter might wanna consider into their arsenal

karyoploteR - An R/Bioconductor package to plot arbitrary data along the genome

Python爬虫实战 - 模拟登陆各大网站 包含但不限于：滑块验证、拼多多、美团、百度、bilibili、大众点评、淘宝，如果喜欢请start ❤️

R package for analyzing other R packages via graph representations of their dependencies

Scrapy, a fast high-level web crawling & scraping framework for Python.

Dynamic meta tags in your AngularJS single page application

A scalable web crawler framework for Java.

💀 The Pirate Bay node.js client