644 Open source projects that are alternatives of or similar to Prerender Java

爬蟲極簡教學（fetch, parse, search, multiprocessing, API）- PTT 為例

Scrapy as a Web Crawler for Azure Search Samples

All in One SEO Pack plugin for WordPress SEO

GOPA, a spider written in Go.（NOTE: this project moved to https://github.com/infinitbyte/gopa ）

DotnetSpider, a .NET standard web crawling library. It is lightweight, efficient and fast high-level web crawling & scraping framework

Fetches PubMed article IDs (PMIDs) from email inbox, then crawls PubMed, Google Scholar and Sci-Hub for respective PDF files.

Golang pkg to quickly return a preview of a webpage (title/description/images)

An R web crawler and scraper

Free Open Source Content Management System, based on PHP, Bootstrap and jQuery.

line-bot-tutorial use python flask

scrapy专利爬虫（停止维护）

🔍 SEO Helper is a package that provides tools and helpers for SEO (Search Engine Optimization).

Sina stock options crawler with CSV output 新浪上证ETF期权数据爬虫

Enable or disable the indexing of your app

Some scrapy and web.py exmaples

This is a Multi-thread crawler for Tumblr.

Distributed Image Search Engine Crawler

💰 Popular marketing tools and add-ons used by 10,000+ of the top e-commerce stores.

Amazon商品引流的 python 爬虫

🍭 epub generator for (light)novels (轻) 小说 epub 生成器，支持站点：轻之国度、轻小说文库

获取最新可备案域名列表爬虫

SEO dashboard from Search console Data using the Google Search API, Mysql database , NodeJS RESTAPI( ExpressJS) and reactJs Dashboard

Powerful web scraping framework for Crystal

Implements the crawler package into Symfony

Puppeteer (Headless Chrome Node API)-based rendering solution.

A fast tool to fetch URLs from HTML attributes by crawl-in.

Scrapy, a fast high-level web crawling & scraping framework for Python.

模拟登录各类网站，操作 API 完成各种不可描述的事情

massive SQL injection vulnerability scanner

我的爬虫合集

优雅地玩知乎

EcommerceTools is a Python data science toolkit for ecommerce, marketing science, and technical SEO analysis and modelling and was created by Matt Clarke.

A Python script to gain some insights from a domain and list of keywords.

Simple Weibo Scraper

World's first seo control panel for multiple websites

Just a crawler based on tg-cli for Telegram. Deprecated by now, please use telegram-export.

基于appium的app自动遍历工具

Aiohttp web server API, which scrapes Google and returns scrape results as response. Supports proxies, multiple geos and number of results.

爬虫案例合集。包括但不限于《淘宝、京东、天猫、豆瓣、抖音、快手、微博、微信、阿里、头条、pdd、优酷、爱奇艺、携程、12306、58、搜狐、百度指数、维普万方、Zlibraty、Oalib、小说、招标网、采购网、小红书》

Source code for the IndieWeb search engine.

👧 美女写真套图爬虫（二）

🐛一只登录正方教务管理系统，爬取数据的小爬虫

GraphQuery is a query language and execution engine tied to any backend service.

No description or website provided.

Pimcore - i18n Manager

Az összes számlád még egy helyen :)

The official website of Truechain

It's an open-source report template that guides web professionals thought steps to audit any website in terms of the page speed and technical SEO optimisation.

A fluent builder Schema.org types and ld+json generator

Google Analytics component for Svelte

Crawl a website and run it through Google lighthouse

AV 电影管理系统， avmoo , javbus , javlibrary 爬虫，线上 AV 影片图书馆，AV 磁力链接数据库，Japanese Adult Video Library,Adult Video Magnet Links - Japanese Adult Video Database

本项目不再维护，详情可加群了解 https://t.me/onecomicbook

Script that crawls meta data from ICLR OpenReview webpage. Tutorials on installing and using Selenium and ChromeDriver on Ubuntu.

Scrapy-based Crawlers for news of Taiwan

Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架

Node.js module to generate URL slugs. Another one? This one cares about i18n and transliterates non-Latin scripts to conform to the RFC3986 standard. Mostly API-compatible with similar modules.

What do people have in their dotfiles?

vulnx 🕷️ is an intelligent bot auto shell injector that detect vulnerabilities in multiple types of cms { `wordpress , joomla , drupal , prestashop .. `}

Fast webpages for all browsers.