644 Open source projects that are alternatives of or similar to Prerender Java

Cross-platform persistent and distributed web crawler 🔗

A Jekyll plugin to add metadata tags for search engines and social networks to better index and display your site's content.

Magento 2 SEO extension will do perfectly for your better SEO. This is a bundle of outstanding features that are auto-active when you install it from Mageplaza without any code modifications. It is also friendly with your store if you need to insert meta keywords and meta descriptions for your product.

It makes a preview from an URL, grabbing all the information such as title, relevant texts and images.

Library that assists in building Open Graph meta tags

POOPAK - TOR Hidden Service Crawler

Laravel Seo package for Content writer/admin/web master who do not know programming but want to edit/update SEO tags from dashboard

It covers the blockade principle of most anti-climbing strategies and corresponding solutions.👽👽👽👽（涵盖了大部分的反爬策略的封锁原理以及对应的解决方案。）

Fawkes is a tool to search for targets vulnerable to SQL Injection. Performs the search using Google search engine.

Tyra - Feminine Gatsby Starter optimized for SEO

GOPA, a spider written in Go.（NOTE: this project moved to https://github.com/infinitbyte/gopa ）

Golang pkg to quickly return a preview of a webpage (title/description/images)

scrapy专利爬虫（停止维护）

Some scrapy and web.py exmaples

Amazon商品引流的 python 爬虫

Powerful web scraping framework for Crystal

Scrapy, a fast high-level web crawling & scraping framework for Python.

优雅地玩知乎

World's first seo control panel for multiple websites

爬虫案例合集。包括但不限于《淘宝、京东、天猫、豆瓣、抖音、快手、微博、微信、阿里、头条、pdd、优酷、爱奇艺、携程、12306、58、搜狐、百度指数、维普万方、Zlibraty、Oalib、小说、招标网、采购网、小红书》

GraphQuery is a query language and execution engine tied to any backend service.

The official website of Truechain

Crawl a website and run it through Google lighthouse

Module for providing dynamic Meta Tags to Angular routes

Symfony SonataSeoBundle

hproxy - Asynchronous IP proxy pool, aims to make getting proxy as convenient as possible.(异步爬虫代理池)

Gatsby remark plugin for generating social card graphics

When you solve the problem of Baekjoon Online Judge, it automatically commits and pushes to the remote repository.

B站用户爬虫 好耶~是爬虫

Elder.js is an opinionated static site generator and web framework for Svelte built with SEO in mind.

Advanced XML Sitemaps for Gatsby.js

Beanbun 是用 PHP 编写的多进程网络爬虫框架，具有良好的开放性、高可扩展性，基于 Workerman。

🕷 CrawlerDetect is a PHP class for detecting bots/crawlers/spiders via the user agent

A utility package for automating lighthouse reporting

My own front end web development set up, covering everything from operating system to analytics.

🐳🐬Eva : 优雅，简约的完整博客项目 [前后端] (Eva: A concise, simple Blog Project. [FD/BD]) 🐋

Node.js scraper to get data from Google Play

自学入门 Python 优质中文资源索引，包含 书籍 / 文档 / 视频，适用于 爬虫 / Web / 数据分析 / 机器学习 方向

Automatically constructing corpus for automatic speech recognition from YouTube videos

The Photo Blog Application based on Laravel 5 and Vue.js 2 + Prerender

蓝天采集器是一款免费的数据采集发布爬虫软件，采用php+mysql开发，可部署在云服务器，几乎能采集所有类型的网页，无缝对接各类CMS建站程序，免登录实时发布数据，全自动无需人工干预！是网页大数据采集软件中完全跨平台的云端爬虫系统

Yoast SEO for WordPress

A sandboxed, extendable testing chrome extension and framework! It runs pre-defined and custom tests on each page that you visit.

Leetcode Contest Ranking Searcher

This package is a complete tool for creating a large dataset of images (specially designed -but not only- for machine learning enthusiasts). It can crawl the web, download images, rename / resize / covert the images and merge folders..

爬取北大法宝网http://www.pkulaw.cn/Case/

Ajax SEO crawlable webapp framework with boosted UX

Craft plugin to generate a sitemap.

Prestashop module. This override module allows to remove IDs from URLs

Base for Blogger, seo, twitter card, open graph, optimization and performance

Get the lyrics for the song currently playing on Spotify

preact-redux-isomorphic PWA SPA SSR best practices and libraries in under 80kB page size (for live demo click the link below)

WEBPACK + JSP 构建多页应用

基于NodeJS的基金数据爬虫，爬取的数据存于github的@nullpointer/fund-data。

OWASP D4N155 - Intelligent and dynamic wordlist using OSINT

💎 🔎 A gem version of @bhardin's SEO Jekyll tool

Tổng hợp script crawl dữ liệu từ các mạng xã hội & website tiếng Việt

A Strong, Fast and Flexible Pixiv Client based on .NET Core and WPF

新浪微博相册大图多线程爬虫。

A SEO Solution for duplicate contents, page titles, etc.