104 Open source projects that are alternatives of or similar to scrape

Serve sitemap.xml from a list of URLs in Express

PHP Simple Sitemap Generator

A simple sitemap generator for Laravel Framework.

Simple sitemap generator for .NET

Grav Sitemap Plugin

Java sitemap generator. This library generates a web sitemap, can ping Google, generate RSS feed, robots.txt and more with friendly, easy to use Java 8 functional style of programming

A rust library to generate sitemaps.

Sitemap Plugin for Sylius eCommerce platform

Google sitemap builder for Laravel

Web scraper for grabing data from Linkedin profiles or company pages (personal project)

Script that generates a sitemap by crawling a given URL

Yellowpages.com Web Scraper written in Python and LXML to extract business details available based on a particular category and location.

Mini website crawler to make sitemap from a website.

SEO utilities including a unique field type, sitemap & redirect manager

Bolt Sitemap extension - create XML sitemaps for your Bolt website.

This project is a web scraper built with Ruby retrieving data from the "Movies | Netflix official website"

SEOmatic facilitates modern SEO best practices & implementation for Craft CMS 3. It is a turnkey SEO system that is comprehensive, powerful, and flexible.

Craft plugin to generate a sitemap.

Laravel Seo package for Content writer/admin/web master who do not know programming but want to edit/update SEO tags from dashboard

A ready-to-use, customizable personal blog with minimalist design

XML Sitemap parser class compliant with the Sitemaps.org protocol.

Create and generate sitemaps with ease

Sitemap is the easiest way to generate Sitemaps in Elixir.

A high performance skeleton starter for GatsbyJS that focuses on SEO/Social features/development environment.

parses sitemaps for Node.JS

My Personal Links

Webpack plugin to generate a sitemap.

🌆 Here I've aggregated some of the most commonly used web-page templates made using Bootstrap4 🛒

Twitter Troll & Fake News Hunter - Crawls news websites and twitter to identify fake news

📻 An OLX Scraper using Scrapy + MongoDB. It Scrapes recent ads posted regarding requested product and dumps to NOSQL MONGODB.

Sitemap generator plugin for vuepress.

static blog generator for my blog at https://zupzup.org/

Creates an XML-Sitemap by crawling a given site.

Generate sitemap.xml by React Router configuration

Elder.js plugins and community plugins.

go-sitemap-generator is the easiest way to generate Sitemaps in Go

PHP XML Sitemap Generation

Instagram Bot which when given a post url will spam mentions to increase the chances of winning. Win Instagram Giveaways!

Generate sitemap.xml by vue-router configuration

Event Sourcing + CQRS using Golang Tutorial

Scape top GitHub repositories and users based on keywords

Jekyll plugin to silently generate a sitemaps.org compliant sitemap for your Jekyll site

Laravelium Sitemap generator for Laravel.

Ultimate Website Sitemap Parser

Sitemap-generating framework for node.js

📷 Automate full website screenshots and PDF generation with multiple viewport support.

👓 Every link ever to Android Developer site.

Classic SEO is the first SEO plugin built specifically to work with ClassicPress. A fork of Rank Math, the plugin contains many essential SEO tools to help optimize your website.

Site map creation support

a tool for validate xml sitemap and sitemap index files for broken links

Application sitemap and navigation manager module for Yii 2.0 Framework

Developer friendly Bard that writes sitemap poetry in xml.

State of the art object detection in real-time using YOLOV3 algorithm. Augmented with a process that allows easy training of the classifier as a plug & play solution . Provides alert if an item in an alert list is detected.

Rust projects here are easy to use. There are blog posts for them also.

A fast Web API scraper written in C++ and built on Boost ASIO

A Burp Suite Extension that try to find all sub-domain, similar-domain and related-domain of an organization automatically! 基于流量自动收集整个企业或组织的子域名、相似域名、相关域名的burp插件

OnlyFans content downloader

The Ultimate Boilerplate for Products.

A console application that can scrape the Azur Lane wiki and export the data to Json files

A command line program to download hentai videos and images from multiple websites