1216 Open source projects that are alternatives of or similar to Filesensor

swiss army knife for hackers

基于搜狗微信搜索的微信公众号爬虫接口

crawler framework, distributed crawler extractor

A multi-thread crawler framework with many builtin image crawlers provided.

Scrapy-based Crawlers for news of Taiwan

基于Scrapy的QQ音乐爬虫(QQ Music Spider)，爬取歌曲信息、歌词、精彩评论等，并且分享了QQ音乐中排名前6400名的内地和港台歌手的49万+的音乐语料

A framework for creating semi-automatic web content extractors

Dictionary collection project such as Pentesing, Fuzzing, Bruteforce and BugBounty. 渗透测试、SRC漏洞挖掘、爆破、Fuzzing等字典收集项目。

DotnetCrawler is a straightforward, lightweight web crawling/scrapying library for Entity Framework Core output based on dotnet core. This library designed like other strong crawler libraries like WebMagic and Scrapy but for enabling extandable your custom requirements. Medium link : https://medium.com/@mehmetozkaya/creating-custom-web-crawler-with-dotnet-core-using-entity-framework-core-ec8d23f0ca7c

Parser and database to index the terpene profile of different strains of Cannabis from online databases

A Not So Very Intelligent Fuzzer: An advanced fuzzing framework designed to find vulnerabilities in C/C++ code.

BurpSuite收集：包括不限于 Burp 文章、破解版、插件(非BApp Store)、汉化等相关教程，欢迎添砖加瓦---burpsuite-pro burpsuite-extender burpsuite cracked-version hackbar hacktools fuzzing fuzz-testing burp-plugin burp-extensions bapp-store brute-force-attacks brute-force-passwords waf sqlmap jar

Life is short, *****.

Lite version of Crawlab. 轻量版 Crawlab 爬虫管理平台

爬虫, http代理, 模拟登陆!

Crawlera middleware for Scrapy

Web Pentesting Fuzz 字典,一个就够了。

A Facebook crawler

💖 High available distributed ip proxy pool, powerd by Scrapy and Redis

Find web directories without bruteforce

Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架

A container repository for my public web hacks!

Some scrapy and web.py exmaples

ScrapingOutsourcing专注分享爬虫代码 尽量每周更新一个

Python爬虫实战 - 模拟登陆各大网站 包含但不限于：滑块验证、拼多多、美团、百度、bilibili、大众点评、淘宝，如果喜欢请start ❤️

💐Marmot | Web Crawler/HTTP protocol Download Package 🐭

The Last Web Recon Tool You'll Need

Scrapy as a Web Crawler for Azure Search Samples

Scrapoxy hides your scraper behind a cloud. It starts a pool of proxies to send your requests. Now, you can crawl without thinking about blacklisting!

《数据采集从入门到放弃》源码。内容简介：爬虫介绍、就业情况、爬虫工程师面试题 ；HTTP协议介绍； Requests使用 ；解析器Xpath介绍； MongoDB与MySQL； 多线程爬虫； Scrapy介绍 ；Scrapy-redis介绍； 使用docker部署； 使用nomad管理docker集群； 使用EFK查询docker日志

Rockyou for web fuzzing

Web path scanner

A high performance offensive security tool for reconnaissance and vulnerability scanning

Simple but useful Python web scraping tutorial code.

Summary of online learning materials

PTT 網路版爬蟲

Github 仓库及用户分析爬虫

码云仓库链接:AJay13/ECommerceCrawlers Github 仓库链接:DropsDevopsOrg/ECommerceCrawlers 项目展示平台链接:http://wechat.doonsec.com

Redis-based components for Scrapy.

HTTP API for Scrapy spiders

scrapy专利爬虫（停止维护）

[Crawler/Scraper for Golang]🕷A lightweight distributed friendly Golang crawler framework.一个轻量的分布式友好的 Golang 爬虫框架。

File Inclusion & Directory Traversal fuzzing, enumeration & exploitation tool.

Web crawler.

Fuzz your Rust code with Google-developed Honggfuzz !

Vagrant VirtualBox environment for conducting an internal network penetration test

Rapid is a Go library for property-based testing that supports state machine ("stateful" or "model-based") testing and fully automatic test case minimization ("shrinking")

《Python爬虫开发 从入门到实战》配套源代码。

Proxy [Finder | Checker | Server]. HTTP(S) & SOCKS 🎭

Gorecon is a All in one Reconnaissance Tool , a.k.a swiss knife for Reconnaissance , A tool that every pentester/bughunter might wanna consider into their arsenal

Scrape, standardize and share public meetings from local government websites

A Tumblr Backup Application

Scrapy+Splash for JavaScript integration

The Leading Security Assessment Framework for Android.

A list of useful payloads for Web Application Security and Pentest/CTF

Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Django and Vue.js

Universal scrapping tool, which allows you to extract data using multiple environments

dynamic crawler for web vulnerability scanner

A simple wrapper for C# tools

A fuzzer for full VM kernel/driver targets