3055 Open source projects that are alternatives of or similar to Linkedin Profile Scraper

Elegant Scraper and Crawler Framework for Golang

Distributed crawler powered by Headless Chrome

Crawly, a high-level web crawling & scraping framework for Elixir.

No description or website provided.

Wget-AT is a modern Wget with Lua hooks, Zstandard (+dictionary) WARC compression and URL-agnostic deduplication.

a reliable high-level web crawling & scraping framework for Node.js.

Geziyor, a fast web crawling & scraping framework for Go. Supports JS rendering.

[WIP] GOPA, a spider written in Golang, for Elasticsearch. DEMO: http://index.elasticsearch.cn

Declarative web scraping

[Unmaintained] A simple and clean video/music/image downloader 👾

DotnetCrawler is a straightforward, lightweight web crawling/scrapying library for Entity Framework Core output based on dotnet core. This library designed like other strong crawler libraries like WebMagic and Scrapy but for enabling extandable your custom requirements. Medium link : https://medium.com/@mehmetozkaya/creating-custom-web-crawler-with-dotnet-core-using-entity-framework-core-ec8d23f0ca7c

simple multi-level scraper json input/output for Cheerio

`scrape_linkedin` is a python package that allows you to scrape personal LinkedIn profiles & company pages - turning the data into structured json.

A test suite of common scraper detection techniques. See how detectable your scraper stack is.

A web crawler (for bug hunting) that gathers more than you can imagine.

[Deprecated - Maintenance mode - use APIs directly please!] The official Diffbot client library

🔎Search LinkedIn profile by email address📧

Scraping the status of WhatsApp contacts

Papercut is a scraping/crawling library for Node.js built on top of JSDOM. It provides basic selector features together with features like Page Caching and Geosearch.

High performance crawler for Nodejs

一个灵活、友好的爬虫框架

🕷️ The progressive PHP crawler framework! 优雅的渐进式PHP采集框架。

ProxyCrawl Python library for scraping and crawling

A curated list of awesome puppeteer resources.

Squidwarc is a high fidelity, user scriptable, archival crawler that uses Chrome or Chromium with or without a head

Fresh Onions is an open source TOR spider / hidden service onion crawler hosted at zlal32teyptf4tvi.onion

web spider built by puppeteer, support task-queue and task-scheduling by decorators，support nedb / mongodb, support data visualization; 基于puppeteer的web爬虫框架，提供灵活的任务队列管理调度方案，提供便捷的数据保存方案（nedb/mongodb），提供数据可视化和用户交互的实现方案

dynamic crawler for web vulnerability scanner

爬虫工程师常用的 Chrome 插件 | Chrome extensions used by crawler developer

Universal scrapping tool, which allows you to extract data using multiple environments

蓝天采集器是一款免费的数据采集发布爬虫软件，采用php+mysql开发，可部署在云服务器，几乎能采集所有类型的网页，无缝对接各类CMS建站程序，免登录实时发布数据，全自动无需人工干预！是网页大数据采集软件中完全跨平台的云端爬虫系统

👨‍👩‍👦 Social account detection and extraction in Python, e.g. for crawling/scraping.

Scrapy, a fast high-level web crawling & scraping framework for Python.

OSINT Swiss Army Knife

News, full-text, and article metadata extraction in Python 3. Advanced docs:

Collection of scrapy spiders which can scrape posts, images, and so on from public Facebook Pages.

A series of distributed components for Scrapy. Including RabbitMQ-based components, Kafka-based components, and RedisBloom-based components for Scrapy.

Continuous scalable web crawler built on top of Flink and crawler-commons

A collection of awesome web crawler,spider in different languages

Apify SDK — The scalable web scraping and crawling library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.

LinkedIn Scraper (currently working 2020)

A Facebook crawler

Simple but useful Python web scraping tutorial code.

快速、简洁且强大的PHP爬虫框架

A high performance web crawler in Elixir.

A Smart, Automatic, Fast and Lightweight Web Scraper for Python

Scraping scripts for various websites.

Creating Scrapy scrapers via the Django admin interface

Extract structured data from web sites. Web sites scraping.

Linkedin Scraper using Selenium Web Driver, Chromium headless, Docker and Scrapy

A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

Powerful web scraping framework for Crystal

AV 电影管理系统， avmoo , javbus , javlibrary 爬虫，线上 AV 影片图书馆，AV 磁力链接数据库，Japanese Adult Video Library,Adult Video Magnet Links - Japanese Adult Video Database

HTTP API for Scrapy spiders

Headless Chrome For Java （Java 爬虫）

Antch, a fast, powerful and extensible web crawling & scraping framework for Go

Every web site provides APIs.

Free Web Scraping Tool with Java

自学入门 Python 优质中文资源索引，包含 书籍 / 文档 / 视频，适用于 爬虫 / Web / 数据分析 / 机器学习 方向

a puppeteer walker 🕷 🕸