2056 Open source projects that are alternatives of or similar to Linkedin

An example using Selenium webdrivers for python and Scrapy framework to create a web scraper to crawl an ASP site

`scrape_linkedin` is a python package that allows you to scrape personal LinkedIn profiles & company pages - turning the data into structured json.

The main functionality is to extract all the emails from one or several URLs - La funcionalidad principal es extraer todos los correos electrónicos de una o varias Url

Creating Scrapy scrapers via the Django admin interface

Collection of scrapy spiders which can scrape posts, images, and so on from public Facebook Pages.

🕵️‍♂️ LinkedIn profile scraper returning structured profile data in JSON. Works in 2020.

Crawlera middleware for Scrapy

爬虫工程师常用的 Chrome 插件 | Chrome extensions used by crawler developer

Araignée LeBonCoin avec Scrapy et ElasticSearch

A LinkedIn Scraper to scrape up to 10k LinkedIn profiles from company profile links and save their e-mail addresses if available!

🔎Search LinkedIn profile by email address📧

ProxyCrawl Python library for scraping and crawling

Simple and friendly Bot for Instagram, using Selenium and Scrapy with Python.

This repository is no longer maintained.

An Instagram bot developed using the Selenium Framework

🤖 👻 Desktop application for Instagram Bot, Twitter Bot and Facebook Bot

This class can retrieve search results from Google.

With Selenium headless browsing and CAPTCHA solving

[Deprecated - Maintenance mode - use APIs directly please!] The official Diffbot client library

Monitor instagram user account and automatically post new images to discord channel via a webhook. Working 2022!

A test suite of common scraper detection techniques. See how detectable your scraper stack is.

Command line program to download documents from web portals.

An open source webapp for scraping: towards a public service for webscraping

Proxy pool. Finds and checks proxies with rest api for querying results. Can find over 25k proxies in under 5 minutes.

A tutorial-based introduction to web scraping with Python.

All-in-one Python (And now Go!) module to help solve captchas with Capmonster, 2captcha and Anticaptcha API's!

Zyte Smart Proxy Manager (formerly Crawlera) middleware for Scrapy

Yet Another LInkedIn Scraper...

Send messages to any person in any time how much you want.

Node.js package to bypass CloudFlare's anti-bot JavaScript challenges

scrapes medias, likes, followers, tags and all metadata. Inspired by instagram-php-scraper,bot

Social media research and promotion, semi-autonomous CLI bot

Tool to scrape linkedin

Pahe.ph [Pahe.in] Movies Website Scraper

**[ARCHIVED]** website changes tracker 🔍

🐙 Get Daily 400-500 Real Followers 👽 [BadRobo] is Best Instagram Bot Available Now with All Features!. Our BOT did not violate any of Instagram's rules, so you don't have to worry about getting ACTION BLOCK!

A Selenium-driven tool for automated website interaction and scraping.

👨‍👩‍👦 Social account detection and extraction in Python, e.g. for crawling/scraping.

A Scrapy extension to log items coverage when the spider shuts down

scrapers for building your own image databases

Home Assistant custom component for scraping (html, xml or json) multiple values (from a single HTTP request) with a separate sensor/attribute for each value. Support for (login) form-submit functionality.

Retrieve real (with Javascript executed) HTML code from an URL, ultra fast and supports multiple parallel loading of webs

Web scraper for grabing data from Linkedin profiles or company pages (personal project)

A simple Google meet bot so the bot can attend classes for you.

📻 An OLX Scraper using Scrapy + MongoDB. It Scrapes recent ads posted regarding requested product and dumps to NOSQL MONGODB.

Wget-AT is a modern Wget with Lua hooks, Zstandard (+dictionary) WARC compression and URL-agnostic deduplication.

A series of distributed components for Scrapy. Including RabbitMQ-based components, Kafka-based components, and RedisBloom-based components for Scrapy.

No description or website provided.

🕸 List of mini projects that involve web scraping 🕸

LinkedinScraper is an another information gathering tool written in python. You can scrape employees of companies on Linkedin.com and then create these employee names, titles and emails.

Spin up Tor containers and then proxy HTTP requests via these Tor instances

A Scraper, Downloader, & Recorder for static open directories.

A Scraper made 100% in Python using BeautifulSoup and Tor. It can be used to scrape both normal and onion links. Happy Scraping :)

fetch data from Facebook, Instagram and LinkedIn

Nodejs web scraper. Contains a command line, docker container, terraform module and ansible roles for distributed cloud scraping. Supported databases: SQLite, MySQL, PostgreSQL. Supported headless clients: Puppeteer, Playwright, Cheerio, JSdom.

Papercut is a scraping/crawling library for Node.js built on top of JSDOM. It provides basic selector features together with features like Page Caching and Geosearch.

API for scrapping common meme sites

Building a model to recognize incentives for landscape restoration in environmental policies from Latin America, the US and India. Bringing NLP to the world of policy analysis through an extensible framework that includes scraping, preprocessing, active learning and text analysis pipelines.

ARGUS is an easy-to-use web scraping tool. The program is based on the Scrapy Python framework and is able to crawl a broad range of different websites. On the websites, ARGUS is able to perform tasks like scraping texts or collecting hyperlinks between websites. See: https://link.springer.com/article/10.1007/s11192-020-03726-9

Scraping scripts for various websites.