All Projects β†’ OfirKP β†’ Whatsapp-Net

OfirKP / Whatsapp-Net

Licence: GPL-2.0 license
Generate a network graph of connections from your WhatsApp groups data

Programming Languages

javascript
184084 projects - #8 most used programming language
Jupyter Notebook
11667 projects
python
139335 projects - #7 most used programming language

Projects that are alternatives of or similar to Whatsapp-Net

whatsapp-tracking
Scraping the status of WhatsApp contacts
Stars: ✭ 49 (-34.67%)
Mutual labels:  scraping, whatsapp, puppeteer
naos
πŸ“‰ Uptime and error monitoring CLI
Stars: ✭ 30 (-60%)
Mutual labels:  scraping, puppeteer
browser-pool
A Node.js library to easily manage and rotate a pool of web browsers, using any of the popular browser automation libraries like Puppeteer, Playwright, or SecretAgent.
Stars: ✭ 71 (-5.33%)
Mutual labels:  scraping, puppeteer
Apify Js
Apify SDK β€” The scalable web scraping and crawling library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.
Stars: ✭ 3,154 (+4105.33%)
Mutual labels:  scraping, puppeteer
LInkedIn-Reverese-Lookup
πŸ”ŽSearch LinkedIn profile by email addressπŸ“§
Stars: ✭ 20 (-73.33%)
Mutual labels:  scraping, puppeteer
puppeteer-botcheck
πŸ•΅β€β™‚ Bot detection tests for Puppeteer. Hide and seek!
Stars: ✭ 42 (-44%)
Mutual labels:  scraping, puppeteer
bots-zoo
No description or website provided.
Stars: ✭ 59 (-21.33%)
Mutual labels:  scraping, puppeteer
Whalesong
Whalesong is an asyncio python library to manage WebApps remotely. Currently WhatsappWeb is implemented
Stars: ✭ 46 (-38.67%)
Mutual labels:  whatsapp, puppeteer
Headless Chrome Crawler
Distributed crawler powered by Headless Chrome
Stars: ✭ 5,129 (+6738.67%)
Mutual labels:  scraping, puppeteer
Awesome Puppeteer
A curated list of awesome puppeteer resources.
Stars: ✭ 1,728 (+2204%)
Mutual labels:  scraping, puppeteer
Educative.io Downloader
πŸ“– This tool is to download course from educative.io for offline usage. It uses your login credentials and download the course.
Stars: ✭ 139 (+85.33%)
Mutual labels:  scraping, puppeteer
double-agent
A test suite of common scraper detection techniques. See how detectable your scraper stack is.
Stars: ✭ 123 (+64%)
Mutual labels:  scraping, puppeteer
Venom
Venom is the most complete javascript library for Whatsapp, 100% Open Source.
Stars: ✭ 3,457 (+4509.33%)
Mutual labels:  whatsapp, puppeteer
browser-automation-api
Browser automation API for repetitive web-based tasks, with a friendly user interface. You can use it to scrape content or do many other things like capture a screenshot, generate pdf, extract content or execute custom Puppeteer, Playwright functions.
Stars: ✭ 24 (-68%)
Mutual labels:  scraping, puppeteer
Whatsapp Bot
BOT - WhatsApp Web in TypeScript
Stars: ✭ 170 (+126.67%)
Mutual labels:  whatsapp, puppeteer
Linkedin Profile Scraper
πŸ•΅οΈβ€β™‚οΈ LinkedIn profile scraper returning structured profile data in JSON. Works in 2020.
Stars: ✭ 171 (+128%)
Mutual labels:  scraping, puppeteer
Whatspup
πŸ”³ WhatsApp chat from commandline/console/cli using GoogleChrome puppeteer
Stars: ✭ 310 (+313.33%)
Mutual labels:  whatsapp, puppeteer
Wbot
A simple Web based BOT for WhatsAppβ„’ in NodeJS 😜. Working as of πŸ“… Feb 14th, 2020
Stars: ✭ 638 (+750.67%)
Mutual labels:  whatsapp, puppeteer
Tinking
🧢 Extract data from any website without code, just clicks.
Stars: ✭ 331 (+341.33%)
Mutual labels:  scraping, puppeteer
Secret Agent
The web browser that's built for scraping.
Stars: ✭ 151 (+101.33%)
Mutual labels:  scraping, puppeteer

Whatsapp Net

This project creates a network graph of connections out of your WhatsApp groups' participants data.

Prerequisites

Make sure you have installed all of the following prerequisites on your machine:

Downloading & Installing

  1. Clone this project
$ git clone https://github.com/OfirKP/Whatsapp-Net
  1. In the application directory ($ cd Whatsapp-Net), run this command:
$ npm install
  1. Install required python packages either by using requirements.txt:
$ pip install -r requirements.txt

or by installing them directly:

$ pip install networkx==2.5 tqdm==4.50.2 matplotlib==3.1.1

Usage

Scraping

To generate a json file with your groups' data, run the following command:

$ node scrape.js

A browser window should open. If you're not connected to WhatsApp web, connect by scanning QR code.

Wait until json file starts downloading.

Generating Graph (GEXF file)

Then, run the python script:

$ python generate_graph.py <data1.json> <data2.json> ...

Optional arguments:

  • -c, --contacts: paths to contacts (.json) files, so that the first file overrides names of identical contacts in other files
  • -o, --output: path to output GEXF file (default is graph.gexf)
  • -h, --help: help message to get more info about the usage of the script

Visualizing data

RECOMMENDED: use a software like Gephi that allows graph visualization, taking GEXF files as input.

πŸ’» Technologies Used

License

This project is licensed under the GNU General Public License v2.0 . See License for more info.

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].