271 Open source projects that are alternatives of or similar to ksoup

Jsoup Annotations POJO

Sometimes we need to scrap web data from our Android App. To achieve this goal jsoup library is a good option. I wrote a blog post on this topic in my personal blog. If you know Bengali language then you can visit this link.

A very fast POJO codec for MongoDB (used in conjunction with the Mongo Java Driver) that handles generic types as well as polymorphic class hierarchies

Simple app for scraping author profiles and tutorials from Scotch.io - https://scotch.io.

**[ARCHIVED]** website changes tracker 🔍

A Scrapy extension to log items coverage when the spider shuts down

Chopper is a tool to extract elements from HTML by preserving ancestors and CSS rules

Projeto de monitoramento de publicações oficiais relacionadas a COVID-19 no Brasil.

MITM HTTP(S) proxy with integrated load-balancing, rate-limiting and error handling. Built for automated web scraping.

.NET agile and extensible web searching API

This class can retrieve search results from Google.

NBA Daily Fantasy Lineup Optimizer for FanDuel Using Python

Web Scraping Framework

Tutorial for web scraping / crawling with Node.js.

Download images from reddit

Made for pornhub. Fork from tinyMediaManager v3

With Selenium headless browsing and CAPTCHA solving

Serverless selenium which dynamically execute any given code.

🔎Search LinkedIn profile by email address📧

Machine learning for beginner(Data Science enthusiast)

Generate JSON representations of HTML tables

TV Series is a tool that scrapes Episode Synopsis' of popular TV Series' from websites like Wikipedia / IMDb and show in one place with a user-friendly navigation UI.

Generate POJOs for database table/columns

Python & command-line tool to gather text on the Web: web crawling/scraping, extraction of text, metadata, comments

List of major web + mobile browser user agent strings. +1 Bonus script to scrape :)

Distributed crawling framework for documents and structured data.

Instagram Photo Downloader

Python (asyncio) wrapper for hackernews api

A test suite of common scraper detection techniques. See how detectable your scraper stack is.

🦀 Scraping & crawling websites using Rust, and ReasonML

爬虫工程师常用的 Chrome 插件 | Chrome extensions used by crawler developer

A website dedicated to making recipes from any website easy to read.

🤖 A Versatile Telegram Bot

youtube & tiktok analysis + youchoose recommendation custmizer. backend, extensions, and tooling

Pillaging the seven seas for torrents, pieces of eight and other bounty.

[Deprecated - Maintenance mode - use APIs directly please!] The official Diffbot client library

Tool to scrape linkedin

The simplest demo of chrome automation by python and selenium in AWS Lambda

A CLI for Mozilla Readability. Get clean, uncluttered, ready-to-read HTML from any webpage!

The 4CAT Capture and Analysis Toolkit provides modular data capture & analysis for a variety of social media platforms.

⚽ Instantly find 🏆EURO 2016 live-streams & highlights, now a Web App!

extract data from html table

Basic setup with random user agents and IP addresses for Python Scrapy Framework.

A Selenium-driven tool for automated website interaction and scraping.

Pahe.ph [Pahe.in] Movies Website Scraper

Provides a virtual web browser (a.k.a. "headless browser") appearing as a node.

Tiny little ruby on rails website that crawls though your public github repos to find out what your favourite languages are.

Lightweight parallel Java tasks

Generate a network graph of connections from your WhatsApp groups data

A library to read a YML file with Xpath or CSS Selectors and extract data from HTML pages using them

A Telegram bot combined with python to serve some basic functions like weather, music charts, cricket score and much more.

👨‍👩‍👦 Social account detection and extraction in Python, e.g. for crawling/scraping.

Use SQL on various data sources

Overwatch API library for player details and career stats

📄 Python tool to turn Notion.so pages into lightweight, customizable static websites

scrapers for building your own image databases

Retrieve real (with Javascript executed) HTML code from an URL, ultra fast and supports multiple parallel loading of webs

🕵‍♂ Bot detection tests for Puppeteer. Hide and seek!

Easily crawl news portals or blog sites using Storm Crawler.

This app download all the book available on (http://libgen.io/)