134 Open source projects that are alternatives of or similar to Ping Sm

A web scraping tool to systematically extract the text of scientific papers and corresponding metadata from university accessible journals.

House of Apify Scrapers. Generic scraping actors with a simple UI to handle complex web crawling and scraping use cases.

Python binding to Modest engine (fast HTML5 parser with CSS selectors).

Computational Thinking for Social Scientists book project

WhatsApps related deaths News Articles along with other articles across India during that period

A JavaScript library for generating random user agents with data that's updated daily.

🇺🇸 Is the US flag at half-staff?

Node.js framework for modular web scraping and data extraction

Tableau scraper python library. R and Python scripts to scrape data from Tableau viz

[WIP] GOPA, a spider written in Golang, for Elasticsearch. DEMO: http://index.elasticsearch.cn

Explaining textual analysis tools in Python. Including Preprocessing, Skip Gram (word2vec), and Topic Modelling.

This repository contains very useful restful API's and functionalities in node-js containing many important tutorial code for mastering node-js, all tutorials have been published on medium.com, tutorials link is given below

The Python Code Tutorials

📖 Using deep learning and scraping to analyze/summarize articles! Just drop in any URL!

📈 Regression and Classification with UC Davis student quiz data and exam data

A Docker tutorial using a link extraction application example

A framework for creating semi-automatic web content extractors

Materials to reproduce our findings in our stories, "Amazon Puts Its Own 'Brands' First Above Better-Rated Products" and "When Amazon Takes the Buy Box, it Doesn’t Give it up"

Download/access photos, videos, stories, story highlights, postlives, following and followers of Instagram

Heroshi – open source web crawler.

ACHE is a web crawler for domain-specific search.

Text Mining for Indonesian Online News Articles About Corona

Collection of scripts corresponding to LucidProgramming YouTube tutorials

📻 An OLX Scraper using Scrapy + MongoDB. It Scrapes recent ads posted regarding requested product and dumps to NOSQL MONGODB.

PHP Curl Class makes it easy to send HTTP requests and integrate with web APIs

Project on building a web crawler to collect the fundamentals of the stock and review their performance in one go

Compensation analysis on the posts scraped from leetcode.com/discuss/compensation. At present, the reports have been generated only for Indian cities.

Nextjs server to query websites with GraphQL

📓 Minicurso de raspagem de dados web com Python ministrado na Semana de Tecnologia da FATEC Jundiaí

Apify actor that crawls Google Search result pages (SERPs) and extracts a list of organic results, ads, related queries and more. It supports selection of custom country, language and location.

Content based movie recommendation system with sentiment analysis

Random User-Agent middleware based on fake-useragent

Papercut is a scraping/crawling library for Node.js built on top of JSDOM. It provides basic selector features together with features like Page Caching and Geosearch.

Fetch user's data across social media

Audio Book scrapper

UI.Vision: Open-Source RPA Software (formerly Kantu) - Modern Robotic Process Automation with Selenium IDE++

🚆This web scraper builds a dataset for São Paulo subway operation status

Snoop — инструмент разведки на основе открытых данных (OSINT world)

Web application hosted on Heroku cloud platform based on web scraping in python using lxml library (XML Path Language).

List of libraries, tools and APIs for web scraping and data processing.

Simple search for organisations participating/participated in the GSoC

Go cascadia package command line CSS selector

Build a Flask web application to help users retrieve key restaurant information and feature-based reviews (generated by applying market-basket model – Apriori algorithm and NLP on user reviews).

A Smart, Automatic, Fast and Lightweight Web Scraper for Python

Scape top GitHub repositories and users based on keywords

Scraping publicly-accessible Letterboxd data and creating a movie recommendation model with it that can generate recommendations when provided with a Letterboxd username

No description or website provided.

NBA Stats API via Basketball Reference

Scraping Ebay's products using Scrapy Web Crawling Framework

Web Scraping Craigslist's Engineering Jobs in NY with Scrapy

Scrapy project for scraping data from IMDB with Movie Dataset including 58,623 movies' data.

Apify SDK — The scalable web scraping and crawling library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.

Simple scripts that I'm using to automate the boring things.

A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

API to get user details for competitive coding platforms - Codeforces, Codechef, SPOJ, Interviewbit

Powerful web scraping framework for Crystal

Headless 'Chrome' Orchestration in R

A Router WiFi key recovery/cracking tool with a twist.

Faster requests on Python 3

[Python] Scraps comics and manga from various websites and creates cbz files from them