699 Open source projects that are alternatives of or similar to Pittapi

Ruby gem to inspect completely a web page. It scrapes a given URL, and returns you its meta, links, images more.

API/UI server for the Great British Public Toilet Map

📙 中华新华字典数据库。包括歇后语，成语，词语，汉字。

A web scraper starter project

一个基于webmagic框架二次开发的java爬虫框架实战，已实现能爬取腾讯，搜狐，今日头条（单独集成功能）等资讯内容，配合elasticsearch框架用法，实现了自动爬虫，已投入线上生产使用。

🚌 Analysing Israel's public transport data

Open data and performance hub for the City of Austin Transportation Department

Download Impartus lectures, convert to mkv for offline viewing.

Core repo for

Scraps historical stock market data from Yahoo Finance (https://finance.yahoo.com/)

Golang pkg to quickly return a preview of a webpage (title/description/images)

No description or website provided.

Código perteneciente al portal español de Datos Abiertos datos.gob.es.

Web service and CLI tool for SEO site audit: crawl site, lighthouse all pages, view public reports in browser. Also output to console, json, csv, xlsx, Google Drive.

The participatory democracy framework. A generator and multiple gems made with Ruby on Rails

🔎 A simple yet powerful module to retrieve organic search results and much more from Google.

Scrape a Facebook profile and turn it into a JSON file

A simple web scraper built around the JavaFX WebEngine

This research seeks to examine best practice in the field of digital editions by collating relevant evidence in a detailed catalogue of extant digital projects.

Search and download mangas from the command line

Site que publica as informações libertadas pelo DadosJusBR

CKAN docker images, docker-compose and examples

📈 Create GIFs from user's GitHub activity graph

Wget-AT is a modern Wget with Lua hooks, Zstandard (+dictionary) WARC compression and URL-agnostic deduplication.

我的爬虫合集

Transformation to Open Science

Tangerine Bank scraper

A free TVTime API based on scraping TVTime website. No API key required

Process live and historical data from luftdaten.info, IRCELINE and OpenAQ. Filter by station-id, sensor-id and sensor-type, apply reverse geocoding, store into timeseries and RDBMS databases, publish to MQTT, output as JSON or visualize in Grafana.

A survey of Brazilian states' and municipalities' transparency and open data portals, as well as institutional websites, obtained from several public data sources. 🇧🇷 Levantamento de portais estaduais e municipais de transparência e dados abertos, bem como os portais institucionais, obtido a partir de diversas fontes públicas de dados.

Python tools for data analysis

Scrapers for many e-SAJ systems

API powering the code.gov source code harvester

Study material (slides, documents, etc) for the Web Applications I course (Politecnico di Torino, 2019/2020)

117th United States Senate - View Contact Information for United States Senators, including: Phone Number, Mailing Address, Official Website, Twitter & Facebook Accounts.

No description or website provided.

Scrape Instagram content and stories anonymously, using a new technique based on the har file (No Token + No public API).

Page metadata as a service

The installation profile for SODA distribution

🌐 linkedresearch.org

Aiohttp web server API, which scrapes Google and returns scrape results as response. Supports proxies, multiple geos and number of results.

Open weather data for humans

Web scraper that can create an offline readable version of a website

A PHP Scraping Class

A course downloader/scrapper for https://www.pluralsight.com

Notes from courses in Electrical & Computer Engineering in AUTh (not officially affiliated with the university). All notes are written in Greek using LaTeX.

IMDbPY is a Python package useful to retrieve and manage the data of the IMDb movie database about movies, people, characters and companies

Tracking our progress moving all city paper and pdf forms online.

Scraper example built on Scala, Akka and Jsoup

Sakarya Üniversitesi'nde okuduğum süre boyunca karşıma çıkan tüm ödevler, ders notları ve çıkmış sınav soruları (All the assignments, lecture notes and exams)

University management platform dedicated for post-graduation in computer science field using django rest framework.

Backend for departure times in InfoPlus DVS (Dutch standard)

Python3 API wrapper and web scraper for https://coinmarketcap.com

An open API for the University of Maryland

Open Data Day website

🐙 Get Daily 400-500 Real Followers 👽 [BadRobo] is Best Instagram Bot Available Now with All Features!. Our BOT did not violate any of Instagram's rules, so you don't have to worry about getting ACTION BLOCK!

Our discussion forum (see "issues") for the OpenCon Do-A-Thon, a day of trying, making, testing and doing to advance Open Research & Education. See our full website, with more information (including Github Help, and how to get involved).

Readability / Html Content / Article Extractor & Web Scrapping library written in PHP

Kuwala is the no-code data platform for BI analysts and engineers enabling you to build powerful analytics workflows. We are set out to bring state-of-the-art data engineering tools you love, such as Airbyte, dbt, or Great Expectations together in one intuitive interface built with React Flow. In addition we provide third-party data into data sc…