1866 Open source projects that are alternatives of or similar to Crawlerpack

REST API client from node.js

The POCO C++ Libraries are powerful cross-platform C++ libraries for building network- and internet-based applications that run on desktop, server, mobile, IoT, and embedded systems.

A search application to explore, discover and share online files

Every web site provides APIs.

Ansible role used to deliver the Config Encoder Filters.

This branch will be HashOver 2.0

分析文件目录，统计数据并以树形结构和图表的形式展示结果，也可以导出多种格式留存

universal serialization engine

A lightweight RSS parser, for Node and the browser

news-please - an integrated web crawler and information extractor for news that just works.

An extremely fast web scraper that parses megabytes of invalid HTML in a blink of an eye. PHP5.3+, no dependencies.

A REST API that serves uniformly and well formatted jokes in JSON, XML, YAML or plain text format that also offers a great variety of filtering methods

Lightweight REST for Java

​The C++ Web Framework (CWF) is a MVC web framework, Open Source, under MIT License, using C++ with Qt to be used in the development of web applications.

Android 本地网络小说爬虫，基于jsoup及xpath

The API hosted at dog.ceo

camaro is an utility to transform XML to JSON, using Node.js binding to native XML parser pugixml, one of the fastest XML parser around.

Thoughtfully architected, obscenely fast, thoroughly enjoyable web services for all

新一代爬虫平台，以图形化方式定义爬虫流程，不写代码即可完成爬虫。

FileContextCore is a "Database"-Provider for Entity Framework Core and adds the ability to store information in files instead of being limited to databases.

📗 SheetJS Community Edition -- Spreadsheet Data Toolkit

Reflection based (Dictionary, CKRecord, NSManagedObject, Realm, JSON and XML) object mapping with extensions for Alamofire and Moya with RxSwift or ReactiveSwift

(Migrated from CodePlex) Let PowerShell Script serve or command-line process as WebAPI. PSWebApi is a simple library for building ASP.NET Web APIs (RESTful Services) by PowerShell Scripts or batch/executable files out of the box.

Simple .NET EDI X12 Reader, Writer and Validator. EDI JSON Serialization and Deserialization. Written in C#

🌍 World countries, states, regions, provinces, cities, towns in JSON, SQL, XML, PLIST, YAML, and CSV. All Countries, States, Cities with ISO2, ISO3, Country Code, Phone Code, Capital, Native Language, Timezones, Latitude, Longitude, Region, Subregion, Flag Emoji, and Currency. #countries #states #cities

JSON pretty-viewer for OS X.

XPath/XQuery 3.1 interpreter for Pascal with compatibility modes for XPath 2.0/XQuery 1.0/3.0, custom and JSONiq extensions, XML/HTML parsers and classes for HTTP/S requests

swiss-army knife for data

A fast multi-format message serializer for .NET

Korio: Kotlin cORoutines I/O : Virtual File System + Async/Sync Streams + Async TCP Client/Server + WebSockets for Multiplatform Kotlin 1.3

Command line tool to download and extract data from HTML/XML pages or JSON-APIs, using CSS, XPath 3.0, XQuery 3.0, JSONiq or pattern matching. It can also create new or transformed XML/HTML/JSON documents.

java port of Underscore.js

🎁 A glib-like multi-platform c library

Loaders for big data visualization. Website:

A powerful schema validator!

⚡ PHP7 / Laravel Multi-format Streaming Parser

A tool for mocking HTTP services

ETL Framework for .NET / c# (Parser / Writer for CSV, Flat, Xml, JSON, Key-Value, Parquet, Yaml, Avro formatted files)

The automatic type-safe REST library for .NET Core, Xamarin and .NET. Heavily inspired by Square's Retrofit library, Refit turns your REST API into a live interface.

A highly configurable logging framework for Rust

Adblock Fast is a new, faster ad blocker for Android, iOS, Chrome, and Opera.

Open Security Controls Assessment Language (OSCAL)

A list of command line tools for manipulating structured text data

SirixDB is a temporal, evolutionary database system, which uses an accumulate only approach. It keeps the full history of each resource. Every commit stores a space-efficient snapshot through structural sharing. It is log-structured and never overwrites data. SirixDB uses a novel page-level versioning approach called sliding snapshot.

Query, update and convert data structures from the command line. Comparable to jq/yq but supports JSON, TOML, YAML, XML and CSV with zero runtime dependencies.

F# Data: Library for Data Access

TreeFrog Framework : High-speed C++ MVC Framework for Web Application

Converter utility between XML text and Javascript object / JSON text.

Validate XML, Parse XML to JS/JSON and vise versa, or parse XML to Nimn rapidly without C/C++ based libraries and no callback

Java DSL for easy testing of REST services

Node.JS library for serializing/deserializing FHIR resources between JS/JSON and XML using various node.js XML libraries

Use feedr to fetch the data from a remote url, respect its caching, and parse its data. Despite its name, it's not just for feed data but also for all data that you can feed into it (including binary data).

Default Magento 2 CE import / export CSV files & sample files for Firebear Improved Import / Export extension

CSV, JSON, XML text parsers and generators written in pure POSIX shellscript

PHP Curl Class makes it easy to send HTTP requests and integrate with web APIs

tableExport（table导出文件，支持json、csv、txt、xml、word、excel、image、pdf）

World countries in JSON, CSV, XML and Yaml. Any help is welcome!

Java client for the MarkLogic enterprise NoSQL database

jsoup: the Java HTML parser, built for HTML editing, cleaning, scraping, and XSS safety.

(Migrated from CodePlex) DbWebApi is a .Net library that implement an entirely generic Web API (RESTful) for HTTP clients to call database (Oracle & SQL Server) stored procedures or functions in a managed way out-of-the-box without any configuration or coding.