1866 Open source projects that are alternatives of or similar to Crawlerpack

Reflection based (Dictionary, CKRecord, NSManagedObject, Realm, JSON and XML) object mapping with extensions for Alamofire and Moya with RxSwift or ReactiveSwift

Go package for easily rendering JSON, XML, binary data, and HTML templates responses.

ISO 3166-1 country lists merged with their UN Geoscheme regional codes in ready-to-use JSON, XML, CSV data sets

A Java/Kotlin library for Android platform, to manage bean's persistence in SQLite, SharedPreferences, JSON, XML, Properties, Yaml, CBOR.

news-please - an integrated web crawler and information extractor for news that just works.

Randomly mutate JSON, XML, HTML forms, text and binary data for fuzz testing

🐕 Fetch+ is a convenient Fetch API replacement with first-class middleware support.

(Migrated from CodePlex) DbWebApi is a .Net library that implement an entirely generic Web API (RESTful) for HTTP clients to call database (Oracle & SQL Server) stored procedures or functions in a managed way out-of-the-box without any configuration or coding.

The MarkLogic Data Hub: documentation ==>

omniparser: a native Golang ETL streaming parser and transform library for CSV, JSON, XML, EDI, text, etc.

.NET REST Client Framework for all platforms

With the Serializer component it's possible to handle serializing data structures, including object graphs, into array structures or other formats like XML and JSON. It can also handle deserializing XML and JSON back to object graphs.

SirixDB is a temporal, evolutionary database system, which uses an accumulate only approach. It keeps the full history of each resource. Every commit stores a space-efficient snapshot through structural sharing. It is log-structured and never overwrites data. SirixDB uses a novel page-level versioning approach called sliding snapshot.

Popular Node.js module for parsing JavaScript objects into XML

XML to JSON converter written in Go (no schema, no structs)

QxOrm library - C++ Qt ORM (Object Relational Mapping) and ODM (Object Document Mapper) library - Official repository

Add-on for Google Sheets that allows sheets to be exported as JSON or XML.

Android logger, pretty, powerful and flexible, log to everywhere, save to file, all you want is here.

validation api extracted from play

dict subclass with keylist/keypath support, I/O shortcuts (base64, csv, json, pickle, plist, query-string, toml, xml, yaml) and many utilities. 📘

Server framework and network components written by C/C++ for Linux, Mac, FreeBSD, Solaris(x86), Windows, Android, IOS

A type-safe cascading configuration library for Kotlin/Java/Android, supporting most configuration formats

A simple implementation of the api-problem specification. Includes PSR-15 support.

Türkiye İl, İlçe, Mahalle, Sokak, Cadde Bilgisi SQL Şeklinde

Go parsers for web formats

XPath/XQuery 3.1 interpreter for Pascal with compatibility modes for XPath 2.0/XQuery 1.0/3.0, custom and JSONiq extensions, XML/HTML parsers and classes for HTTP/S requests

Convert between json string and c++ object. json字符串和c++结构体之间互相转换

PHP Curl Class makes it easy to send HTTP requests and integrate with web APIs

(Migrated from CodePlex) Let PowerShell Script serve or command-line process as WebAPI. PSWebApi is a simple library for building ASP.NET Web APIs (RESTful Services) by PowerShell Scripts or batch/executable files out of the box.

An extremely fast web scraper that parses megabytes of invalid HTML in a blink of an eye. PHP5.3+, no dependencies.

JSON pretty-viewer for OS X.

Every web site provides APIs.

swiss-army knife for data

Command line tool to download and extract data from HTML/XML pages or JSON-APIs, using CSS, XPath 3.0, XQuery 3.0, JSONiq or pattern matching. It can also create new or transformed XML/HTML/JSON documents.

java port of Underscore.js

🎁 A glib-like multi-platform c library

Korio: Kotlin cORoutines I/O : Virtual File System + Async/Sync Streams + Async TCP Client/Server + WebSockets for Multiplatform Kotlin 1.3

The API hosted at dog.ceo

⚡ PHP7 / Laravel Multi-format Streaming Parser

分析文件目录，统计数据并以树形结构和图表的形式展示结果，也可以导出多种格式留存

ETL Framework for .NET / c# (Parser / Writer for CSV, Flat, Xml, JSON, Key-Value, Parquet, Yaml, Avro formatted files)

Thoughtfully architected, obscenely fast, thoroughly enjoyable web services for all

The automatic type-safe REST library for .NET Core, Xamarin and .NET. Heavily inspired by Square's Retrofit library, Refit turns your REST API into a live interface.

The POCO C++ Libraries are powerful cross-platform C++ libraries for building network- and internet-based applications that run on desktop, server, mobile, IoT, and embedded systems.

Loaders for big data visualization. Website:

📗 SheetJS Community Edition -- Spreadsheet Data Toolkit

A list of command line tools for manipulating structured text data

Open Security Controls Assessment Language (OSCAL)

Java DSL for easy testing of REST services

Use feedr to fetch the data from a remote url, respect its caching, and parse its data. Despite its name, it's not just for feed data but also for all data that you can feed into it (including binary data).

Default Magento 2 CE import / export CSV files & sample files for Firebear Improved Import / Export extension

jsoup: the Java HTML parser, built for HTML editing, cleaning, scraping, and XSS safety.

XML Security Library

Python script that collects SSL/TLS information from hosts

The Pythonic way to use JSON - with native objects 🛠 and path support 📁

Open Data Portals and Sites around the world

SNMP MIB parser

Scrapoxy hides your scraper behind a cloud. It starts a pool of proxies to send your requests. Now, you can crawl without thinking about blacklisting!

Coq Protocol Playground with Se(xp)rialization of Internal Structures.

Opensource FinTech standards & payment provider data