3533 Open source projects that are alternatives of or similar to Terpene Profile Parser For Cannabis Strains

Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架

Lite version of Crawlab. 轻量版 Crawlab 爬虫管理平台

[WIP] GOPA, a spider written in Golang, for Elasticsearch. DEMO: http://index.elasticsearch.cn

Unofficial API for finviz.com

Carefully curated resource links for data science in one place

PTT 網路版爬蟲

data⎰describe: Pythonic EDA Accelerator for Data Science

The premier open source Data Quality solution

Turbodbc is a Python module to access relational databases via the Open Database Connectivity (ODBC) interface. The module complies with the Python Database API Specification 2.0.

Unix, R and python tools for genomics and data science

Life is short, *****.

Javascript full-stack framework for Big Data visualisation and analysis

Pathogen-Host Analysis Tool - A modern Next-Generation Sequencing (NGS) analysis platform

Continuous scalable web crawler built on top of Flink and crawler-commons

A React web application to query and share any PostgreSQL database.

Easy way to brute-force web directory.

Interactive network visualization in Python and Dash, powered by Cytoscape.js

swiss army knife for hackers

A collection of awesome web crawler,spider in different languages

Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)

This is a repository of a topic-centric public data sources in high quality for Recommender Systems (RS)

A search application to explore, discover and share online files

Aggregate results from bioinformatics analyses across many samples into a single report.

A multi-thread crawler framework with many builtin image crawlers provided.

课题组每周研讨会

用严肃的数据来回答“什么样的企业会到什么样的大学招聘”？

Rust Web Crawler saving pages on Redis

Proxy pool. Finds and checks proxies with rest api for querying results. Can find over 25k proxies in under 5 minutes.

📻 An OLX Scraper using Scrapy + MongoDB. It Scrapes recent ads posted regarding requested product and dumps to NOSQL MONGODB.

A curated list of awesome bioinformatics software.

Raspagem de dados para iniciante usando Scrapy e outras libs básicas

The simple, easy to use command line web crawler.

Cross-platform normalization enables machine learning model training on microarray and RNA-seq data simultaneously

Web Application Security Scanner Framework

List of datasets to apply stats/machine learning/technology to the world of social good.

A web crawler. Supercrawler automatically crawls websites. Define custom handlers to parse content. Obeys robots.txt, rate limits and concurrency limits.

An interpreted relational query language that compiles to SQL.

新一代爬虫平台，以图形化方式定义爬虫流程，不写代码即可完成爬虫。

Crawlera middleware for Scrapy

✎ Simple, personal journaling progressive web app

A framework for creating semi-automatic web content extractors

Easy-to-use data analysis / manipulation framework for humans

The Most Advanced Time Series Platform

基于搜狗微信搜索的微信公众号爬虫接口

This is a database of 180.000+ symbols containing Equities, ETFs, Funds, Indices, Futures, Options, Currencies, Cryptocurrencies and Money Markets.

Simple but useful Python web scraping tutorial code.

A Facebook crawler

A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

HTTP API for Scrapy spiders

Efficient variant-call data storage and retrieval library using the TileDB storage library.

Redis-based components for Scrapy.

Scrapy as a Web Crawler for Azure Search Samples

Single-Cell Analysis in Python. Scales to >1M cells.

Analysis pipelines for sequencing data

Complete-Life-Cycle-of-a-Data-Science-Project

R package for analyzing single-cell RNA-seq data

💖 High available distributed ip proxy pool, powerd by Scrapy and Redis

🐣 locally query the ncbi taxonomy

AV 电影管理系统， avmoo , javbus , javlibrary 爬虫，线上 AV 影片图书馆，AV 磁力链接数据库，Japanese Adult Video Library,Adult Video Magnet Links - Japanese Adult Video Database