572 Open source projects that are alternatives of or similar to scrapyr

Highly Available and Auto-scalable Magento Cluster

Collection of scrapy spiders which can scrape posts, images, and so on from public Facebook Pages.

Find nodes in hierarchical clustering that are statistically significant

Zyte Smart Proxy Manager (formerly Crawlera) middleware for Scrapy

A Hidden Markov Model implemented in Javascript

爬虫管理平台

A django admin site for scrapy

Distributed Elixir Cluster on Render with libcluster and Mix Releases

Machine Learning Course @ Santa Clara University

🕷️some python spiders with BeautifulSoup or scarpy

Scripts for LIUM SpkDiarization tools

A repository to store Deep Web (onion domain) crawler, scraper, and NLP tools for Tor network.

Modelling DNA methylation profiles

小密圈备份，圈子/话题/图片/文件。

REVOLVER - Repeated Evolution in Cancer

秀人网爬虫 55156爬虫

Download all the ebooks with indexed csv of "allitebooks.com"

D-Lab's 6 hour introduction to machine learning in Python. Learn how to perform classification, regression, clustering, and do model selection using scikit-learn and TPOT.

基于Scrapy框架的豆瓣电影爬虫

A fast, scalable and light-weight C++ Fréchet distance library, exposed to python and focused on (k,l)-clustering of polygonal curves.

A Data Clinic project that aggregates NYC Open Data at the tract-level and uses Machine Learning techniques to re-imagine neighborhood boundaries.

Fast, linear version of CorEx for covariance estimation, dimensionality reduction, and subspace clustering with very under-sampled, high-dimensional data

Zio-Entity, a distributed, high performance, functional event sourcing library

A Scrapy demo : Download all images from a site

PulseHA is a active-passive high availability cluster daemon that uses GRPC and is written in GO.

A lightweight MQTT broker w/ full spec,Clustering,WebSocket,SSL written in Java

Watchman: An open-source social-media event-detection system

Highly parallel DBSCAN (HPDBSCAN)

AWS-based peer discovery backend for RabbitMQ 3.7.0+

PTT 網路版爬蟲

Version 2.1.0 released

人生苦短 我用Python

[New Version] Theoretically Efficient and Practical Parallel DBSCAN

Clustering methods in Machine Learning includes both theory and python code of each algorithm. Algorithms include K Mean, K Mode, Hierarchical, DB Scan and Gaussian Mixture Model GMM. Interview questions on clustering are also added in the end.

K-Means clustering

A plugin to use with napari for clustering objects according to their properties.

No description or website provided.

A collection of pipelines for Scrapy

Single Cell Cluster Evaluation

Implements "Clustering a Million Faces by Identity"

Implementation of the k-means algorithm in PyTorch that works for large datasets

Building a model to recognize incentives for landscape restoration in environmental policies from Latin America, the US and India. Bringing NLP to the world of policy analysis through an extensible framework that includes scraping, preprocessing, active learning and text analysis pipelines.

Shell scripts to automate download of GitHub traffic statistics, cluster administration, and create an animated GIF.

Genie++ Fast and Robust Hierarchical Clustering with Noise Point Detection - for Python and R

Genie: A Fast and Robust Hierarchical Clustering Algorithm (this R package has now been superseded by genieclust)

A framework for building (and incrementally growing) graph-based data structures used in hierarchical or DAG-structured clustering and nearest neighbor search

A Locality Sensitive Hashing (LSH) library with an emphasis on large, highly-dimensional datasets.

A showcase for Proto.Actor - an ultra-fast distributed actors solution for Go, C#, and Java/Kotlin.

Web scraper project to collect the useful Hong Kong weather data from HKO website

Monte Carlo Reference-based Consensus Clustering

V2EX爬虫

Easily spawn Elixir nodes (supervising, Mix configured, easy asserted / refuted) within ExUnit tests

Source code for the MorphoCluster application described in Schroeder et al. 2020

Workshop (6 hours): Clustering (Hdbscan, LCA, Hopach), dimension reduction (UMAP, GLRM), and anomaly detection (isolation forests).

Calib clusters barcode tagged paired-end reads based on their barcode and sequence similarity.

今日头条科技新闻接口爬虫

API for scrapping common meme sites

All things Atlassian and Kubernetes

知名網站avgle下載器

exudates detection using hybrid approach (Image Morphology & Machine Learning)