All Git Users → PuerkitoBio

6 open source projects by PuerkitoBio

[ Open user page on Github ]

Package rehttp implements a Go HTTP transport that handles retries.

✭ 170

go http-client retry

Polite, slim and concurrent web crawler.

✭ 1,962

go crawler robots-txt

A little like that j-thing, only in Go.

✭ 10,931

go Roff shell jquery html-parsing selector-strings goquery

A simple and flexible web crawler that follows the robots.txt policies and crawl delays.

✭ 753

tiny Go library to normalize URLs

✭ 391

Proper URL escaping as per RFC3986

✭ 25

1-6 of 6 user projects