All Projects → rhysd → Github Clone All

rhysd / Github Clone All

Licence: mit
Clone (~1000) repos matched to query on GitHub using Search API

Programming Languages

go
31211 projects - #10 most used programming language

Projects that are alternatives of or similar to Github Clone All

git-pull-or-clone
Ensure a git repo exists on disk and that it's up-to-date
Stars: ✭ 46 (+2.22%)
Mutual labels:  clone, repository
Urf.core.sample
URF.Core Sample Solution - E2E sample built with ASP.NET Core, Entity Framework Core, URF.Core, Angular, Kendo UI & OData Core. Live demo: https://goo.gl/QpJVgd
Stars: ✭ 40 (-11.11%)
Mutual labels:  repository
Docker Nexus3
Dockerized version of Nexus Repo Manager 3
Stars: ✭ 917 (+1937.78%)
Mutual labels:  repository
Image Relocation
Docker/OCI image relocation
Stars: ✭ 21 (-53.33%)
Mutual labels:  repository
Repo
Arch Linux CN Repository
Stars: ✭ 929 (+1964.44%)
Mutual labels:  repository
Jetweet
Jetweet is a mini twitter clone with basic functionalities, Made using ASP.NET CORE and Entity framework technologies
Stars: ✭ 29 (-35.56%)
Mutual labels:  clone
Proxmark3
RRG / Iceman repo, the most totally wicked repo around if you are into Proxmark3
Stars: ✭ 901 (+1902.22%)
Mutual labels:  clone
Deepcopy
Create deep copies (clones) of your objects
Stars: ✭ 8,089 (+17875.56%)
Mutual labels:  clone
Expo Stack
🎮🧱 stack game clone made in expo (ios, android, web), three.js, react native
Stars: ✭ 34 (-24.44%)
Mutual labels:  clone
Hall Of Fame
🏆 Show some love to your contributors! A widget for your repo README. Visual and clean. Refreshes every hour.
Stars: ✭ 911 (+1924.44%)
Mutual labels:  repository
Repos
Pull down a list of GitHub repos for the given user or org, and save to a local JSON file.
Stars: ✭ 20 (-55.56%)
Mutual labels:  repository
Google Forms
Clone of google forms using React and Node JS.
Stars: ✭ 27 (-40%)
Mutual labels:  clone
Landr
Repository + Landr = Website
Stars: ✭ 30 (-33.33%)
Mutual labels:  repository
Shallow Clone
Make a shallow clone of an object, array or primitive.
Stars: ✭ 23 (-48.89%)
Mutual labels:  clone
Weihanli.entityframework
EntityFramework extensions
Stars: ✭ 42 (-6.67%)
Mutual labels:  repository
Furion
Make .NET development easier, more versatile, and more popular.
Stars: ✭ 902 (+1904.44%)
Mutual labels:  repository
Repo.js
📄 A plugin to embed Github repos on your site
Stars: ✭ 885 (+1866.67%)
Mutual labels:  repository
Tent
Content management with Github hosted Markdown as an authoritative data source
Stars: ✭ 28 (-37.78%)
Mutual labels:  repository
Clash Royale Clone
A Unity clone of Supercell's Clash of Clans spin-off mobile game Clash Royale with possibly some twists.
Stars: ✭ 43 (-4.44%)
Mutual labels:  clone
Repository Edge
EDGE - Home Assistant Community Add-ons
Stars: ✭ 42 (-6.67%)
Mutual labels:  repository

Clone matching repos on GitHub

GoDoc Badge Mac and Linux Build Status Windows Build Status Coverage Status

$ github-clone-all [flags] {query}

github-clone-all is a small command to clone all repositories matching to the given query and language via GitHub Search API. To know the detail of query, please read official document for GitHub Repository Search. The query should be in GitHub search syntax and cannot be empty. It clones many repositories in parallel. Please see -help option to know all flags.

Repositories re cloned to 'dest' directory. It is ./repos by default and can be specified with -dest flag. And in order to reduce size of cloned repositories, -extract option is available. -extract only leaves files matching to the given regular expression in cloned repository.

Because of restriction of GitHub search API, the max number of results is 1000 repositories. And you may need to get GitHub API token in advance to avoid hitting API rate limit. github-clone-all will refer the token via -token flag or $GITHUB_TOKEN environment variable.

All arguments in {query} are regarded as query. For example, github-clone-all foo bar will search foo bar. But quoting the query is recommended to avoid conflicting with shell special characters as github-clone-all 'foo bar'.

Installation

Use go get or released binaries.

$ go get github.com/rhysd/github-clone-all

Example

$ github-clone-all -extract '(\.vim|vimrc)$' 'language:vim fork:false stars:>1'

The above command will clone first 1000 repositories into ./repos directory directory. And it only leaves files whose file name ends with .vim or vimrc. So it collects many Vim script files from famous repositories on GitHub.

Query condition:

  • language is 'vim'
  • not a fork repo
  • stars of repo is more than 1
$ github-clone-all -count 1 'language:javascript'

The above command will clone the most popular repository of JavaScript on GitHub.

$ github-clone-all -dry 'language:go'

The above command will only list up most popular 1000 repositories of Go instead of cloning them.

$ github-clone-all -deep -ssh 'user:YOUR_USER_NAME fork:false'

The above command will clone all your repositories (except for forks) with full history. It's useful when you want to clone all your repositories.

How to get GitHub API token

  1. Visit https://github.com/settings/tokens in a browser
  2. Click 'Generate new token'
  3. Add token description
  4. Without checking any checkbox, click 'Generate token'
  5. Generated token is shown at the top of your tokens list

Use github-clone-all programmatically

github-clone-all consists of tiny main.go and ghca package. You can import ghca to utilize functions of the tool.

import "github.com/rhysd/github-clone-all/ghca"

Please read documentation for more details.

License

MIT license

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].