Nexus Repository Google Cloud Storage Blobstore
This project adds Google Cloud Object Storage backed blobstores to Sonatype Nexus Repository 3 and later. It allows Nexus Repository to store the components and assets in Google Cloud instead of a local filesystem.
This plugin also uses Google Firestore in Datastore mode to store some metadata about the blobstore. The plugin prioritizes using Small Operations, which have no financial cost, but do use some limited paid operations (read, write, delete) in a cost effective manner.
Which Version do I use?
For the best experience, you should upgrade your Nexus Repository Manager and Google Cloud Blobstore plugin to the latest versions.
- Navigate to https://search.maven.org/artifact/org.sonatype.nexus.plugins/nexus-blobstore-google-cloud
- Select the version that matches your Nexus Repository Manager version. Example: 0.39 of the plugin is intended for Repository Manager 3.39, 0.38 for 3.38, etc.
- Download the corresponding
kar
archive.
Deploying the Plugin
Google Cloud Services and IAM Roles
This plugin uses the following Google Cloud Platform services:
- Google Cloud Storage - for storing the content blobs
- Google Cloud Firestore in Datastore mode - for storing blobstore metadata
Firestore usage is exclusively in Datastore mode; you must configure the project for your Repository Manager deployment to use "Firestore in Datastore mode".
To use this plugin (or execute the integration tests), you will need a service account with the following scopes:
- https://www.googleapis.com/auth/cloud-platform
- https://www.googleapis.com/auth/compute.readonly
- https://www.googleapis.com/auth/devstorage.read_write
- https://www.googleapis.com/auth/datastore
Optionally, add the following for Cloud Logging:
The blobstore will create the storage bucket with the 'Multi-Regional' storage class.
Google Cloud Storage Authentication
Per the Google Cloud documentation:
- Generate a JSON Service Account key
- Store this file on the filesystem with appropriate permissions for the user running Nexus to read it.
- (optional, but recommended) Set the
GOOGLE_APPLICATION_CREDENTIALS
environment variable for the user running Nexus:
export GOOGLE_APPLICATION_CREDENTIALS=/path/to/my/key.json
Installing
After downloading the kar from Maven Central (links above), copy the kar file to the deploy
directory in your Nexus
Repository Manager install:
cp nexus-blobstore-google-cloud-*-bundle.kar /path/to/your/nxrm3/install/deploy
Configuration
A restart of Nexus Repository Manager is required to complete the installation process.
Log in as admin and create a new blobstore, selecting 'Google Cloud Storage' as the type.
If you did not set the environment variable in Step 3 above, specify the absolute path to the JSON Service Account key file.
Contributing to Plugin Development
Contribution Guidelines
Go read our contribution guidelines to get a bit more familiar with how we would like things to flow.
Requirements
- Apache Maven 3.3.3+
- Java 8+
- Network access to https://repository.sonatype.org/content/groups/sonatype-public-grid
Also, there is a good amount of information available at Bundle Development Overview
Building from Source
To build the project and generate the bundle use Maven:
mvn clean package
Optional: review the additional documentation to configure and run integration tests.
A docker-compose file is provided to ease setting up a local NXRM instance to test.
docker swarm init
docker volume create nexus3-data
docker secret create google_application_credentials /path/to/your/google/iam/key.json
docker-compose up
You can also use the docker-compose file with docker service, like so:
docker stack deploy -c docker-compose.yml sonatype
(Using docker stack assumes you've built the container with docker build -t nexus3-google .
or run docker-compose up
at least once).
Last manual option: you can install the local development build in any NXRM install with:
cp target/*-bundle.kar /path/to/your/nxrm3/install/deploy
The Fine Print
It is worth noting that this is NOT SUPPORTED by Sonatype, and is a contribution of ours to the open source community (read: you!)
Remember:
- Use this contribution at the risk tolerance that you have
- Do NOT file Sonatype support tickets related to Google Cloud support
- DO file issues here on GitHub, so that the community can pitch in
Phew, that was easier than I thought. Last but not least of all:
Have fun creating and using this plugin and the Nexus platform, we are glad to have you here!
Getting help
Looking to contribute to our code but need some help? There's a few ways to get information:
- Chat with us on Gitter
- Check out the Nexus3 tag on Stack Overflow
- Check out the Nexus Repository User List