DataHub: The Metadata Platform for the Modern Data Stack
Built with ❤️ by 
Acryl Data and 
LinkedIn
🏠 Project Homepage: datahubproject.io
Quickstart | Documentation | Features | Roadmap | Adoption | Demo | Town Hall
📣 Next DataHub town hall meeting on Dec 17th, 9am-10am PDT (convert to your local time)
- Topic Proposals: submit here
- Signup to get a calendar invite: here
- Town-hall Zoom link: zoom.datahubproject.io
- Meeting details & past recordings
✨ Latest Update:
- Monthly project update: October 2021 Edition.
- Bringing The Power Of The DataHub Real-Time Metadata Graph To Everyone At Acryl Data: Data Engineering Podcast
- Unleashing Excellent DataOps with LinkedIn DataHub: DataOps Unleashed Talk.
- Latest blog post DataHub: Popular Metadata Architectures Explained @ LinkedIn Engineering Blog.
- We're on Slack now! Ask questions and keep up with the latest announcements.
Introduction
DataHub is an open-source metadata platform for the modern data stack. Read about the architectures of different metadata systems and why DataHub excels here. Also read our LinkedIn Engineering blog post, check out our Strata presentation and watch our Crunch Conference Talk. You should also visit DataHub Architecture to get a better understanding of how DataHub is implemented and DataHub Onboarding Guide to understand how to extend DataHub for your own use cases.
Quickstart
Please follow the DataHub Quickstart Guide to get a copy of DataHub up & running locally using Docker. As the guide assumes some basic knowledge of Docker, we'd recommend you to go through the "Hello World" example of A Docker Tutorial for Beginners if Docker is completely foreign to you.
Demo and Screenshots
There's a hosted demo environment where you can play around with DataHub before installing.
Source Code and Repositories
- linkedin/datahub: This repository contains the complete source code for both DataHub's frontend & backend services.
- linkedin/datahub-gma: This repository contains the source code for DataHub's metadata infrastructure libraries (Generalized Metadata Architecture, or GMA).
Documentation
We have documentation available at https://datahubproject.io/docs/.
Releases
See Releases page for more details. We follow the SemVer Specification when versioning the releases and adopt the Keep a Changelog convention for the changelog format.
Features & Roadmap
Check out DataHub's Features & Roadmap.
Contributing
We welcome contributions from the community. Please refer to our Contributing Guidelines for more details. We also have a contrib directory for incubating experimental features.
Community
Join our slack workspace for discussions and important announcements. You can also find out more about our upcoming town hall meetings and view past recordings.
Adoption
Here are the companies that have officially adopted DataHub. Please feel free to add yours to the list if we missed it.
- Banksalad
- DefinedCrowd
- DFDS
- Expedia Group
- Experius
- Geotab
- Grofers
- hipages
- IOMED
- Klarna
- Peloton
- Saxo Bank
- Stash
- Shanghai HuaRui Bank
- ThoughtWorks
- TypeForm
- Uphold
- Viasat
- Wolt
Select Articles & Talks
- DataHub Blog
- DataHub YouTube Channel
- Saxo Bank: Enabling Data Discovery in Data Mesh
- Bringing The Power Of The DataHub Real-Time Metadata Graph To Everyone At Acryl Data: Data Engineering Podcast
- DataHub: Popular Metadata Architectures Explained
- Driving DataOps Culture with LinkedIn DataHub @ DataOps Unleashed 2021
- The evolution of metadata: LinkedIn’s story @ Strata Data Conference 2019
- Journey of metadata at LinkedIn @ Crunch Data Conference 2019
- DataHub Journey with Expedia Group
- Data Discoverability at SpotHero
- Data Catalogue — Knowing your data
- DataHub: A Generalized Metadata Search & Discovery Tool
- Open sourcing DataHub: LinkedIn’s metadata search and discovery platform
- Emerging Architectures for Modern Data Infrastructure
See the full list here.