databricks-notebook
Collection of Sample Databricks Spark Notebooks ( mostly for Azure Databricks )
Sample Notebooks
| Notebook | Description | Lang |
|---|---|---|
| File Operations Sample | Various file operations sample such as Azure Blob Storage mount & umount, ls/rm/cp/mv, read CSV file, etc | Python |
| ELT Sample: Azure Blob Stroage - Databricks - CosmosDB | In this notebook, you extract data from Azure Blob Storage into Databricks cluster, run transformations on the data in Databricks cluster, and then load the transformed data into Azure Cosmos DB | Python |
| ELT Sample: Azure Blob Stroage - Databricks - SQLDW | In this notebook, you extract data from Azure Blob Storage into Databricks cluster, run transformations on the data in Databricks cluster, and then load the transformed data into Azure SQL Data Warehouse | Python |
| Streaming Sample: Cosmos DB ChangeFeed - Databricks | In this notebook, you read a live stream of tweets that stored in Cosmos DB by leveraging Apache Spart to read the Cosmos DB's Change Feed, and run transformations on the data in Databricks cluster | Python |
| Streaming Sample: Azure Event Hub - Databricks | In this notebook, you connect Azure Event Hub (hyper-scale data ingestion service) with Azure Databricks to stream data into an Apache Spark cluster in near real-time | Python |
Contributing
Bug reports and pull requests are welcome on GitHub at https://github.com/yokawasa/databricks-notebook