Azure Databricks—Apache Spark as a Service with Sascha Dittmann
Download as PDF, PPTX0 likes729 views
The document discusses Azure Databricks as a service offered by Microsoft, emphasizing its ease of use and integration with Azure Data Lake and Big Data storage solutions. It highlights use cases including wind farms and heating systems, along with the architecture involving batch layers, speed layers, and structured streaming for real-time data processing. Various features such as managed clusters, machine learning models, and real-time analytics capabilities are also mentioned.
More Related Content
Similar to Azure Databricks—Apache Spark as a Service with Sascha Dittmann(20)
![IMPACT OF SOCIAL MEDIA MARKETING ON BRAND ENGAGEMENT UPDATED[1][1]-1.docx](https://cdn.slidesharecdn.com/ss_thumbnails/impactofsocialmediamarketingonbrandengagementupdated11-1-250909101007-18a150a4-thumbnail.jpg?width=560&fit=bounds)
Azure Databricks—Apache Spark as a Service with Sascha Dittmann
- 1. Sascha Dittmann, MicrosoftDeutschland GmbH Azure Databricks Spark as a Service #SAISDS6 @SaschaDittmann
- 2.
- 3. CONTROL EASE OFUSE Azure Data Lake Store Azure Storage BIGDATA STORAGE BIGDATA ANALYTICS ReducedAdministration Data Engineering in a Job-as-a-service model Azure Data Lake Analytics Big Data as-a-service Any Hadoop technology, any distribution Azure Marketplace HDP | CDH | MapR IaaS Clusters Workload optimized, managed clusters Managed Clusters Azure HDInsight Frictionless & Optimized Spark clusters Azure Databricks #SAISDS6 @SaschaDittmann
- 4. Cloud storage Data warehouses Hadoopstorage IoT / streaming data Machine learning models BI tools Data exports Data warehouses Azure Databricks Enhance Productivity Build on secure & trusted cloud Scale without limits #SAISDS6 @SaschaDittmann
- 5. DEMO How to getstarted with Azure Databricks #SAISDS6 @SaschaDittmann
- 6. Use Case Wind Farms #SAISDS6@SaschaDittmann
- 7. #SAISDS6 @SaschaDittmann computed batch view servinglayer computed batch view master dataset batch layer pre- compute storage speed layer structured streaming real-time view
- 8. DEMO Use Case: WindFarms #SAISDS6 @SaschaDittmann
- 9. Use Case Heating Systems #SAISDS6@SaschaDittmann
- 10. Azure Cosmos DB #SAISDS6@SaschaDittmann
- 11. master dataset computed batch view #SAISDS6@SaschaDittmann batch layer serving layer speed layer pre- compute storage structured streaming computed batch view real-time view change feed
- 12. #SAISDS6 @SaschaDittmann master dataset computed batchview collections computed batch view pre- compute
- 13. #SAISDS6 @SaschaDittmann master dataset computed batchview collections computed batch viewchange feed structured streaming real-time view
- 14. DEMO Use Case: HeatingSystems #SAISDS6 @SaschaDittmann