Databricks SQL Analytics – Quick introduction:
Databricks SQL is now Generally Available (GA) providing a new generation of analytics & data applications, running directly on the data lake with data warehousing capabilities & SQL support on the Databricks Lakehouse Platform.
Databricks SQL (DB SQL):
- allows us to operate on a multi-cloud lakehouse architecture
- provides thousands of optimizations option for the best performance for all query types and real-world applications using Photon, the next-generation query engine which provides up to 12x better price/performance compared to other cloud data warehouses.
Important Features:
- Reliable, lightning-fast analytics on data lake data: Run SQL queries on lakehouse with more reliability, quality, security and performance to data lake to support traditional analytics.
- Simplified administration and governance for lakehouse: Easy to set up & manage elastic SQL compute resources which is decoupled from storage allowing us to scale independently.
- Analytics with existing preferred tools: Easy integration with existing BI tools like Tableau, PowerBI etc maintaining a single source of truth for most recent and complete data without moving data into a data warehouse.
- Familiar SQL development experience: Allows data analysts to quickly discover/easily explore Delta Lake table schemas for ad hoc analysis using familiar SQL syntax. SQL queries can be saved for quick reuse, and query results can be cached to keep run times short.
- Quickly discover and share new insights: Allows analysts to build variety of rich visualizations using query results & map to a dashboards which can be shared and configured to automatically refresh, as well as to alert the team to meaningful changes in the data