data engineering
-
Databricks SQL: Aggregate Metrics at the Correct Grain
Databricks SQL Tutorial: Aggregate Metrics at the Correct Grain Databricks SQL Tutorial: Aggregate Metrics at the Correct Grain This tutorial focuses on ensuring you aggregate metrics at the appropriate granularity within Databricks SQL. Incorrect grain can lead to misleading insights. We will progress through three scripts, each building upon the previous one. Script 1: Basic…
A1, aggregate, category:data cable, category:desktop pc, category:education, category:software, coding, correct, data engineering, databricks, databricks sql, delta lake, education, grain, Metrics., paragraph ordering, paragraph structure, paragraphorder, profession:data analyst, profession:data scientist, profession:developer, profession:linguist, profession:student, profession:teacher, profession:translator, progressive learning, sql, sql engineering -
Databricks SQL: Combine Result Sets with UNION and UNION ALL
Databricks SQL Tutorial: UNION and UNION ALL Databricks SQL Tutorial: Combine Result Sets with UNION and UNION ALL This tutorial guides you through combining result sets in Databricks SQL using the `UNION` and `UNION ALL` statements. We’ll progress through increasingly complex examples to solidify your understanding. Script 1: Basic UNION The first script demonstrates the…
(all), A1, category:data cable, category:desktop pc, category:education, category:software, coding, combine, data engineering, databricks, databricks sql, delta lake, education, paragraph ordering, paragraph structure, paragraphorder, profession:data analyst, profession:data engineer, profession:linguist, profession:software developer, profession:student, profession:teacher, profession:translator, progressive learning, result, sets, sql, sql engineering, union -
Databricks SQL: Create External Tables at Governed Locations
Databricks SQL Tutorial: Create External Tables at Governed Locations Databricks SQL Tutorial: Create External Tables at Governed Locations This tutorial guides you through creating external tables in Databricks SQL, specifically focusing on using governed locations. We’ll proceed with a series of scripts, each building upon the previous one to progressively develop your understanding. Script 1:…
A1, category:data cable, category:desktop pc, category:digital product, category:education, category:software, coding, Create, data engineering, databricks, databricks sql, delta lake, education, External, governed, locations, paragraph ordering, paragraph structure, paragraphorder, profession:data analyst, profession:data engineer, profession:data scientist, profession:linguist, profession:student, profession:teacher, profession:translator, progressive learning, sql, sql engineering, tables -
Databricks SQL: Audit Effective Grants with SHOW GRANTS
Databricks SQL: Audit Effective Grants with SHOW GRANTS Tutorial Databricks SQL: Audit Effective Grants with SHOW GRANTS This tutorial demonstrates how to use the `SHOW GRANTS` command in Databricks SQL to audit effective grants on a table. We’ll progress through three scripts, each focusing on a slightly more complex scenario. Script 1: Basic Grant Audit…
A1, audit, category:computer, category:data cable, category:education, category:software, coding, data engineering, databricks, databricks sql, delta lake, education, Effective, grants, paragraph ordering, paragraph structure, paragraphorder, profession:data analyst, profession:data engineer, profession:data scientist, profession:linguist, profession:student, profession:teacher, profession:translator, progressive learning, Show, sql, sql engineering -
Databricks SQL: Grant Least-Privilege Catalog Access
Databricks SQL: Grant Least-Privilege Catalog Access Databricks SQL: Grant Least-Privilege Catalog Access This tutorial demonstrates how to grant least-privilege access to a Databricks SQL catalog using SQL commands. We’ll focus on a practical scenario and build up the permissions incrementally. Script 1: Create a Sample Catalog and User This script creates a simple catalog and…
A1, Access, Catalog, category:data cable, category:desktop pc, category:education, category:networking, category:software, coding, data engineering, databricks, databricks sql, delta lake, education, grant, least-privilege, paragraph ordering, paragraph structure, paragraphorder, profession:data analyst, profession:data engineer, profession:database administrator, profession:linguist, profession:student, profession:teacher, profession:translator, progressive learning, sql, sql engineering -
Databricks SQL: Protect Sensitive Columns with Masks
Databricks SQL: Protecting Sensitive Columns with Masks Databricks SQL: Protecting Sensitive Columns with Masks This tutorial demonstrates how to protect sensitive columns within your Databricks SQL tables using masking. Masking allows you to redact or substitute data while maintaining the structure and format of the original column, preventing unauthorized access to the actual values. Script…
A1, category:data cable, category:education, category:security, category:software, coding, columns, data engineering, databricks, databricks sql, delta lake, education, masks, paragraph ordering, paragraph structure, paragraphorder, profession:data analyst, profession:data engineer, profession:developer, profession:linguist, profession:student, profession:teacher, profession:translator, progressive learning, protect, sensitive, sql, sql engineering -
Databricks SQL: Update Delta Rows with Precise Predicates
Databricks SQL Tutorial: Precise Predicates Update Databricks SQL Tutorial: Update Delta Rows with Precise Predicates This tutorial demonstrates how to update rows in a Delta table using precise predicates in Databricks SQL. We’ll progress through several scripts, each focusing on a different aspect of this process. Script 1: Initial Data and Basic Update Let’s start…
A1, category:data cable, category:education, category:software, coding, data engineering, databricks, databricks sql, Delta, delta lake, education, paragraph ordering, paragraph structure, paragraphorder, precise, predicates, profession:data analyst, profession:data engineer, profession:data scientist, profession:linguist, profession:student, profession:teacher, profession:translator, progressive learning, rows, sql, sql engineering, update -
Databricks SQL: Query Historical Delta Table Versions
Databricks SQL Tutorial: Query Historical Delta Table Versions Databricks SQL Tutorial: Query Historical Delta Table Versions This tutorial demonstrates how to query historical versions of a Delta table using Databricks SQL. We will execute three scripts, each building upon the previous one, to progressively explore the capabilities of querying historical data. Script 1: Initial Version…
A1, category:data cable, category:desktop pc, category:education, category:laptop, category:software, coding, data engineering, databricks, databricks sql, Delta, delta lake, education, historical, paragraph ordering, paragraph structure, paragraphorder, profession:data analyst, profession:data engineer, profession:data scientist, profession:linguist, profession:student, profession:teacher, profession:translator, progressive learning, query, sql, sql engineering, table, versions -
Databricks SQL: Load Cloud Files Incrementally with COPY INTO
Databricks SQL Tutorial: Incremental Load with COPY INTO Databricks SQL Tutorial: Load Cloud Files Incrementally with COPY INTO This tutorial demonstrates how to load data from cloud files into a Databricks SQL table incrementally using the `COPY INTO` command. We’ll focus on the key aspects of this process and build three scripts to illustrate the…
A1, category:data cable, category:education, category:software, Cloud, coding, copy, data engineering, databricks, databricks sql, delta lake, education, files, incrementally, into, load, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:linguist, profession:student, profession:teacher, profession:translator, progressive learning, sql, sql engineering -
Databricks SQL: Publish Aggregated Gold Tables
Databricks SQL Tutorial: Publish Aggregated Gold Tables Databricks SQL Tutorial: Publish Aggregated Gold Tables This tutorial guides you through publishing aggregated “gold” tables in Databricks SQL. We will build this process incrementally, focusing on the core functionality. The goal is to understand how to efficiently publish pre-calculated data for downstream consumption. Script 1: Create and…
A1, aggregated, category:computer, category:data cable, category:digital product, category:education, category:software, coding, data engineering, databricks, databricks sql, delta lake, education, gold, paragraph ordering, paragraph structure, paragraphorder, profession:data analyst, profession:data engineer, profession:data scientist, profession:linguist, profession:student, profession:teacher, profession:translator, progressive learning, publish, sql, sql engineering, tables
