Managing
-
Creating and Managing External Volumes
POST_START Creating and Managing External Volumes in Databricks Unity Catalog I recently started working on a new data pipeline for the sales team, and I needed to organize the raw files they’re ingesting from various sources. I learned that Databricks Unity Catalog provides a way to manage external volumes, which are useful for storing and…
A1, category:business, category:education, category:software, category:technology, coding, creating, data engineering, data governance, databricks, education, External, Lakehouse, Managing, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, sql, unity catalog, volumes -
Creating and Managing External Delta Tables
POST_START Creating and Managing External Delta Tables I recently needed to create an external Delta table in Databricks Unity Catalog to integrate data from an external source. This table would be used to store sales orders, and I wanted to ensure it was properly managed within the catalog. I started by defining the structure of…
A1, category:business, category:education, category:software, category:technology, coding, creating, data engineering, data governance, databricks, Delta, education, External, Lakehouse, Managing, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, sql, tables, unity catalog -
Creating and Managing Managed Volumes for Non-Tabular Files
POST_START Creating and Managing Managed Volumes for Non-Tabular Files I recently needed to organize a growing collection of non-tabular files, such as PDFs, CSVs, and text documents, for a data pipeline. These files were not structured in a traditional table format, so using standard tables wasn’t the right approach. Instead, I decided to leverage Databricks…
A1, category:business, category:education, category:software, category:technology, coding, creating, data engineering, data governance, databricks, education, files, Lakehouse, Managed, Managing, non-tabular, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, sql, unity catalog, volumes -
Managing Read, Write, and Table-Creation Access on External Locations
POST_START Managing Read, Write, and Table-Creation Access on External Locations Setting Up Access for Data Engineers I recently needed to set up access for the data_engineers team to an external location called raw_data. The goal was to grant them the ability to read files from this location, but also to manage their permissions carefully to…
A1, Access, category:business, category:education, category:software, category:technology, coding, data engineering, data governance, databricks, education, External, Lakehouse, locations, Managing, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, read, sql, table-creation, unity catalog, Write -
Managing Schema-Level SELECT Access Across Tables
POST_START Managing Schema-Level SELECT Access Across Tables I recently had the task of setting up access controls for a new analytics team in our organization. The goal was to grant them the ability to query data from a specific schema across multiple tables, without giving them full administrative privileges. I decided to use Databricks Unity…
A1, Access, Across, category:business, category:education, category:software, category:technology, coding, data engineering, data governance, databricks, education, Lakehouse, Managing, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, schema-level, select, sql, tables, unity catalog -
Creating and Managing Permanent Unity Catalog Views
POST_START Creating and Managing Permanent Unity Catalog Views I recently needed to create a permanent view in Unity Catalog to simplify access to customer data for my team. I decided to use the CREATE OR REPLACE VIEW command to define a view that selects specific columns from the customers table in the training.sales namespace. CREATE…
A1, category:business, category:education, category:software, category:technology, coding, creating, data engineering, data governance, databricks, education, Lakehouse, Managing, paragraph ordering, paragraph structure, paragraphorder, permanent, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, sql, unity catalog, Views -
Creating, Inspecting, and Managing Schemas in Unity Catalog
POST_START Creating, Inspecting, and Managing Schemas in Unity Catalog I recently needed to set up a new schema in Unity Catalog for a sales team to store their data. I started by creating the schema if it didn’t already exist, using the CREATE SCHEMA IF NOT EXISTS command. CREATE SCHEMA IF NOT EXISTS training.sales; I…
A1, category:business, category:education, category:software, category:technology, coding, creating, data engineering, data governance, databricks, education, inspecting, Lakehouse, Managing, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, schemas, sql, unity catalog -
Creating, Inspecting, Using, and Managing Unity Catalog Catalogs
POST_START Creating, Inspecting, Using, and Managing Unity Catalogs I started my day by exploring the Unity Catalog in Databricks, a critical part of our data governance strategy. I wanted to understand how to create, inspect, use, and manage catalogs effectively. My first step was to check what catalogs already existed in the environment. SHOW CATALOGS;…
A1, catalogs, category:business, category:education, category:software, category:technology, coding, creating, data engineering, data governance, databricks, education, inspecting, Lakehouse, Managing, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, sql, unity catalog
