creating
-
Creating a Restricted Production Reporting View for Analysts
POST_START Creating a Restricted Production Reporting View for Analysts I recently needed to create a restricted reporting view for the data analysts team so they could access only the active orders from our production system. This view would allow them to analyze current orders without exposing sensitive or outdated data. To achieve this, I followed…
A1, analysts, category:business, category:education, category:software, category:technology, coding, creating, data engineering, data governance, databricks, education, Lakehouse, paragraph ordering, paragraph structure, paragraphorder, production, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, Reporting, restricted, sql, unity catalog, view -
Creating a Governed External Volume for Production Landing Files
POST_START Creating a Governed External Volume for Production Landing Files I’m working on setting up a new data pipeline for our production environment. As part of the data governance process, I need to create a governed external volume for the landing files that will be ingested from S3. I started by checking what volumes already…
A1, category:business, category:education, category:software, category:technology, coding, creating, data engineering, data governance, databricks, education, External, files, governed, Lakehouse, landing, paragraph ordering, paragraph structure, paragraphorder, production, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, sql, unity catalog, Volume. -
Creating and Managing External Volumes
POST_START Creating and Managing External Volumes in Databricks Unity Catalog I recently started working on a new data pipeline for the sales team, and I needed to organize the raw files they’re ingesting from various sources. I learned that Databricks Unity Catalog provides a way to manage external volumes, which are useful for storing and…
A1, category:business, category:education, category:software, category:technology, coding, creating, data engineering, data governance, databricks, education, External, Lakehouse, Managing, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, sql, unity catalog, volumes -
Creating and Managing External Delta Tables
POST_START Creating and Managing External Delta Tables I recently needed to create an external Delta table in Databricks Unity Catalog to integrate data from an external source. This table would be used to store sales orders, and I wanted to ensure it was properly managed within the catalog. I started by defining the structure of…
A1, category:business, category:education, category:software, category:technology, coding, creating, data engineering, data governance, databricks, Delta, education, External, Lakehouse, Managing, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, sql, tables, unity catalog -
Creating and Managing Managed Volumes for Non-Tabular Files
POST_START Creating and Managing Managed Volumes for Non-Tabular Files I recently needed to organize a growing collection of non-tabular files, such as PDFs, CSVs, and text documents, for a data pipeline. These files were not structured in a traditional table format, so using standard tables wasn’t the right approach. Instead, I decided to leverage Databricks…
A1, category:business, category:education, category:software, category:technology, coding, creating, data engineering, data governance, databricks, education, files, Lakehouse, Managed, Managing, non-tabular, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, sql, unity catalog, volumes -
Creating and Inspecting Governed External Locations
POST_START Creating and Inspecting Governed External Locations I recently needed to set up a new external location in Unity Catalog to access raw data stored in cloud storage. This location would be used by multiple teams, so I wanted to ensure it was properly governed and secured. I started by creating the external location with…
A1, category:business, category:education, category:software, category:technology, coding, creating, data engineering, data governance, databricks, education, External, governed, inspecting, Lakehouse, locations, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, sql, unity catalog -
Creating and Using Reusable SQL Functions
POST_START Creating and Using Reusable SQL Functions in Databricks Unity Catalog I recently needed to calculate tax amounts for various sales transactions in my Databricks environment. To make this process more efficient and maintainable, I decided to create a reusable SQL function using Unity Catalog. This function would allow me to apply the same tax…
A1, category:business, category:education, category:software, category:technology, coding, creating, data engineering, data governance, databricks, education, Functions, Lakehouse, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, reusable, sql, unity catalog -
Creating Identity-Aware Views for Conditional Data Access
POST_START Creating Identity-Aware Views for Conditional Data Access I recently had the task of implementing a secure data access pattern for customer information in our sales database. The goal was to create a view that would expose customer data conditionally based on the user’s identity. This way, only users who are part of the ‘pii_readers’…
A1, Access, category:business, category:education, category:software, category:technology, coding, Conditional, creating, data, data engineering, data governance, databricks, education, identity-aware, Lakehouse, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, sql, unity catalog, Views -
Creating and Managing Permanent Unity Catalog Views
POST_START Creating and Managing Permanent Unity Catalog Views I recently needed to create a permanent view in Unity Catalog to simplify access to customer data for my team. I decided to use the CREATE OR REPLACE VIEW command to define a view that selects specific columns from the customers table in the training.sales namespace. CREATE…
A1, category:business, category:education, category:software, category:technology, coding, creating, data engineering, data governance, databricks, education, Lakehouse, Managing, paragraph ordering, paragraph structure, paragraphorder, permanent, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, sql, unity catalog, Views -
Creating and Using Session-Scoped Temporary Views
POST_START Creating and Using Session-Scoped Temporary Views I recently needed to analyze a subset of customer data for a reporting task. The dataset was large, and I wanted to filter for active customers in Germany first. I decided to create a temporary view to simplify my analysis and keep the data isolated for the session.…
A1, category:business, category:education, category:software, category:technology, coding, creating, data engineering, data governance, databricks, education, Lakehouse, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, session-scoped, sql, temporary, unity catalog, Views
