category:technology
-
Troubleshooting Column-Level Security with Function and Grant Inspection
POST_START Troubleshooting Column-Level Security with Function and Grant Inspection I was working on a data pipeline where certain users needed access to specific columns in the customer data, but not all. I noticed that when I tried to query the email column, it wasn’t showing up in the results, even though the column existed in…
A1, category:business, category:education, category:software, category:technology, coding, column-level, data engineering, data governance, databricks, education, function, grant, inspection, Lakehouse, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, security, sql, troubleshooting, unity catalog -
Building a Layered RLS and CLS Policy for Customer Analytics
POST_START Building a Layered RLS and CLS Policy for Customer Analytics I recently had the task of implementing a secure data access layer for customer analytics within our organization. The goal was to ensure that users only saw the data they were authorized to access, while also protecting sensitive information like emails and phone numbers.…
A1, Analytics,, building, category:business, category:education, category:software, category:technology, cls, coding, customer, data engineering, data governance, databricks, education, Lakehouse, layered, paragraph ordering, paragraph structure, paragraphorder, policy, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, rls, sql, unity catalog -
Implementing Role-Aware Column Masking for Customer Contact Data
POST_START Implementing Role-Aware Column Masking for Customer Contact Data I recently had the task of ensuring that customer contact data in our Databricks environment is only accessible to authorized users. This is part of a broader initiative to enforce data privacy and compliance across our organization. The specific requirement was to implement role-aware column masking…
A1, category:business, category:education, category:software, category:technology, coding, column, contact, customer, data, data engineering, data governance, databricks, education, implementing, Lakehouse, masking, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, role-aware, sql, unity catalog -
Masking Multiple PII Columns with Separate Governance Functions
POST_START Masking Multiple PII Columns with Separate Governance Functions I recently had the task of masking multiple Personally Identifiable Information (PII) columns in the customer master table. The goal was to ensure that sensitive data like phone numbers and emails were only accessible to authorized users. I decided to use Unity Catalog’s masking capabilities along…
A1, category:business, category:education, category:software, category:technology, coding, columns, data engineering, data governance, databricks, education, Functions, Governance, Lakehouse, masking, multiple, paragraph ordering, paragraph structure, paragraphorder, pii, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, separate, sql, unity catalog -
Hardening Row-Level Security with a Controlled Administrator Bypass
POST_START Hardening Row-Level Security with a Controlled Administrator Bypass I recently had the task of hardening row-level security for a customer table in our data lake. The goal was to enforce a region-based filter, but also allow for a controlled bypass for administrators. I needed to implement a function that would restrict access to data…
A1, administrator, bypass, category:business, category:education, category:software, category:technology, coding, controlled, data engineering, data governance, databricks, education, hardening, Lakehouse, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, row-level, security, sql, unity catalog -
Designing Multi-Group Row-Level Security for Regional Sales Data
POST_START Designing Multi-Group Row-Level Security for Regional Sales Data I’ve been tasked with implementing row-level security for the sales data in our Databricks environment. The goal is to ensure that users can only access sales data relevant to their region. This involves setting up a function that filters data based on user group membership and…
A1, category:business, category:education, category:software, category:technology, coding, data, data engineering, data governance, databricks, designing, education, Lakehouse, multi-group, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, regional, row-level, sales, security, sql, unity catalog -
End-to-End Production Security Review for Row and Column Protection
POST_START End-to-End Production Security Review for Row and Column Protection I recently had the opportunity to perform a comprehensive security review of a customer data pipeline in Databricks Unity Catalog. The goal was to ensure that both row-level and column-level data protection were properly implemented and enforced. I started by understanding the functions and tables…
A1, category:business, category:education, category:software, category:technology, coding, column, data engineering, data governance, databricks, education, End-to-End, Lakehouse, paragraph ordering, paragraph structure, paragraphorder, production, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, protection, review, row, security, sql, unity catalog -
Documenting a Production Table and Sensitive Column for Governance Review
POST_START Documenting a Production Table and Sensitive Column for Governance Review I recently took on the responsibility of ensuring that our production data assets are properly documented for governance review. One of the key tables in our system is the customer_master table in the production.customers schema. This table holds the core customer information, and it’s…
A1, category:business, category:education, category:software, category:technology, coding, column, data engineering, data governance, databricks, documenting, education, Governance, Lakehouse, paragraph ordering, paragraph structure, paragraphorder, production, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, review, sensitive, sql, table, unity catalog
