column
-
End-to-End Production Security Review for Row and Column Protection
POST_START End-to-End Production Security Review for Row and Column Protection I recently had the opportunity to perform a comprehensive security review of a customer data pipeline in Databricks Unity Catalog. The goal was to ensure that both row-level and column-level data protection were properly implemented and enforced. I started by understanding the functions and tables…
A1, category:business, category:education, category:software, category:technology, coding, column, data engineering, data governance, databricks, education, End-to-End, Lakehouse, paragraph ordering, paragraph structure, paragraphorder, production, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, protection, review, row, security, sql, unity catalog -
Documenting a Production Table and Sensitive Column for Governance Review
POST_START Documenting a Production Table and Sensitive Column for Governance Review I recently took on the responsibility of ensuring that our production data assets are properly documented for governance review. One of the key tables in our system is the customer_master table in the production.customers schema. This table holds the core customer information, and it’s…
A1, category:business, category:education, category:software, category:technology, coding, column, data engineering, data governance, databricks, documenting, education, Governance, Lakehouse, paragraph ordering, paragraph structure, paragraphorder, production, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, review, sensitive, sql, table, unity catalog -
Inspecting Security Functions Used by Row Filters and Column Masks
POST_START Inspecting Security Functions Used by Row Filters and Column Masks I recently had the task of understanding how security functions are applied to our data in the production environment. As part of this, I needed to inspect the row filters and column masks that are used to control access to sensitive information. I started…
A1, category:business, category:education, category:software, category:technology, coding, column, data engineering, data governance, databricks, education, filters, Functions, inspecting, Lakehouse, masks, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, row, security, sql, unity catalog, Used -
Combining Row Filtering and Column Masking on the Same Customer Table
POST_START Combining Row Filtering and Column Masking on the Same Customer Table I recently had the task of securing sensitive customer data in our production environment. The goal was to ensure that only authorized users could access specific rows and columns in the customer table. I decided to implement both row filtering and column masking…
A1, category:business, category:education, category:software, category:technology, coding, column, combining, customer, data engineering, data governance, databricks, education, filtering, Lakehouse, masking, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, row, same, sql, table, unity catalog -
Rolling Back a Production Column Mask After Policy Testing
POST_START Rolling Back a Production Column Mask After Policy Testing I recently had to roll back a column mask on a production table after completing a policy testing phase. The table in question was production.customers.customer_master, and the column that was masked was email. I needed to verify the current state of the table, remove the…
A1, after, Back,, category:business, category:education, category:software, category:technology, coding, column, data engineering, data governance, databricks, education, Lakehouse, mask, paragraph ordering, paragraph structure, paragraphorder, policy, production, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, rolling, sql, Testing, unity catalog -
Protecting Sensitive Columns with Column Masks
POST_START Protecting Sensitive Columns with Column Masks I recently needed to ensure that sensitive data, like customer emails, was only accessible to specific users in our Databricks environment. I decided to use column masks to control access to the email column in the customers table. This approach allows me to hide the email addresses from…
A1, category:business, category:education, category:software, category:technology, coding, column, columns, data engineering, data governance, databricks, education, Lakehouse, masks, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, protecting, sensitive, sql, unity catalog -
Removing Column Masks from Protected Columns
POST_START Removing Column Masks from Protected Columns Understanding the Need to Remove Column Masks I recently took on the responsibility of managing sensitive customer data in our Databricks environment. One of the key tasks was to ensure that data access adhered to strict privacy regulations. As part of this, certain columns, like the customer email,…
A1, category:business, category:education, category:software, category:technology, coding, column, columns, data engineering, data governance, databricks, education, Lakehouse, masks, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, protected, removing, sql, unity catalog -
Auditing Security Function Ownership Used by Column Masks
POST_START Auditing Security Function Ownership Used by Column Masks I recently had to audit the security function ownership used by column masks in our Databricks Unity Catalog environment. The goal was to ensure that the functions used for data masking were properly secured and that only authorized users had access to them. I started by…
A1, auditing, category:business, category:education, category:software, category:technology, coding, column, data engineering, data governance, databricks, education, function, Lakehouse, masks, ownership, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, security, sql, unity catalog, Used -
Investigating a Column Mask That Exposes Sensitive Production Values
POST_START Investigating a Column Mask That Exposes Sensitive Production Values I recently encountered an issue while reviewing the customer data in our production environment. A column mask was supposed to protect sensitive information, but it appeared to be exposing some production values. I needed to investigate the table structure and data to understand what was…
A1, category:business, category:education, category:software, category:technology, coding, column, data engineering, data governance, databricks, education, exposes, investigating, Lakehouse, mask, paragraph ordering, paragraph structure, paragraphorder, production, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, sensitive, sql, That, unity catalog, values -
Investigating a Column Mask That Blocks an Approved Production User
POST_START Investigating a Column Mask That Blocks an Approved Production User I recently encountered an issue where an approved production user was unable to access certain data in the customer_master table. The user had the necessary permissions, but when they tried to query the table, some columns were masked or hidden. My task was to…
A1, approved, blocks, category:business, category:education, category:software, category:technology, coding, column, data engineering, data governance, databricks, education, investigating, Lakehouse, mask, paragraph ordering, paragraph structure, paragraphorder, production, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, sql, That, unity catalog, user
