sensitive
-
Documenting a Production Table and Sensitive Column for Governance Review
POST_START Documenting a Production Table and Sensitive Column for Governance Review I recently took on the responsibility of ensuring that our production data assets are properly documented for governance review. One of the key tables in our system is the customer_master table in the production.customers schema. This table holds the core customer information, and it’s…
A1, category:business, category:education, category:software, category:technology, coding, column, data engineering, data governance, databricks, documenting, education, Governance, Lakehouse, paragraph ordering, paragraph structure, paragraphorder, production, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, review, sensitive, sql, table, unity catalog -
Protecting Sensitive Columns with Column Masks
POST_START Protecting Sensitive Columns with Column Masks I recently needed to ensure that sensitive data, like customer emails, was only accessible to specific users in our Databricks environment. I decided to use column masks to control access to the email column in the customers table. This approach allows me to hide the email addresses from…
A1, category:business, category:education, category:software, category:technology, coding, column, columns, data engineering, data governance, databricks, education, Lakehouse, masks, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, protecting, sensitive, sql, unity catalog -
Validating Least-Privilege Access from Catalog Through Sensitive Columns
POST_START Validating Least-Privilege Access from Catalog Through Sensitive Columns I started my day by reviewing the access controls for the production catalog in our Databricks environment. My goal was to ensure that the least-privilege principle was being followed, especially when it came to sensitive columns in our customer data. I wanted to verify if the…
A1, Access, category:business, category:education, category:software, category:technology, coding, columns, data engineering, data governance, databricks, education, Lakehouse, least-privilege, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, sensitive, sql, through, unity catalog, validating -
Investigating a Column Mask That Exposes Sensitive Production Values
POST_START Investigating a Column Mask That Exposes Sensitive Production Values I recently encountered an issue while reviewing the customer data in our production environment. A column mask was supposed to protect sensitive information, but it appeared to be exposing some production values. I needed to investigate the table structure and data to understand what was…
A1, category:business, category:education, category:software, category:technology, coding, column, data engineering, data governance, databricks, education, exposes, investigating, Lakehouse, mask, paragraph ordering, paragraph structure, paragraphorder, production, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, sensitive, sql, That, unity catalog, values -
Enforcing Separation of Duties for Sensitive Production Data with Unity Catalog Privileges
POST_START Enforcing Separation of Duties for Sensitive Production Data with Unity Catalog Privileges I recently took on the responsibility of securing access to a critical dataset in our production environment. The dataset, called customer_master, contains sensitive customer information that must be handled with care. My task was to enforce a separation of duties model using…
A1, category:business, category:education, category:software, category:technology, coding, data, data engineering, data governance, databricks, duties, education, enforcing, Lakehouse, paragraph ordering, paragraph structure, paragraphorder, privileges, production, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, sensitive, separation, sql, unity catalog -
Troubleshooting Sensitive Column Visibility and Unity Catalog Column Mask Behavior
POST_START Troubleshooting Sensitive Column Visibility and Unity Catalog Column Mask Behavior I was working on a data pipeline that involved accessing the production.customers.customer_master table. My task was to understand why certain sensitive columns weren’t showing up in the results, even though I had the necessary permissions. I wanted to troubleshoot the issue using Unity Catalog’s…
A1, behavior, category:business, category:education, category:software, category:technology, coding, column, data engineering, data governance, databricks, education, Lakehouse, mask, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, sensitive, sql, troubleshooting, unity catalog, visibility -
Protecting Sensitive Production Columns with Unity Catalog Column Masks
POST_START Protecting Sensitive Production Columns with Unity Catalog Column Masks Setting the Stage I recently joined a team that’s responsible for maintaining a data warehouse built on Databricks. One of the key responsibilities I inherited was ensuring that sensitive data, especially in production environments, is properly protected. The team had a number of tables with…
A1, category:business, category:education, category:software, category:technology, coding, column, columns, data engineering, data governance, databricks, education, Lakehouse, masks, paragraph ordering, paragraph structure, paragraphorder, production, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, protecting, sensitive, sql, unity catalog
