profession:data engineer
-
Delegating Governance Administration with MANAGE Instead of Ownership Transfer
POST_START Delegating Governance Administration with MANAGE Instead of Ownership Transfer I recently needed to delegate governance responsibilities for a table in our data lake. The table, production.sales.orders, was being used by multiple teams, and the current owners were overwhelmed with managing access and compliance. I decided to explore the MANAGE privilege as a way to…
A1, administration, category:business, category:education, category:software, category:technology, coding, data engineering, data governance, databricks, delegating, education, Governance, instead, Lakehouse, manage, ownership, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, sql, transfer, unity catalog -
Removing Legacy Direct Access After an RBAC Migration
POST_START Removing Legacy Direct Access After an RBAC Migration I recently completed a migration from a legacy access model to a more secure and scalable Role-Based Access Control (RBAC) system in Databricks Unity Catalog. One of the critical steps in this process was removing direct access permissions that were no longer needed after the migration.…
A1, Access, after, category:business, category:education, category:software, category:technology, coding, data engineering, data governance, databricks, direct, education, Lakehouse, Legacy, migration, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, rbac, removing, sql, unity catalog -
Auditing RBAC Across Catalog Schema and Table Boundaries
POST_START Auditing RBAC Across Catalog Schema and Table Boundaries I recently needed to audit the role-based access control (RBAC) settings for a catalog in our Databricks environment. The goal was to understand who had access to which parts of the catalog, especially across schema and table boundaries. I started by checking the grants at the…
A1, Across, auditing, Boundaries, category:business, category:education, category:software, category:technology, coding, data engineering, data governance, databricks, education, Lakehouse, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, rbac, schema, sql, table, unity catalog -
Designing RBAC Through Catalog Schema and Table Privilege Layers
POST_START Designing RBAC Through Catalog Schema and Table Privilege Layers I recently had the task of setting up role-based access control (RBAC) for a new team in our organization. The goal was to ensure that the sales team could access the necessary data without exposing sensitive information. I decided to leverage Databricks Unity Catalog to…
A1, category:business, category:education, category:software, category:technology, coding, data engineering, data governance, databricks, designing, education, Lakehouse, layers, paragraph ordering, paragraph structure, paragraphorder, privilege, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, rbac, schema, sql, table, through, unity catalog -
Troubleshooting Column-Level Security with Function and Grant Inspection
POST_START Troubleshooting Column-Level Security with Function and Grant Inspection I was working on a data pipeline where certain users needed access to specific columns in the customer data, but not all. I noticed that when I tried to query the email column, it wasn’t showing up in the results, even though the column existed in…
A1, category:business, category:education, category:software, category:technology, coding, column-level, data engineering, data governance, databricks, education, function, grant, inspection, Lakehouse, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, security, sql, troubleshooting, unity catalog -
Building a Layered RLS and CLS Policy for Customer Analytics
POST_START Building a Layered RLS and CLS Policy for Customer Analytics I recently had the task of implementing a secure data access layer for customer analytics within our organization. The goal was to ensure that users only saw the data they were authorized to access, while also protecting sensitive information like emails and phone numbers.…
A1, Analytics,, building, category:business, category:education, category:software, category:technology, cls, coding, customer, data engineering, data governance, databricks, education, Lakehouse, layered, paragraph ordering, paragraph structure, paragraphorder, policy, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, rls, sql, unity catalog -
Implementing Role-Aware Column Masking for Customer Contact Data
POST_START Implementing Role-Aware Column Masking for Customer Contact Data I recently had the task of ensuring that customer contact data in our Databricks environment is only accessible to authorized users. This is part of a broader initiative to enforce data privacy and compliance across our organization. The specific requirement was to implement role-aware column masking…
A1, category:business, category:education, category:software, category:technology, coding, column, contact, customer, data, data engineering, data governance, databricks, education, implementing, Lakehouse, masking, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, role-aware, sql, unity catalog -
Masking Multiple PII Columns with Separate Governance Functions
POST_START Masking Multiple PII Columns with Separate Governance Functions I recently had the task of masking multiple Personally Identifiable Information (PII) columns in the customer master table. The goal was to ensure that sensitive data like phone numbers and emails were only accessible to authorized users. I decided to use Unity Catalog’s masking capabilities along…
A1, category:business, category:education, category:software, category:technology, coding, columns, data engineering, data governance, databricks, education, Functions, Governance, Lakehouse, masking, multiple, paragraph ordering, paragraph structure, paragraphorder, pii, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, separate, sql, unity catalog
