category:technology
-
Comparing Current and Historical Production Data After a Suspected Bad Write
POST_START Comparing Current and Historical Production Data After a Suspected Bad Write Today, I encountered an issue with the production data in our Databricks Unity Catalog. A team member reported that a recent write operation might have caused some data to be incorrect. My task was to investigate and compare the current data with a…
A1, after, bad, category:business, category:education, category:software, category:technology, coding, Comparing, current, data, data engineering, data governance, databricks, education, historical, Lakehouse, paragraph ordering, paragraph structure, paragraphorder, production, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, sql, suspected, unity catalog -
Performing an Expert Security Rollback for Layered RLS and CLS Controls
POST_START Performing an Expert Security Rollback for Layered RLS and CLS Controls I recently encountered a situation where I needed to roll back security controls on a table in Unity Catalog. The table, production.customers.customer_master, was protected by both Row-Level Security (RLS) and Column-Level Security (CLS) policies. My task was to perform a controlled rollback to…
A1, category:business, category:education, category:software, category:technology, cls, coding, controls, data engineering, data governance, databricks, education, expert, Lakehouse, layered, paragraph ordering, paragraph structure, paragraphorder, performing, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, rls, rollback, security, sql, unity catalog -
Establishing a Clean Production Catalog Context Before an Incident Investigation
POST_START Establishing a Clean Production Catalog Context Before an Incident Investigation Today, I’m tasked with investigating an unexpected data inconsistency in our production environment. Before diving into the issue, I need to ensure I’m working with the correct and clean catalog context to avoid any misinterpretation of the data. The first step is to verify…
A1, before, category:business, category:education, category:software, category:technology, clean, coding, context, data engineering, data governance, databricks, education, establishing, incident, investigation, Lakehouse, paragraph ordering, paragraph structure, paragraphorder, production, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, sql, unity catalog -
Delegating Governance Administration with MANAGE Instead of Ownership Transfer
POST_START Delegating Governance Administration with MANAGE Instead of Ownership Transfer I recently needed to delegate governance responsibilities for a table in our data lake. The table, production.sales.orders, was being used by multiple teams, and the current owners were overwhelmed with managing access and compliance. I decided to explore the MANAGE privilege as a way to…
A1, administration, category:business, category:education, category:software, category:technology, coding, data engineering, data governance, databricks, delegating, education, Governance, instead, Lakehouse, manage, ownership, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, sql, transfer, unity catalog -
Removing Legacy Direct Access After an RBAC Migration
POST_START Removing Legacy Direct Access After an RBAC Migration I recently completed a migration from a legacy access model to a more secure and scalable Role-Based Access Control (RBAC) system in Databricks Unity Catalog. One of the critical steps in this process was removing direct access permissions that were no longer needed after the migration.…
A1, Access, after, category:business, category:education, category:software, category:technology, coding, data engineering, data governance, databricks, direct, education, Lakehouse, Legacy, migration, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, rbac, removing, sql, unity catalog -
Auditing RBAC Across Catalog Schema and Table Boundaries
POST_START Auditing RBAC Across Catalog Schema and Table Boundaries I recently needed to audit the role-based access control (RBAC) settings for a catalog in our Databricks environment. The goal was to understand who had access to which parts of the catalog, especially across schema and table boundaries. I started by checking the grants at the…
A1, Across, auditing, Boundaries, category:business, category:education, category:software, category:technology, coding, data engineering, data governance, databricks, education, Lakehouse, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, rbac, schema, sql, table, unity catalog -
Designing RBAC Through Catalog Schema and Table Privilege Layers
POST_START Designing RBAC Through Catalog Schema and Table Privilege Layers I recently had the task of setting up role-based access control (RBAC) for a new team in our organization. The goal was to ensure that the sales team could access the necessary data without exposing sensitive information. I decided to leverage Databricks Unity Catalog to…
A1, category:business, category:education, category:software, category:technology, coding, data engineering, data governance, databricks, designing, education, Lakehouse, layers, paragraph ordering, paragraph structure, paragraphorder, privilege, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, rbac, schema, sql, table, through, unity catalog
