after
-
Comparing Current and Historical Production Data After a Suspected Bad Write
POST_START Comparing Current and Historical Production Data After a Suspected Bad Write Yesterday, I noticed some inconsistencies in our sales reports. A few orders were showing up as completed when they should have been pending. I suspected a bad write might have occurred, so I decided to investigate using Databricks Unity Catalog’s time travel capabilities.…
A1, after, bad, category:business, category:education, category:software, category:technology, coding, Comparing, current, data, data engineering, data governance, databricks, education, historical, Lakehouse, paragraph ordering, paragraph structure, paragraphorder, production, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, sql, suspected, unity catalog -
Comparing Current and Historical Production Data After a Suspected Bad Write
POST_START Comparing Current and Historical Production Data After a Suspected Bad Write Today, I encountered an issue with the production data in our Databricks Unity Catalog. A team member reported that a recent write operation might have caused some data to be incorrect. My task was to investigate and compare the current data with a…
A1, after, bad, category:business, category:education, category:software, category:technology, coding, Comparing, current, data, data engineering, data governance, databricks, education, historical, Lakehouse, paragraph ordering, paragraph structure, paragraphorder, production, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, sql, suspected, unity catalog -
Removing Legacy Direct Access After an RBAC Migration
POST_START Removing Legacy Direct Access After an RBAC Migration I recently completed a migration from a legacy access model to a more secure and scalable Role-Based Access Control (RBAC) system in Databricks Unity Catalog. One of the critical steps in this process was removing direct access permissions that were no longer needed after the migration.…
A1, Access, after, category:business, category:education, category:software, category:technology, coding, data engineering, data governance, databricks, direct, education, Lakehouse, Legacy, migration, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, rbac, removing, sql, unity catalog -
Rolling Back a Production Column Mask After Policy Testing
POST_START Rolling Back a Production Column Mask After Policy Testing I recently had to roll back a column mask on a production table after completing a policy testing phase. The table in question was production.customers.customer_master, and the column that was masked was email. I needed to verify the current state of the table, remove the…
A1, after, Back,, category:business, category:education, category:software, category:technology, coding, column, data engineering, data governance, databricks, education, Lakehouse, mask, paragraph ordering, paragraph structure, paragraphorder, policy, production, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, rolling, sql, Testing, unity catalog -
Comparing Current and Historical Production Data After a Suspected Bad Write
POST_START Comparing Current and Historical Production Data After a Suspected Bad Write Yesterday, I noticed some unusual behavior in our production data pipeline. A new batch of data was written to the production.sales.orders table, but when I checked the latest records, it looked like some entries were missing or had incorrect values. I suspected a…
A1, after, bad, category:business, category:education, category:software, category:technology, coding, Comparing, current, data, data engineering, data governance, databricks, education, historical, Lakehouse, paragraph ordering, paragraph structure, paragraphorder, production, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, sql, suspected, unity catalog -
Removing Stale Production Access After Team Changes
POST_START Removing Stale Production Access After Team Changes Last week, our team underwent a restructuring, and the former sales team was disbanded. As part of the cleanup, I needed to ensure that no former team members still had access to production data. My first step was to check what access was currently granted on the…
A1, Access, after, category:business, category:education, category:software, category:technology, changes, coding, data engineering, data governance, databricks, education, Lakehouse, paragraph ordering, paragraph structure, paragraphorder, production, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, removing, sql, stale, team, unity catalog -
Auditing Emergency Production Access After an Incident
POST_START Auditing Emergency Production Access After an Incident Yesterday, we experienced a minor security incident involving access to the production catalog. A user with temporary emergency access was found to have interacted with critical data in the production environment. Now, I’m tasked with auditing who has access to the production catalog and how it’s being…
A1, Access, after, auditing, category:business, category:education, category:software, category:technology, coding, data engineering, data governance, databricks, education, emergency, incident, Lakehouse, paragraph ordering, paragraph structure, paragraphorder, production, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, sql, unity catalog


