profession:cloud engineer
-
Comparing Current and Historical Production Data After a Suspected Bad Write
POST_START Comparing Current and Historical Production Data After a Suspected Bad Write Yesterday, I noticed some inconsistencies in our sales reports. A few orders were showing up as completed when they should have been pending. I suspected a bad write might have occurred, so I decided to investigate using Databricks Unity Catalog’s time travel capabilities.…
A1, after, bad, category:business, category:education, category:software, category:technology, coding, Comparing, current, data, data engineering, data governance, databricks, education, historical, Lakehouse, paragraph ordering, paragraph structure, paragraphorder, production, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, sql, suspected, unity catalog -
Establishing a Clean Production Catalog Context Before an Incident Investigation
POST_START Establishing a Clean Production Catalog Context Before an Incident Investigation Today, I’m tasked with investigating an unexpected data discrepancy in our production environment. To ensure I’m working with the correct and clean context, I need to establish a clear understanding of the current Unity Catalog setup. I know that starting with the right catalog…
A1, before, category:business, category:education, category:software, category:technology, clean, coding, context, data engineering, data governance, databricks, education, establishing, incident, investigation, Lakehouse, paragraph ordering, paragraph structure, paragraphorder, production, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, sql, unity catalog -
Recovering a Production Delta Table to a Known Good Version
POST_START Recovering a Production Delta Table to a Known Good Version Today, I encountered an issue with the production Delta table production.sales.orders. A recent update introduced some inconsistencies, and I needed to recover the table to a known good version. I decided to use Unity Catalog’s versioning features to identify and restore the table to…
A1, category:business, category:education, category:software, category:technology, coding, data engineering, data governance, databricks, Delta, education, good, known, Lakehouse, paragraph ordering, paragraph structure, paragraphorder, production, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, recovering, sql, table, unity catalog, version -
Tracing Read Access Through Catalog Schema and Table Grants
POST_START Tracing Read Access Through Catalog Schema and Table Grants I was tasked with understanding how read access to a specific table in the Unity Catalog was granted. My goal was to trace the permissions from the catalog level down to the table level to ensure that only the right users could access the data.…
A1, Access, category:business, category:education, category:software, category:technology, coding, data engineering, data governance, databricks, education, grants, Lakehouse, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, read, schema, sql, table, through, tracing, unity catalog -
Comparing Current and Historical Production Data After a Suspected Bad Write
POST_START Comparing Current and Historical Production Data After a Suspected Bad Write Today, I encountered an issue with the production data in our Databricks Unity Catalog. A team member reported that a recent write operation might have caused some data to be incorrect. My task was to investigate and compare the current data with a…
A1, after, bad, category:business, category:education, category:software, category:technology, coding, Comparing, current, data, data engineering, data governance, databricks, education, historical, Lakehouse, paragraph ordering, paragraph structure, paragraphorder, production, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, sql, suspected, unity catalog -
Establishing a Clean Production Catalog Context Before an Incident Investigation
POST_START Establishing a Clean Production Catalog Context Before an Incident Investigation Today, I’m tasked with investigating an unexpected data inconsistency in our production environment. Before diving into the issue, I need to ensure I’m working with the correct and clean catalog context to avoid any misinterpretation of the data. The first step is to verify…
A1, before, category:business, category:education, category:software, category:technology, clean, coding, context, data engineering, data governance, databricks, education, establishing, incident, investigation, Lakehouse, paragraph ordering, paragraph structure, paragraphorder, production, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, sql, unity catalog -
Performing an Expert Security Rollback for Layered RLS and CLS Controls
POST_START Performing an Expert Security Rollback for Layered RLS and CLS Controls I recently encountered a situation where I needed to roll back security controls on a table in Unity Catalog. The table, production.customers.customer_master, was protected by both Row-Level Security (RLS) and Column-Level Security (CLS) policies. My task was to perform a controlled rollback to…
A1, category:business, category:education, category:software, category:technology, cls, coding, controls, data engineering, data governance, databricks, education, expert, Lakehouse, layered, paragraph ordering, paragraph structure, paragraphorder, performing, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, rls, rollback, security, sql, unity catalog
