investigation
-
🔎 The Report That Did Not Match the Records
🔎 The Report That Did Not Match the Records The message arrived shortly before lunch. Our operations director asked me to join a meeting in a small conference room on the fourth floor. When I arrived, three people were already waiting: a department manager, someone from compliance, and a representative from human resources. A printed…
A1, A2, B1, B2, business english, C1, C2, category:business|710, category:compliance|710, category:investigation|710, category:professional english|710, category:risk management|710, Compliance, corporate investigation, english, evidence, fact finding, incident review, investigation, language, matching, profession:auditor|710, profession:business analyst|710, profession:compliance officer|710, profession:human resources manager|710, profession:investigator|710, profession:operations manager|710, profession:risk manager|710, professional vocabulary, risk management, wobizdu, workplace investigation -
🔎 I Investigate Databricks Production Incidents
A successful data pipeline can still hide a serious problem. I learned this after working through production-style Databricks incidents where a job could finish successfully while the resulting data was stale, duplicated, incomplete, unexpectedly expensive, or available to the wrong audience. That changed the way I think about data engineering. I no longer begin with…
A1, A2, auto-loader, B1, B2, C1, C2, category:databricks, cdc, chat, conversational, data engineering, data-engineer-professional, data-quality, databricks, delta lake, difficulty:240, incident-response, investigation, production-pipelines, profession:data engineer, root-cause-analysis, structured-streaming, troubleshooting, unity catalog, Workflows. -
Establishing a Clean Production Catalog Context Before an Incident Investigation
POST_START Establishing a Clean Production Catalog Context Before an Incident Investigation Today, I’m tasked with investigating an unexpected data discrepancy in our production environment. To ensure I’m working with the correct and clean context, I need to establish a clear understanding of the current Unity Catalog setup. I know that starting with the right catalog…
A1, before, category:business, category:education, category:software, category:technology, clean, coding, context, data engineering, data governance, databricks, education, establishing, incident, investigation, Lakehouse, paragraph ordering, paragraph structure, paragraphorder, production, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, sql, unity catalog -
Establishing a Clean Production Catalog Context Before an Incident Investigation
POST_START Establishing a Clean Production Catalog Context Before an Incident Investigation Today, I’m tasked with investigating an unexpected data inconsistency in our production environment. Before diving into the issue, I need to ensure I’m working with the correct and clean catalog context to avoid any misinterpretation of the data. The first step is to verify…
A1, before, category:business, category:education, category:software, category:technology, clean, coding, context, data engineering, data governance, databricks, education, establishing, incident, investigation, Lakehouse, paragraph ordering, paragraph structure, paragraphorder, production, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, sql, unity catalog -
End-to-End Production Access Investigation from Namespace to Audit Trail
POST_START End-to-End Production Access Investigation from Namespace to Audit Trail I recently needed to investigate access to the production catalog in Databricks Unity Catalog. My goal was to understand who had access to what, what actions they could perform, and how their interactions were recorded in the audit trail. This is a common task when…
A1, Access, audit, category:business, category:education, category:software, category:technology, coding, data engineering, data governance, databricks, education, End-to-End, investigation, Lakehouse, namespace, paragraph ordering, paragraph structure, paragraphorder, production, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, sql, trail, unity catalog -
Reviewing Production Table Properties During an Operational Investigation
POST_START Reviewing Production Table Properties During an Operational Investigation I recently encountered an issue with the production table production.sales.orders that required me to investigate its properties to understand its structure and behavior. As part of the operational investigation, I needed to check the table’s metadata to determine if there were any settings that might be…
A1, category:business, category:education, category:software, category:technology, coding, data engineering, data governance, databricks, during, education, investigation, Lakehouse, operational, paragraph ordering, paragraph structure, paragraphorder, production, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, properties, Reviewing, sql, table, unity catalog
