table
-
Documenting a Production Table and Sensitive Column for Governance Review
POST_START Documenting a Production Table and Sensitive Column for Governance Review I recently took on the responsibility of ensuring that our production data assets are properly documented for governance review. One of the key tables in our system is the customer_master table in the production.customers schema. This table holds the core customer information, and it’s…
A1, category:business, category:education, category:software, category:technology, coding, column, data engineering, data governance, databricks, documenting, education, Governance, Lakehouse, paragraph ordering, paragraph structure, paragraphorder, production, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, review, sensitive, sql, table, unity catalog -
Testing a Production Table Schema Change Before Grant Review
POST_START Testing a Production Table Schema Change Before Grant Review I recently needed to test a schema change for a production table before submitting it for grant review. The table in question was production.sales.orders, and the goal was to add a new column to track the status of a review process. Before making any changes,…
A1, before, category:business, category:education, category:software, category:technology, change, coding, data engineering, data governance, databricks, education, grant, Lakehouse, paragraph ordering, paragraph structure, paragraphorder, production, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, review, schema, sql, table, Testing, unity catalog -
Investigating a Production Table Rename Through Object Discovery
POST_START Investigating a Production Table Rename Through Object Discovery Today, I was tasked with investigating a recent table rename in the production environment. The team had renamed a table from orders to orders_archive, and I needed to verify that the change was correctly applied and understand the impact on the system. I started by checking…
A1, category:business, category:education, category:software, category:technology, coding, data engineering, data governance, databricks, discovery, education, investigating, Lakehouse, object, paragraph ordering, paragraph structure, paragraphorder, production, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, rename, sql, table, through, unity catalog -
Reviewing Production Table Properties During an Operational Investigation
POST_START Reviewing Production Table Properties During an Operational Investigation I recently encountered an issue with the production table production.sales.orders that required me to investigate its properties to understand its structure and behavior. As part of the operational investigation, I needed to check the table’s metadata to determine if there were any settings that might be…
A1, category:business, category:education, category:software, category:technology, coding, data engineering, data governance, databricks, during, education, investigation, Lakehouse, operational, paragraph ordering, paragraph structure, paragraphorder, production, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, properties, Reviewing, sql, table, unity catalog -
Investigating User Activity Against a Production Table with Audit Logs
POST_START Investigating User Activity Against a Production Table with Audit Logs I recently needed to investigate user activity against a production table in our data warehouse. The table in question was production.sales.orders, and I wanted to understand who had accessed it, what actions they performed, and when. Since we use Databricks Unity Catalog for access…
A1, Activity, against, audit, category:business, category:education, category:software, category:technology, coding, data engineering, data governance, databricks, education, investigating, Lakehouse, logs, paragraph ordering, paragraph structure, paragraphorder, production, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, sql, table, unity catalog, user -
Auditing Production Table Privileges Through INFORMATION_SCHEMA
POST_START Auditing Production Table Privileges Through INFORMATION_SCHEMA Today, I needed to audit the privileges assigned to a specific table in the production environment. The table in question was orders from the sales schema. My goal was to understand who has access to this table and what kind of privileges they hold. I decided to use…
A1, auditing, category:business, category:education, category:software, category:technology, coding, data engineering, data governance, databricks, education, information, Lakehouse, paragraph ordering, paragraph structure, paragraphorder, privileges, production, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, schema, sql, table, through, unity catalog -
Removing an Obsolete Governance Tag from a Production Table
POST_START Removing an Obsolete Governance Tag from a Production Table I recently had to address an outdated governance tag on a production table in our data lake. The table, production.customers.customer_master, was marked with a legacy_classification tag that was no longer relevant. My task was to remove this tag and verify that it was successfully removed.…
A1, category:business, category:education, category:software, category:technology, coding, data engineering, data governance, databricks, education, Governance, Lakehouse, obsolete, paragraph ordering, paragraph structure, paragraphorder, production, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, removing, sql, table, tag, unity catalog -
Combining Row Filtering and Column Masking on the Same Customer Table
POST_START Combining Row Filtering and Column Masking on the Same Customer Table I recently had the task of securing sensitive customer data in our production environment. The goal was to ensure that only authorized users could access specific rows and columns in the customer table. I decided to implement both row filtering and column masking…
A1, category:business, category:education, category:software, category:technology, coding, column, combining, customer, data engineering, data governance, databricks, education, filtering, Lakehouse, masking, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, row, same, sql, table, unity catalog
