removing
-
Removing Write Access from a Production External Location
POST_START Removing Write Access from a Production External Location I recently had the task of securing a production external location in Databricks Unity Catalog. The location, named production_raw, was being used by several teams, but we needed to remove write access for a legacy ingestion service to prevent accidental or unauthorized data modifications. Understanding the…
A1, Access, category:business, category:education, category:software, category:technology, coding, data engineering, data governance, databricks, education, External, Lakehouse, location, paragraph ordering, paragraph structure, paragraphorder, production, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, removing, sql, unity catalog, Write -
Removing an Obsolete Governance Tag from a Production Table
POST_START Removing an Obsolete Governance Tag from a Production Table I recently had to address an outdated governance tag on a production table in our data lake. The table, production.customers.customer_master, was marked with a legacy_classification tag that was no longer relevant. My task was to remove this tag and verify that it was successfully removed.…
A1, category:business, category:education, category:software, category:technology, coding, data engineering, data governance, databricks, education, Governance, Lakehouse, obsolete, paragraph ordering, paragraph structure, paragraphorder, production, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, removing, sql, table, tag, unity catalog -
Removing a Row Filter During a Controlled Security Policy Rollback
POST_START Removing a Row Filter During a Controlled Security Policy Rollback I recently had to roll back a security policy that had been applied to a critical table in our data warehouse. The policy had introduced a row filter that restricted access to certain customer records. Now, as part of a controlled rollback, I needed…
A1, category:business, category:education, category:software, category:technology, coding, controlled, data engineering, data governance, databricks, during, education, filter, Lakehouse, paragraph ordering, paragraph structure, paragraphorder, policy, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, removing, rollback, row, security, sql, unity catalog -
Removing Column Masks from Protected Columns
POST_START Removing Column Masks from Protected Columns Understanding the Need to Remove Column Masks I recently took on the responsibility of managing sensitive customer data in our Databricks environment. One of the key tasks was to ensure that data access adhered to strict privacy regulations. As part of this, certain columns, like the customer email,…
A1, category:business, category:education, category:software, category:technology, coding, column, columns, data engineering, data governance, databricks, education, Lakehouse, masks, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, protected, removing, sql, unity catalog -
Removing Row-Level Filters from Tables
POST_START Removing Row-Level Filters from Tables I recently encountered a situation where a table in our data lake had been filtered at the row level, and we needed to remove those filters to access the full dataset. The table in question was training.sales.customers, and the filters were applied as part of a row-level security policy.…
A1, category:business, category:education, category:software, category:technology, coding, data engineering, data governance, databricks, education, filters, Lakehouse, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, removing, row-level, sql, tables, unity catalog -
Removing All Rows While Preserving a Table with TRUNCATE
POST_START Removing All Rows While Preserving a Table with TRUNCATE I recently had the task of cleaning up some data in the training.sales.customer_master table. The goal was to remove all rows from the table while keeping the table structure intact. This is a common operation when you need to reset a table for testing or…
(all), A1, category:business, category:education, category:software, category:technology, coding, data engineering, data governance, databricks, education, Lakehouse, paragraph ordering, paragraph structure, paragraphorder, preserving, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, removing, rows, sql, table, truncate, unity catalog, while -
Removing Stale Production Access After Team Changes
POST_START Removing Stale Production Access After Team Changes Last week, our team underwent a restructuring, and the former sales team was disbanded. As part of the cleanup, I needed to ensure that no former team members still had access to production data. My first step was to check what access was currently granted on the…
A1, Access, after, category:business, category:education, category:software, category:technology, changes, coding, data engineering, data governance, databricks, education, Lakehouse, paragraph ordering, paragraph structure, paragraphorder, production, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, removing, sql, stale, team, unity catalog -
Removing Temporary Elevated Production Privileges
POST_START Removing Temporary Elevated Production Privileges I recently had to address a security concern where a group of incident responders had been granted temporary MODIFY privileges on the production.sales.orders table. These privileges were initially issued to allow them to investigate a data integrity issue, but the incident had been resolved, and the elevated access was…
A1, category:business, category:education, category:software, category:technology, coding, data engineering, data governance, databricks, education, elevated, Lakehouse, paragraph ordering, paragraph structure, paragraphorder, privileges, production, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, removing, sql, temporary, unity catalog -
Safely Removing Column-Level Masking from a Production Unity Catalog Table
POST_START Safely Removing Column-Level Masking from a Production Unity Catalog Table Safely Removing Column-Level Masking from a Production Unity Catalog Table I’ve been working on a project where we needed to update a customer email column in our production table to remove column-level masking. The table in question is production.customers.customer_master, and the column we’re focusing…
A1, category:business, category:education, category:software, category:technology, coding, column-level, data engineering, data governance, databricks, education, Lakehouse, masking, paragraph ordering, paragraph structure, paragraphorder, production, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, removing, safely, sql, table, unity catalog
