tables
-
Removing Row-Level Filters from Tables
POST_START Removing Row-Level Filters from Tables I recently encountered a situation where a table in our data lake had been filtered at the row level, and we needed to remove those filters to access the full dataset. The table in question was training.sales.customers, and the filters were applied as part of a row-level security policy.…
A1, category:business, category:education, category:software, category:technology, coding, data engineering, data governance, databricks, education, filters, Lakehouse, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, removing, row-level, sql, tables, unity catalog -
Creating and Managing External Delta Tables
POST_START Creating and Managing External Delta Tables I recently needed to create an external Delta table in Databricks Unity Catalog to integrate data from an external source. This table would be used to store sales orders, and I wanted to ensure it was properly managed within the catalog. I started by defining the structure of…
A1, category:business, category:education, category:software, category:technology, coding, creating, data engineering, data governance, databricks, Delta, education, External, Lakehouse, Managing, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, sql, tables, unity catalog -
Managing Schema-Level SELECT Access Across Tables
POST_START Managing Schema-Level SELECT Access Across Tables I recently had the task of setting up access controls for a new analytics team in our organization. The goal was to grant them the ability to query data from a specific schema across multiple tables, without giving them full administrative privileges. I decided to use Databricks Unity…
A1, Access, Across, category:business, category:education, category:software, category:technology, coding, data engineering, data governance, databricks, education, Lakehouse, Managing, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, schema-level, select, sql, tables, unity catalog -
Dropping Unity Catalog Tables
POST_START Dropping Unity Catalog Tables Starting the Process I recently needed to clean up some old data in my Unity Catalog to make space and ensure that our data lake remains organized. One of the tables I identified for removal was training.sales.customer_master. Before I proceed, I wanted to make sure I understood the implications of…
A1, category:business, category:education, category:software, category:technology, coding, data engineering, data governance, databricks, dropping, education, Lakehouse, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, sql, tables, unity catalog -
Deleting Selected Records from Delta Tables
POST_START Deleting Selected Records from Delta Tables I recently needed to clean up some customer data in my Delta table. The task was to remove a specific customer record by their ID. I started by checking the current state of the table to make sure I understood what I was working with. SELECT * FROM…
A1, category:business, category:education, category:software, category:technology, coding, data engineering, data governance, databricks, deleting, Delta, education, Lakehouse, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, records, selected, sql, tables, unity catalog -
Updating Existing Records in Delta Tables
POST_START Updating Existing Records in Delta Tables I recently needed to update a specific customer’s country in our Delta table. The customer had an ID of 1, and I wanted to change their country to the Netherlands. I knew that Delta Lake supports updates, but I wanted to make sure I did it correctly using…
A1, category:business, category:education, category:software, category:technology, coding, data engineering, data governance, databricks, Delta, education, existing, Lakehouse, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, records, sql, tables, unity catalog, Updating -
Adding New Records to Unity Catalog Tables with INSERT
POST_START Adding New Records to Unity Catalog Tables with INSERT I started my day by exploring how to add new records to tables in Databricks Unity Catalog. I had previously worked with data in Delta tables, but I wanted to understand how the Unity Catalog enhances data management by providing governance, access control, and metadata…
A1, Adding, category:business, category:education, category:software, category:technology, coding, data engineering, data governance, databricks, education, insert, Lakehouse, new, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, records, sql, tables, unity catalog
