data engineering
-
Managing Schema-Level SELECT Access Across Tables
POST_START Managing Schema-Level SELECT Access Across Tables I recently had the task of setting up access controls for a new analytics team in our organization. The goal was to grant them the ability to query data from a specific schema across multiple tables, without giving them full administrative privileges. I decided to use Databricks Unity…
A1, Access, Across, category:business, category:education, category:software, category:technology, coding, data engineering, data governance, databricks, education, Lakehouse, Managing, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, schema-level, select, sql, tables, unity catalog -
Inspecting Storage Credentials for External Data Access
POST_START Inspecting Storage Credentials for External Data Access I recently needed to understand how our team is accessing external storage systems for data processing. I started by checking the list of storage credentials that are currently registered in Unity Catalog. This would give me a high-level overview of what credentials are available and who owns…
A1, Access, category:business, category:education, category:software, category:technology, coding, credentials, data, data engineering, data governance, databricks, education, External, inspecting, Lakehouse, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, sql, Storage, unity catalog -
Creating and Inspecting Governed External Locations
POST_START Creating and Inspecting Governed External Locations I recently needed to set up a new external location in Unity Catalog to access raw data stored in cloud storage. This location would be used by multiple teams, so I wanted to ensure it was properly governed and secured. I started by creating the external location with…
A1, category:business, category:education, category:software, category:technology, coding, creating, data engineering, data governance, databricks, education, External, governed, inspecting, Lakehouse, locations, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, sql, unity catalog -
Transferring Ownership of Unity Catalog Objects
POST_START Transferring Ownership of Unity Catalog Objects I recently took on the responsibility of managing access to our Unity Catalog in Databricks. As part of a team restructuring, I needed to transfer ownership of various catalog objects to different teams. The goal was to ensure that the right people had control over the data assets…
A1, category:business, category:education, category:software, category:technology, coding, data engineering, data governance, databricks, education, Lakehouse, objects:, ownership, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, sql, transferring, unity catalog -
Controlling Table Data Changes with MODIFY Privileges
POST_START Controlling Table Data Changes with MODIFY Privileges I recently had the task of managing access to a table in our data warehouse called training.sales.customers. The goal was to ensure that only specific teams could modify the data, while others could only read it. I learned that using the MODIFY privilege is essential for allowing…
A1, category:business, category:education, category:software, category:technology, changes, coding, controlling, data, data engineering, data governance, databricks, education, Lakehouse, modify, paragraph ordering, paragraph structure, paragraphorder, privileges, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, sql, table, unity catalog -
Controlling Table Read Access with SELECT Privileges
POST_START Controlling Table Read Access with SELECT Privileges I recently had the task of setting up access controls for a new dataset in our organization’s data lake. The goal was to ensure that only specific analysts could read a particular customer table, while keeping the data secure from unauthorized users. I decided to use Databricks…
A1, Access, category:business, category:education, category:software, category:technology, coding, controlling, data engineering, data governance, databricks, education, Lakehouse, paragraph ordering, paragraph structure, paragraphorder, privileges, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, read, select, sql, table, unity catalog -
Granting and Revoking Schema-Level Access
POST_START Granting and Revoking Schema-Level Access I recently had the task of managing access to a new data catalog in Databricks Unity Catalog. The goal was to grant specific permissions to a group of analysts while ensuring that only authorized users could interact with the data. I started by understanding the structure of the catalog…
A1, Access, category:business, category:education, category:software, category:technology, coding, data engineering, data governance, databricks, education, granting, Lakehouse, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, revoking, schema-level, sql, unity catalog -
Granting and Revoking Catalog-Level Access
POST_START Granting and Revoking Catalog-Level Access I recently had the task of managing access to a Databricks Unity Catalog called training. My team needed to ensure that only specific roles could interact with this catalog, while others had no access. I decided to use the GRANT and REVOKE commands to manage these permissions at the…
A1, Access, catalog-level, category:business, category:education, category:software, category:technology, coding, data engineering, data governance, databricks, education, granting, Lakehouse, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, revoking, sql, unity catalog
