category:business
-
Creating and Managing Managed Volumes for Non-Tabular Files
POST_START Creating and Managing Managed Volumes for Non-Tabular Files I recently needed to organize a growing collection of non-tabular files, such as PDFs, CSVs, and text documents, for a data pipeline. These files were not structured in a traditional table format, so using standard tables wasn’t the right approach. Instead, I decided to leverage Databricks…
A1, category:business, category:education, category:software, category:technology, coding, creating, data engineering, data governance, databricks, education, files, Lakehouse, Managed, Managing, non-tabular, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, sql, unity catalog, volumes -
Managing Read, Write, and Table-Creation Access on External Locations
POST_START Managing Read, Write, and Table-Creation Access on External Locations Setting Up Access for Data Engineers I recently needed to set up access for the data_engineers team to an external location called raw_data. The goal was to grant them the ability to read files from this location, but also to manage their permissions carefully to…
A1, Access, category:business, category:education, category:software, category:technology, coding, data engineering, data governance, databricks, education, External, Lakehouse, locations, Managing, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, read, sql, table-creation, unity catalog, Write -
Managing Schema-Level SELECT Access Across Tables
POST_START Managing Schema-Level SELECT Access Across Tables I recently had the task of setting up access controls for a new analytics team in our organization. The goal was to grant them the ability to query data from a specific schema across multiple tables, without giving them full administrative privileges. I decided to use Databricks Unity…
A1, Access, Across, category:business, category:education, category:software, category:technology, coding, data engineering, data governance, databricks, education, Lakehouse, Managing, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, schema-level, select, sql, tables, unity catalog -
Inspecting Storage Credentials for External Data Access
POST_START Inspecting Storage Credentials for External Data Access I recently needed to understand how our team is accessing external storage systems for data processing. I started by checking the list of storage credentials that are currently registered in Unity Catalog. This would give me a high-level overview of what credentials are available and who owns…
A1, Access, category:business, category:education, category:software, category:technology, coding, credentials, data, data engineering, data governance, databricks, education, External, inspecting, Lakehouse, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, sql, Storage, unity catalog -
Creating and Inspecting Governed External Locations
POST_START Creating and Inspecting Governed External Locations I recently needed to set up a new external location in Unity Catalog to access raw data stored in cloud storage. This location would be used by multiple teams, so I wanted to ensure it was properly governed and secured. I started by creating the external location with…
A1, category:business, category:education, category:software, category:technology, coding, creating, data engineering, data governance, databricks, education, External, governed, inspecting, Lakehouse, locations, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, sql, unity catalog -
Transferring Ownership of Unity Catalog Objects
POST_START Transferring Ownership of Unity Catalog Objects I recently took on the responsibility of managing access to our Unity Catalog in Databricks. As part of a team restructuring, I needed to transfer ownership of various catalog objects to different teams. The goal was to ensure that the right people had control over the data assets…
A1, category:business, category:education, category:software, category:technology, coding, data engineering, data governance, databricks, education, Lakehouse, objects:, ownership, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, sql, transferring, unity catalog -
Controlling Table Data Changes with MODIFY Privileges
POST_START Controlling Table Data Changes with MODIFY Privileges I recently had the task of managing access to a table in our data warehouse called training.sales.customers. The goal was to ensure that only specific teams could modify the data, while others could only read it. I learned that using the MODIFY privilege is essential for allowing…
A1, category:business, category:education, category:software, category:technology, changes, coding, controlling, data, data engineering, data governance, databricks, education, Lakehouse, modify, paragraph ordering, paragraph structure, paragraphorder, privileges, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, sql, table, unity catalog -
Controlling Table Read Access with SELECT Privileges
POST_START Controlling Table Read Access with SELECT Privileges I recently had the task of setting up access controls for a new dataset in our organization’s data lake. The goal was to ensure that only specific analysts could read a particular customer table, while keeping the data secure from unauthorized users. I decided to use Databricks…
A1, Access, category:business, category:education, category:software, category:technology, coding, controlling, data engineering, data governance, databricks, education, Lakehouse, paragraph ordering, paragraph structure, paragraphorder, privileges, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, read, select, sql, table, unity catalog
