metadata
-
Reconstructing a Missing Table Incident from Metadata and Delta History
POST_START Reconstructing a Missing Table Incident from Metadata and Delta History I was working on a routine data validation task when I received an alert that the orders table in the production.sales database was missing. At first, I assumed it might have been accidentally dropped or moved. But I knew the orders table was critical…
A1, category:business, category:education, category:software, category:technology, coding, data engineering, data governance, databricks, Delta, education, history, incident, Lakehouse, metadata, Missing, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, reconstructing, sql, table, unity catalog -
Reconstructing a Missing Table Incident from Metadata and Delta History
POST_START Reconstructing a Missing Table Incident from Metadata and Delta History I was working on a routine data review when I noticed that the orders table in the production.sales database was missing. This was unexpected because the table had been a critical part of our sales analytics. I wanted to understand what had happened and…
A1, category:business, category:education, category:software, category:technology, coding, data engineering, data governance, databricks, Delta, education, history, incident, Lakehouse, metadata, Missing, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, reconstructing, sql, table, unity catalog -
Troubleshooting a Row Filter by Inspecting Its Function and Table Metadata
POST_START Troubleshooting a Row Filter by Inspecting Its Function and Table Metadata I recently encountered an issue with a row filter that wasn’t behaving as expected. The filter, defined as a function in Unity Catalog, was supposed to restrict access to customer data based on their region. However, some users were seeing data they shouldn’t…
A1, category:business, category:education, category:software, category:technology, coding, data engineering, data governance, databricks, education, filter, function, inspecting, its, Lakehouse, metadata, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, row, sql, table, troubleshooting, unity catalog -
Reconstructing a Missing Table Incident from Metadata and Delta History
POST_START Reconstructing a Missing Table Incident from Metadata and Delta History Today, I encountered an issue where a critical table in our production environment was missing. The table in question was production.sales.orders, and the team was urgently looking for a way to recover it or at least understand what had happened. I knew that Unity…
A1, category:business, category:education, category:software, category:technology, coding, data engineering, data governance, databricks, Delta, education, history, incident, Lakehouse, metadata, Missing, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, reconstructing, sql, table, unity catalog -
Discovering Schema Metadata with INFORMATION_SCHEMA
POST_START Discovering Schema Metadata with INFORMATION_SCHEMA I recently needed to understand the structure of schemas in my Databricks environment to better organize and manage data assets. I decided to explore the schema metadata using the INFORMATION_SCHEMA in Unity Catalog, which provides a standardized way to query metadata about databases and schemas. Exploring Schema Metadata I…
A1, category:business, category:education, category:software, category:technology, coding, data engineering, data governance, databricks, discovering, education, information, Lakehouse, metadata, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, schema, sql, unity catalog -
Discovering Catalog Metadata with INFORMATION_SCHEMA
POST_START Discovering Catalog Metadata with INFORMATION_SCHEMA I recently started working with Databricks Unity Catalog, and I wanted to get a better understanding of the metadata available in the environment. One of the first things I needed to do was find out what catalogs exist within the Databricks workspace. I remembered that Unity Catalog provides a…
A1, category:business, category:education, category:software, category:technology, coding, data engineering, data governance, databricks, discovering, education, information, Lakehouse, metadata, paragraph ordering, paragraph structure, paragraphorder, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, schema, sql, unity catalog -
Databricks Unity Catalog: Discovering Metadata with BROWSE Privilege
POST_START # Databricks Unity Catalog: Discovering Metadata with BROWSE Privilege In the world of data engineering and analytics, understanding the structure and metadata of your data assets is essential for effective data governance, collaboration, and discovery. Databricks Unity Catalog provides a powerful framework for managing and discovering metadata across your organization's data assets. One of…
A1, browse, category:business, category:education, category:software, category:technology, coding, data engineering, data governance, databricks, discovering, education, Lakehouse, metadata, paragraph ordering, paragraph structure, paragraphorder, privilege, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:database administrator, profession:software engineer, profession:solution architect, progressive learning, sql, unity catalog
