Workflows.
-
🚨 The Dashboard Numbers Were Wrong — I Traced the Databricks Pipeline with My Team
🚨 The Dashboard Numbers Were Wrong — I Traced the Databricks Pipeline with My Team My morning started with a message from Maya, one of our business analysts: “The revenue dashboard is showing yesterday’s numbers.” A few seconds later, Daniel from the product team added another problem. Several orders visible in the operational application were…
A1, A2, auto-loader, B1, B2, C1, C2, category:databricks, cdc, chat, conversational, data engineering, data-freshness, data-quality, databricks, delta lake, difficulty:240, incident-response, production-pipelines, profession:data engineer, structured-streaming, team-conversation, troubleshooting, unity catalog, Workflows. -
🔎 I Investigate Databricks Production Incidents
A successful data pipeline can still hide a serious problem. I learned this after working through production-style Databricks incidents where a job could finish successfully while the resulting data was stale, duplicated, incomplete, unexpectedly expensive, or available to the wrong audience. That changed the way I think about data engineering. I no longer begin with…
A1, A2, auto-loader, B1, B2, C1, C2, category:databricks, cdc, chat, conversational, data engineering, data-engineer-professional, data-quality, databricks, delta lake, difficulty:240, incident-response, investigation, production-pipelines, profession:data engineer, root-cause-analysis, structured-streaming, troubleshooting, unity catalog, Workflows. -
Databricks: Organizations Should Modernize Legacy ETL Workflows Using Cloud Platforms. To What Extent Do You Agree or Disagree?
My Journey with Data and “Databricks”: A Newcomer’s Take on Modernizing Workflows Okay, so here I am in Berlin. It’s brilliant, truly. The food is amazing (the currywurst is an absolute addiction!), and the people are generally friendly – though sometimes my terrible German gets me into trouble! I moved over six months ago for…
Agree, bis gleich, category:bigdata, category:businessintelligence, category:cloudcomputing, category:databricks, category:dataintegration, category:digitaltransformation, category:etl, category:modernization, category:workflow, Cloud, databricks, dataengineer, Disagree, Do, english, ETL, Extent, foryourpage, fyp, Legacy, Modernize, multiplechoice, or), organizations, platforms, profession:business analyst, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:devops engineer, profession:project manager, profession:software developer, profession:solution architect, profession:system administrator, profession:technical writer, Should, teamwork, to, Using, what, wobizdu, Workflows., You -
Databricks: Every Data Platform Should Support End-to-End Machine Learning Workflows. Discuss Both Views.
Learning German & Databricks: A Newcomer’s Perspective Okay, deep breath. Moving to Berlin was amazing, honestly. The culture, the food… everything! But let’s be real, learning German has been a complete mountain range compared to just understanding “Bitte” and “Danke.” And that brings me to something I’ve been grappling with at my new job –…
(both…, bis gleich, category:analytics, category:artificial intelligence, category:big data, category:cloud computing, category:data platform, category:databricks, category:end-to-end workflows, category:etl, category:machine learning, category:workflow management, data, databricks, dataengineer, Discuss, End-to-End, english, Every, foryourpage, fyp, learning, Machine, multiplechoice, Platform, profession:analyst, profession:backend developer, profession:cloud engineer, profession:data analyst, profession:data engineer, profession:data scientist, profession:devops engineer, profession:machine learning engineer, profession:software developer, Should, support, teamwork, Views, wobizdu, Workflows.
