Principal Databricks Data Engineer

Principal Databricks Data Engineer Experience Required: 1218 Years Key Requirements 1218 years of overall Data Engineering experience 8+ years of experience with enterprise Data Warehouse and Data Lake platforms 5+ years of hands-on experience with Databricks and Apache Spark at scale Strong experience modernizing legacy Cloudera platforms including: CDH/CDP Hive HBase Impala Spark Modernize Cloudera platforms to Databricks Lakehouse architecture Redesign ingestion, transformation, and consumption patterns from HDFS-based architecture to Cloud Object Storage and Delta Lake Refactor legacy Hive and Impala logic into PySpark and Spark SQL ELT pipelines Ensure data reconciliation, audit integrity, and consistency during migration Design and govern enterprise Data Warehouse and Data Lake/Lakehouse architectures Implement layered data architecture including: Raw / Landing Layer Curated / Conformed Layer Semantic / Consumption Layer Modernize traditional Enterprise Data Wa...