Senior Databricks Consultant
Posted
Senior Databricks Consultant
Design and maintain conceptual, logical, and physical data models
Create dimensional models for analytics and reporting
Develop Fact and Dimension tables aligned with business requirements
Ensure data consistency, integrity, and standardization across datasetsDesign, develop, and maintain end to end ETL/ELT pipelines using Azure Data Factory
Build and optimize data processing workflows using Azure Databricks
Ingest data from multiple sources (SQL/NoSQL databases, APIs, flat files, cloud storage)
Implement incremental loads, error handling, logging, and monitoring
Optimize Spark jobs for performance, scalability, and cost efficiency
Manage data in Azure Data Lake (ADLS Gen2) or similar cloud storage
Collaborate with solution architects on data platform architecture
Implement data quality checks, validation rules, and reconciliation processes
Enforce data governance, security, and compliance standards
Support metadata management and lineage documentation
Design and maintain conceptual, logical, and physical data models
Create dimensional models for analytics and reporting
Develop Fact and Dimension tables aligned with business requirements
Ensure data consistency, integrity, and standardization across datasetsDesign, develop, and maintain end to end ETL/ELT pipelines using Azure Data Factory
Build and optimize data processing workflows using Azure Databricks
Ingest data from multiple sources (SQL/NoSQL databases, APIs, flat files, cloud storage)
Implement incremental loads, error handling, logging, and monitoring
Optimize Spark jobs for performance, scalability, and cost efficiency
Manage data in Azure Data Lake (ADLS Gen2) or similar cloud storage
Collaborate with solution architects on data platform architecture
Implement data quality checks, validation rules, and reconciliation processes
Enforce data governance, security, and compliance standards
Support metadata management and lineage documentation
