Data Engineer
Posted
Job ID: (phone number removed)
Job Title: Data Engineer
Location: San Jose (Local Candidates Only)
Duration: 6 months + possible extension
Rate Range: $50 - $58/hour on W2/ C2C (All inclusive)
Job Description:
We are looking for a highly skilled and hands-on Senior Data Engineer with strong expertise in Azure data technologies, Databricks, PySpark, and large-scale ETL/ELT pipeline development. The ideal candidate will be responsible for designing, developing, monitoring, and supporting enterprise-grade data workflows while ensuring data quality, governance, and operational excellence.This role requires close collaboration with business, analytics, and engineering teams to build scalable and reliable data solutions supporting critical business operations and analytics initiatives.Key Responsibilities
Job Title: Data Engineer
Location: San Jose (Local Candidates Only)
Duration: 6 months + possible extension
Rate Range: $50 - $58/hour on W2/ C2C (All inclusive)
Job Description:
We are looking for a highly skilled and hands-on Senior Data Engineer with strong expertise in Azure data technologies, Databricks, PySpark, and large-scale ETL/ELT pipeline development. The ideal candidate will be responsible for designing, developing, monitoring, and supporting enterprise-grade data workflows while ensuring data quality, governance, and operational excellence.This role requires close collaboration with business, analytics, and engineering teams to build scalable and reliable data solutions supporting critical business operations and analytics initiatives.Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT data pipelines using Azure Data Factory (ADF), Azure Databricks, and PySpark.
- Build and optimize large-scale structured and unstructured data processing workflows.
- Develop and manage workflow orchestration using Airflow / Astronomer.
- Monitor, troubleshoot, and support production data pipelines and workflows.
- Ensure data quality, validation, governance, and lineage across data platforms.
- Work closely with business stakeholders, analytics teams, and cross-functional engineering teams to gather requirements and deliver data solutions.
- Improve pipeline performance, scalability, reliability, and operational efficiency.
- Support end-to-end data lifecycle management and operational ownership.
- Strong hands-on experience with:
- Azure Data Factory (ADF)
- Azure Databricks
- PySpark / Spark SQL
- Advanced SQL
- Experience building and supporting:
- Production-grade ETL/ELT pipelines
- End-to-end data workflows
- Large-scale structured and unstructured data processing
- Strong expertise in:
- Airflow / Astronomer
- Workflow orchestration
- Pipeline monitoring and troubleshooting
- Good understanding of:
- Data quality and validation
- Data governance and lineage
- Production support and operational ownership
- Excellent communication and stakeholder management skills.
- Candidate must be a hands-on engineer and comfortable working directly with business and analytics teams.
- Experience with marketing analytics platforms and campaign/impression/spend data.
- Exposure to:
- Client Fabric
- Snowflake
- dbt
- Delta Lake
- Kafka / Event Hub streaming pipelines
- Experience with:
- CI/CD for data pipelines
- Real-time or near-real-time data processing
- Data governance frameworks
- Comprehensive health insurance plans
- Opportunities for professional development and career growth
- Inclusive and dynamic work environment
