Data Engineer II

Posted by Pride Global

Cupertino, CA

Permanent

Title: Data Engineer II
Location: Cupertino, CA
Duration: 12-month contract
Mode: Hybrid (3days onsite)
Pay rate: $62/hr. - $67/hr. on W2

Role Overview
We are seeking a skilled Data Engineer (Software) with strong expertise in designing and implementing scalable data pipelines and modern data infrastructure. This role requires a blend of data engineering and infrastructure engineering capabilities, with hands-on experience managing containerized workflows in Kubernetes and Docker.
The ideal candidate will contribute to the development, deployment, and optimization of reliable data systems that support analytics, reporting, and data-driven decision-making in a cloud-based environment.

Key Technical Skills

SQL
Python
Bash / Shell Scripting
Apache Spark
Apache Airflow
Snowflake
DBT
AWS S3
Kubernetes
Docker
CI/CD Pipelines
GitHub
DevOps Practices

Key Requirements

25 years of professional experience in Data Engineering, Software Engineering, or Analytics Engineering
Strong proficiency in SQL and Python, with working knowledge of Bash/Shell scripting
Hands-on experience building and maintaining data pipelines using:
- Apache Spark
- Apache Airflow
- Snowflake
- DBT
- AWS S3
Proven experience with Kubernetes and Docker, including deployment, management, and troubleshooting of containerized workloads
Familiarity with CI/CD pipelines, version control (GitHub), and DevOps best practices
Experience with monitoring, automation, and improving system reliability in cloud environments (AWS preferred)
Strong understanding of data modeling, data warehousing, and distributed data systems
Ability to effectively bridge data engineering and infrastructure responsibilities

Responsibilities

Design, develop, and maintain scalable ELT/ETL pipelines using SQL and Python
Build and optimize distributed data processing workflows using Spark and Airflow
Deploy, manage, and monitor containerized data services using Kubernetes and Docker
Develop and maintain data infrastructure solutions on AWS, including S3-based data storage systems
Implement and enhance CI/CD pipelines to support automated deployment and delivery of data services
Ensure system reliability through monitoring, logging, alerting, and performance optimization
Collaborate with cross-functional teams to deliver robust, well-documented data solutions
Support urgent data requests, reporting needs, and ad-hoc analytical requirements as needed