GCP Cloud Engineer
Mandatory skills: GCP Composer (Apache Airflow)
Job Description:
Fix and enhance Dataflow and/or Dataproc Data ingestion pipelines (batch & Streaming) .
Have Good Understanding of GCP Composer (Apache Airflow) environments.
Manage Airflow DAGs and troubleshoot Airflow-related issues.
Monitor and optimize Composer performance and scalability.
Maintain GCP infrastructure including services like:o Google Cloud Storage (GCS)
o BigQuery (BQ)
o Cloud Dataflow ( Apache Beam )
o Cloud Dataproc
o Cloud Functions
o Cloud Run Have Good Understanding of:o IAM and service account permissions
o Secret Manager Monitor GCP usage and quotas, and proactively prevent quota-related issues.
Set up and manage alerting, logging, and monitoring using tools like Stackdriver (Cloud Monitoring & Logging).
DB design experience (with Excellent RDBS-PLSQL knowledge )
Design Springboot APIs
Analyze, design, create Dockerfile
Knowledge on Angular ( Good to Have )
Design and implement infrastructure as code using Terraform for provisioning and managing GCP resources.
Collaborate with DevOps and development teams to manage CI/CD pipelines using Jenkins and other automation tools.
Ensure security, compliance, and cost-efficiency across the cloud environment.
Document system configurations, procedures, and best practices.
Proficient in either Java or Python programming languages.
Excellent problem-solving and troubleshooting skills.
Strong communication and documentation abilities.
Knowledge on DNS and SSO configuration setup
Knowledge on CDC Pipelines/Application (Good to Have)
Job Description:
Fix and enhance Dataflow and/or Dataproc Data ingestion pipelines (batch & Streaming) .
Have Good Understanding of GCP Composer (Apache Airflow) environments.
Manage Airflow DAGs and troubleshoot Airflow-related issues.
Monitor and optimize Composer performance and scalability.
Maintain GCP infrastructure including services like:o Google Cloud Storage (GCS)
o BigQuery (BQ)
o Cloud Dataflow ( Apache Beam )
o Cloud Dataproc
o Cloud Functions
o Cloud Run Have Good Understanding of:o IAM and service account permissions
o Secret Manager Monitor GCP usage and quotas, and proactively prevent quota-related issues.
Set up and manage alerting, logging, and monitoring using tools like Stackdriver (Cloud Monitoring & Logging).
DB design experience (with Excellent RDBS-PLSQL knowledge )
Design Springboot APIs
Analyze, design, create Dockerfile
Knowledge on Angular ( Good to Have )
Design and implement infrastructure as code using Terraform for provisioning and managing GCP resources.
Collaborate with DevOps and development teams to manage CI/CD pipelines using Jenkins and other automation tools.
Ensure security, compliance, and cost-efficiency across the cloud environment.
Document system configurations, procedures, and best practices.
Proficient in either Java or Python programming languages.
Excellent problem-solving and troubleshooting skills.
Strong communication and documentation abilities.
Knowledge on DNS and SSO configuration setup
Knowledge on CDC Pipelines/Application (Good to Have)
