Data Engineer
Mandatory Skills: SQL/Python/Data Engineer/AWS
- Data Engineers who can build scalable, reliable data pipelines and infrastructure, requiring mastery in SQL, Python/Scala, cloud platforms (AWS), and big data technologies (Spark, Kafka, Hadoop).
- Key skills include data modeling, ETL/ELT pipeline construction, data warehousing and orchestration tools like Airflow. Strong problem-solving, collaboration, and data governance skills are crucial. Collect, process, and analyze large datasets to extract meaningful insights.
- Design and conduct experiments to test hypotheses and validate data-driven solutions.
- Collaborate with cross-functional teams to identify data needs and align strategies with organizational goals.
- Create templates, dashboards and visualizations to communicate findings effectively to stakeholders.
- Ensure data integrity and accuracy through cleaning, preprocessing, and validation techniques.
- Optimize data collection and storage processes for efficiency and scalability. Knowledge on Manufacturing process is preferred.
