Senior Data Engineer
Summary:
- Location: Iselin, NJ
- Work Mode: Hybrid
- Formulates system scope through research and fact-finding to develop or modify moderately complex information systems.
- Evaluates and implements changes to existing system logic difficulties and documentation as necessary.
- Reviews flow charts, models, and procedures and feasibility studies to design possible system solutions.
- Reviews technical documentation to guide system users and to assist with the ongoing operation, maintenance, and development of the system.
- Collaborates with system analysts, engineers, and programmers to design systems and to determine project limitations and capabilities, performance requirements, systems performance standards, and interfaces.
- Identifies and documents all system constraints, implications and consequences of various proposed system changes.
- Educates end users on system designs and functionalities through creation of training materials and conducting demos.
- Evaluates the efficiency and effectiveness of application operations and troubleshooting problems.
- Develop ETL frameworks and tools.
- Design and optimize databases (e.g., PostgreSQL, MySQL, Snowflake).
- Deploy and manage cloud solutions on AWS (Lambda, Glue, S3, Airflow).
- Implement CI/CD pipelines, security best practices, and performance monitoring.
- Lead technical discussions, mentor developers, and drive best practices.
- 5 to 7 years of experience in Python backend development.
- Expertise in PostgreSQL and other DB tools.
- Expertise in AWS services, Terraform.
- Experience with ETL frameworks and tools.
- Experience with Kafka, event-driven architecture.
- Strong problem-solving, analytical, and communication skills.
- University Degree Preferred
- Experience with working for the technology department of Asset Management firms.
