Must Haves:
- 10+ years of experience within data engineering
- Python experience
- Snowflake experience (developing ETL pipelines)
- IDMC (intelligent data management cloud) experience
- Knowledge of AWS
- Fluent in English (written and verbal)
Job Description:
This role will be part of a team focused on cloud transformation, modernizing analytics platforms and improving agility. The role requires hands-on experience in building and managing analytics solutions in Snowflake, Provide direction on adoption of Cloud technologies (Snowflake) and industry best practices in the field of Data Engineering architecture and Development.
Primary duties and responsibilities:
- Establish Data Engineering architecture strategy, best practices, standards, and roadmap
- Experience developing ETL Pipeline using Python, Snowflake and IDMC.
- Experience with loading batch data and streaming data via Kafka
- Build Data Flows mapping Source systems and Process flows.
- Assemble large, complex data sets that meet non-functional and functional business requirements
- Perform code reviews and assist developers in optimization and troubleshooting.
- Expertise in Snowflake advanced concepts like setting up resource monitors, RBAC controls, virtual warehouse sizing, query performance tuning, zero copy clone, time travel and understand how to use these features
- Knowledge in AWS and management technologies such as S3.
- Strong written communication skills
- Is effective and persuasive in both written and oral communication
Good to have:
- Kafka experience (loading batch and streaming data)
Snowflake Data Lead