Sr. ETL Developer, Remote
Job Summary
The Senior ETL developer will work with the Corporate IT team to maintain and develop data integration solutions to support our Analytics platform. The solutions must align with data vault, data mart, dimensional modeling, and ETL standards and guidelines. The data modeling and data integration solutions will be based on Matillion with Snowflake data warehouses/databases & Power BI for reporting platform.
The ideal candidate will need to understand business and technical requirements and translate this into data integration designs and deliverables by working with the Corporate Data Architect. The position also requires supporting the Agile process in terms of Development, testing, deployment and post-production support.
Responsibilities
- Handle multiple projects in parallel, participate and deliver solution design while working closely with the architecture
- Design and Develop/Review ETL programs primarily using modern ETL tools like Matillion, DBT , and Python
- Coach and guide the technical team in terms development of ETL jobs
- Provide performance improvement and tuning of data pipeline.
- Perform technical reviews, data validation, and end to end testing of ETL objects, source data analysis and data profiling
- Create necessary documentation as per the standards and update the project documentation
- Support QA on end-to-end testing and provide daily/weekly project status to the project manager
- Work with deployment team in the code migration across the environments
- Triage the Production issues and work on the code fixes
- Proven experience in database administration with cloud data platforms like Snowflake
- Frees up data engineers and analysts from administrative tasks
- Education and Experience
- 10+ years of experience in implementation of BI projects in a large-scale enterprise data warehouse environment
- Hands-on experience in building large cloud data warehouses using Snowflake; including database architecture design, data transformations, stored procedures, account and security principles, performance management, etc.
- Experience with cloud computing services, particularly deploying and running services in Azure
- Expert-level understanding of Agile, SDCL, CI/CD, DevOps, GitOps, and ProdOps.
- A team player with excellent verbal and written communication skills
- Experience with other ETL tools like Matillion, ADF, and DBT
- Advance SQL knowledge and familiar with relational, Vault, and dimensional modeling
- Knowledge of Power BI
- Financial industry data fluency is preferred but not required
- Required knowledge and skills would typically be a acquired through a bachelor's degree in information technology or related field
Skills & Requirements
- Snowflake administration & configuration with some development.
- Over the first 6 months, 60% of the time will be spent in Snowflake administration and configuration. This will reduce as automation is implemented
- Must know how Snowflake integrates with other tools (Disaster Recovery, etc.)
- Prior ETL Development experience is required.
- Production optimization and workflow experience.
- Previous Snowflake experience, deep understanding of query, structure, security and networking piece, architecture.
- ETL experience to troubleshoot or help other developers (Matillion training, on the job)
- Previous reporting experience, understanding of analytics reporting. PowerBI preferred.