Lead Data Engineer

Chicago, Illinois

Next Gen IT Inc
Job Expired - Click here to search for similar jobs

Role: Lead Data Engineer Azure

Duration: 12+ months

Hybrid (Chicago)

Exp: 14+yrs


Job Description

As a Lead Senior Data Engineer you will play a crucial role in shaping our data infrastructure and strategy. You will be responsible for leading a team of data engineers, designing and implementing robust data solutions, and ensuring the scalability and reliability of our data system. This role is perfect for a dynamic leader passionate about leveraging data to make impactful decisions. You dedicate time to stay on top of the fast changing tech space and invest a lot of energy in learning new tricks. You are caught up on industry trends in data integration/transformation frameworks, DevSecOps, serverless computing/architecture and cloud technologies along with building skills to anticipate what the near future will bring. You love clean interfaces and have a real passion for extraordinary user experience.

Our tech stack:
Oracle Exadata / Snowflake / Azure / Airflow / Python / Kafka / Shell scripting / PowerBI

Top Skills for the role:
Oracle database (19c) Development and performance tuning
Team leading experience guiding/mentoring the team, getting work done on time
Snowflake
Azure cloud
CICD DevOps for database
Unix shell scripting
Airflow

responsibilities
This is a net new add as they need someone on-site in Chicago to lead the team. Prior resource was off-shore and off-hours creating some complexities
Will assist with code reviews, enhancements
MUST BE willing to perform hands-on work
Likely a Contract-to-Hire opportunity after 6 months to 1 year+


Additional Skills & Qualifications

Furthermore:
You bring 9 to 12+ years of experience in data engineering designing, implementing and maintaining efficient data platforms
You have experience in leading and mentoring a team of data engineers, promoting a culture of excellence and continuous improvement
You have demonstrated experience in migrating on-premises data to cloud and setting up stable, scalable frameworks
You have strong understanding of data modeling techniques and experience in designing data models for cloud data warehouses and OLTP applications
You have advanced proficiency in Python for data processing and automation
You have strong understanding of relational database concepts and have experience with performance tuning techniques
You have hands-on experience with cloud infrastructure and services, preferably Azure, as it relates to data integration/migration.
You have experience with Kafka and CDC tools for real-time data synchronization
You have familiarity with BI tools and technologies for creating reports and dashboards
You have understanding of REST APIs and how to use them in practice
You have experience with continuous integration and collaboration tools like Azure ADO, GitHub and Confluence.
You have exposure to writing UNIX/LINUX scripts

Lead Data Engineer-Azure
Date Posted: 25 May 2024
Job Expired - Click here to search for similar jobs