Interview : Video
Visa : USC, GC, GC EAD, H4, L2
This is hybrid from Day-1
Description : MOTOR Information Systems, an operating group of Hearst, is actively seeking a Senior AWS Data Lake Developer. Ideally, a hands-on data engineer who possesses a strong passion for designing, optimizing, refactoring, and upgrading complex data solutions. MOTOR's primary product is Automotive Content, and we need someone who can help us design, develop and model Data Lakes within AWS.
We are looking for someone who wants to be part of our mission to transform the future. We have a rare opportunity for you to use your talent, passion, and expertise to help drive this massive change in how we build our user experience across our product lines, and how consumers experience the MOTOR Product Platform.
This position offers excellent career growth and promotional opportunities, stellar compensation, and the ability to work with the world's premier provider of aftermarket automotive data. Hearst/MOTOR Information Systems will be the best and last place you'll ever work.
Required Experience (Must Have) - Expert Python Developer (Minimum Two Years of Experience)
- Strong AWS Experience (Minimum Three Years of Experience)
- Demonstrated Data Lake Experience (with S3 as Storage)
- Expert Lambda Developer
- Expert in Fargate / Containers
- Expert in Step Functions / State Machines
- Expert in Cloud Formation
- Experience with Semi-Structured Data
- Experience with Larger Data Pipelines (Multiple Terabytes)
- Experience with Linux
- Strong Automation Experience
Helpful Experience (Nice to Have) - Experience with AWS Glue / Spark
- Experience with DevOps, CI/CD, Deployment Orchestration (Octopus Deploy)
- Experience with Git and Azure DevOps
- Experience with Relational Databases
- Experience with Neo4j
- Experience with Kettle and/or Apache Hop
- Experience with Automotive Data / Industry
- Experience with Agile / Scrum
Primary Responsibilities
- Analyze large, and complex, data sets
- Design, develop and coordinate the generation of Data Pipelines
- Model complex data sets
- Work collaboratively with team to plan and solve complex problems
- Design for, or optimize existing pipelines, for performance
Desired Skills and Experience PYTHON