We are in search of a Lead Senior Automation Test Engineer to design, build, and test automated frameworks. This role focuses on coding reusable components and integrating test frameworks to ensure quality outcomes.
Key Responsibilities: - Identify and design essential tests to guarantee the quality of data and pipelines.
- Lead testing automation strategies and oversee their successful implementation.
- Create and maintain efficient data pipelines that ingest, transform, catalog, and deliver quality data from multiple sources into the Common Data Platform, enabling detailed business analysis.
- Possess a strong understanding of data architecture, information security, and data governance, while developing processes that uphold standards.
- Proactively troubleshoot and resolve issues within data pipelines and analytical data stores.
- Implement monitoring and alerting systems for data pipelines and stores, leveraging automated remediation wherever feasible to maintain system reliability.
- Adopt a security-first and automation-first approach by adhering to best practices in data engineering.
- Collaborate within an Agile delivery squad, engaging actively in various Agile rituals and following Scaled Agile methodologies.
Qualifications: - A Bachelor's degree in computer science, Information Systems, or a related field is typically required.
- At least seven years of experience in test automation, data science, or software engineering.
- Minimum of 2 years working with a modern data stack, which includes object stores like S3, Spark, Airflow, and Lakehouse architectures.
- 2+ years of experience using automated test tools such as Great Expectations, Lambda Test, Selenium, and Cucumber.
- A background as a Senior Data Engineer, with thorough knowledge of the technology landscape and functional objectives.
- Experience in building end-to-end data pipelines to process unstructured or semi-structured data using Spark architecture.
- Familiarity with data engineering and knowledge of the Big Data ecosystem is preferred.
- A strong drive and enthusiasm to tackle challenges and opportunities within a large, complex, and visible program.
- Understanding of various automation strategies and methodologies for testing data, applications, and CI/CD infrastructure.
- Commitment to mutual respect, and a dedication to embracing diversity, equity, and inclusion while acting with authenticity.