Data Quality Engineer

JOB DESCRIPTION:

TITLE: DATA QUALITY ENGINEER

Location: Dallas, TX (NEED ONLY LOCALS - ONE ROUND OF FACE TO FACE AVAILABILITY IS MUST)

Duration: Long term

Interview: Mode One Teams call, One Face to Face interview

MUST HAVE 10+ Years experience over all IT experience .

Data Engineer Responsibilities: (SDET)

• Work with business stakeholders, Business Systems Analysts and Developers to ensure quality delivery of software.

• Interact with key business functions to confirm data quality policies and governed attributes.

• Follow quality management best practices and processes to bring consistency and completeness to integration service testing

• Designing and managing the testing AWS environments of data workflows during development and deployment of data products

• Provide assistance to the team in Test Estimation & Test Planning

• Design, development of Reports and dashboards.

• Analyzing and evaluating data sources, data volume, and business rules.

• Proficiency with SQL, familiarity with Python, Scala, Athena, EMR, Redshift and AWS.

• No SQL data and unstructured data experience.

• Extensive experience in programming tools like Map Reduce to HIVEQL

• Experience in data science platforms like SageMaker/Machine Learning Studio/ H2O.

• Should be well versed with the Data flow and Test Strategy for Cloud/ On Prem ETL Testing.

• Interpret and analyses data from various source systems to support data integration and data reporting needs.

• Experience in testing Database Application to validate source to destination data movement and transformation.

• Work with team leads to prioritize business and information needs.

• Develop complex SQL scripts (Primarily Advanced SQL) for Cloud ETL and On prem.

• Develop and summarize Data Quality analysis and dashboards.

• Knowledge of Data modeling and Data warehousing concepts with emphasis on Cloud/ On Prem ETL.

• Execute testing of data analytic and data integration on time and within budget.

• Work with team leads to prioritize business and information needs

• Troubleshoot & determine best resolution for data issues and anomalies

• Experience in Functional Testing, Regression Testing, System Testing, Integration Testing & End to End testing.

• Has deep understanding of data architecture & data modeling best practices and guidelines for different data and analytic platforms

Requirements:

• Extensive Experience in Data migration is a must ( Teradata to Redshift preferred)

• Extensive testing Experience with SQL/Unix/Linux scripting is a must

• Extensive experience testing Cloud/On Prem ETL (e.g. Abinitio, Informatica, SSIS, Datastage, Alteryx, Glu)

• Extensive experience DBMS like Oracle, Teradata, SQL Server, DB2, Redshift, Postgres and Sybase.

• Extensive experience using Python scripting and AWS and Cloud Technologies.

• Extensive experience using Athena, EMR, Redshift, AWS, and Cloud Technologies

• Experienced in large-scale application development testing - Cloud/ On Prem Data warehouse, Data Lake, Data science

• Experience with multi-year, large-scale projects

• Expert technical skills with hands-on testing experience using SQL queries.

• Extensive experience with both data migration and data transformation testing

• Extensive experience DBMS like Oracle, Teradata, SQL Server, DB2, Redshift, Postgres and Sybase.

• Extensive testing Experience with SQL/Unix/Linux.

• Extensive experience testing Cloud/On Prem ETL (e.g. Abinitio, Informatica, SSIS, Datastage, Alteryx, Glu)

• Extensive experience using Python scripting and AWS and Cloud Technologies.

• Extensive experience using Athena, EMR , Redshift and AWS and Cloud Technologies

• API/Rest Assured automation, building reusable frameworks, and good technical expertise/acumen

• Java/Java Script - Implement core Java, Integration, Core Java and API.

• Functional/UI/ Selenium - BDD/Cucumber, Specflow, Data Validation/Kafka, BigData, also automation experience using Cypress.

• AWS/Cloud - Jenkins/ Gitlab/ EC2 machine, S3 and building Jenkins and CI/CD pipelines, SouceLabs.

• API/Rest API - Rest API and Micro Services using JSON, SoapUI

• Extensive experience in DevOps/Data Ops space.

• Strong experience in working with DevOps and build pipelines.

• Strong experience of AWS data services including Redshift, Glue, Kinesis, Kafka (MSK) and EMR/ Spark, Sage Maker etc

• Experience with technologies like Kubeflow, EKS, Docker

• Extensive experience using No SQL data and unstructured data experience like MongoDB, Cassandra, Redis, ZooKeeper.

• Extensive experience in Map reduce using tools like Hadoop, Hive, Pig, Kafka, S4, Map R.

• Experience using Jenkins and Gitlab

• Experience using both Waterfall and Agile methodologies.

• Experience in testing storage tools like S3, HDFS

• Experience with one or more industry-standard defect or Test Case management Tools

• Great communication skills (regularly interacts with cross functional team members)