Data Engineer

Job Description
JOB SUMMARY:

Genesis Consulting has an immediate opportunity for an experienced Data Engineer to join our team and support a Federal Agency project centered around Data Management and Analytics. The ideal candidate will be responsible for designing, building, and maintaining data pipelines and ETL processes to ensure the efficient movement and transformation of data across cloud-based platforms. This role requires a strong technical background in data engineering and a passion for optimizing data workflows in a collaborative environment.

DUTIES AND RESPONSIBILITIES:

• Design and build robust data pipelines and ETL processes to support data ingestion, transformation, and integration from various sources into cloud-based data warehouses.

• Implement data validation, cleansing, and quality assurance processes to ensure the integrity and reliability of data for analytics and reporting purposes.

• Collaborate with data scientists and analysts to understand data requirements and deliver solutions that enhance analytical capabilities.

• Optimize data storage and processing solutions in AWS Cloud, utilizing services such as AWS Glue, Redshift, S3, and Apache Spark.

• Develop and maintain documentation for data workflows, data models, and architectural designs to ensure transparency and best practices in data engineering.

• Monitor and troubleshoot data pipeline performance, identifying and resolving issues to ensure continuous and reliable data operations.

• Stay current with emerging technologies and tools in data engineering and cloud computing to implement innovative solutions that meet business needs.

Requirements

MINIMUM QUALIFICATIONS/EXPERIENCE:

• Minimum of 5 years of experience in data engineering or related fields in a public sector or federal government setting, with a strong focus on ETL processes and data pipeline development.

• Proficiency in programming languages such as Python, SQL, and Scala, with practical experience in data processing frameworks.

• Hands-on experience with cloud platforms, specifically AWS, and tools like AWS Glue, Apache Spark, DataStage, and Redshift.

• Strong understanding of data governance and compliance standards, particularly in federal environments.

• Excellent analytical and problem-solving skills, with the ability to work independently and manage multiple priorities.

• Effective communication skills, with the ability to collaborate with technical and non-technical stakeholders.

MINIMUM EDUCATION:

Bachelor's degree in Computer Science, Information Technology, Data Science, or a related field

REQUIRED CERTIFICATIONS:

None Required

OTHER:

• U.S. Citizenship Required.

• Ability and willingness to obtain security clearance.