Data Integration Engineer

Mc Lean, Virginia

Marathon TS
Job Expired - Click here to search for similar jobs
Maraton TS

Data Integration Engineer - TS/SCI

Defense Intelligence Agency (DIA)

Marathon TS is seeking our next TS/SCI cleared Data Integration Engineer supporting the National Media Exploitation Center (NMEC) under our 10-year DOMEX Technology Platform (DTP) contract. Have impact as part of a mission focused, solutions oriented, and adaptive team that values innovation, collaboration, and professional development. Your job will be to design, implement, maintain, and monitor data pipelines, both in support of R&D prototypes and production pipelines. You succeed through effective cross functional collaboration in areas such as, but not limited to, development, product, and QA in a dynamic and fast paced environment. While most work is conducted on-site at our client location in Bethesda, MD, we offer a flexible schedule and, some unclassified development tasks may be performed remotely. Percentage of remote work will vary based on client requirements/deliverables. Come join our award-winning organization and work with some of the most talented and brightest minds in the GovCon industry.

Location:

Bethesda, MD (Hybrid)

Security Clearance:

Secret

Responsibilities

Perform Database builds, installs, configuration, administration, and troubleshooting of database systems (e.g., MariaDB/MySQL, Postgres, Elasticsearch, Qdrant, Milvus, etc.)

Ensure data integrity by performing employing data engineering best practices

Maintain database and data pipeline documentation, data dictionaries, and system diagrams

Minimum Requirement

Bachelor's Degree and 12+ years of prior relevant experience or Masters with 10+ years of prior relevant experience

Experience with SQL, NoSQL, and vector databases such as MSSQL, MySQL, PostgreSQL, Redis, FAISS, Milvus, Qdrant, etc.

Experience designing and maintaining ETL and ELT pipelines with technologies such as Spark, Airflow, Dagster, Prefect, Argocd, Metaflow, Kubeflow, etc.

Experience with DevOps / MLOps, using CI/CD methodology with data pipelines, and cloud-native deployment paradigms

Must possess an active Secret clearance and the ability to obtain and maintain a TS/SCI with Polygraph

Experience with database design, implementation, maintenance, monitoring, performance tuning, and optimization.

Expertise in data profiling techniques and understanding the content from both a data quality and business perspective

Experience with data quality and accuracy evaluation techniques

Experience with Agile practices

Development experience with Python

Experience on data model development, modification and migration, and maintenance

Strong verbal and written communication skills

Enthusiastic with the ability to work well on a team and a self-starter who can work independently.

Preferred Qualification

An active TS/SCI clearance

Experience supporting data teams and data scientists

Experience on a production/ enterprise system

Experience in air-gapped environments

Application development and deployment in an AWS environment

AWS certifications

Marathon TS is committed to the development of a creative, diverse and inclusive work environment. In order to provide equal employment and advancement opportunities to all individuals, employment decisions at Marathon TS will be based on merit, qualifications, and abilities. Marathon TS does not discriminate against any person because of race, color, creed, religion, sex, national origin, disability, age or any other characteristic protected by law (referred to as "protected status").

Date Posted: 20 May 2024
Job Expired - Click here to search for similar jobs