Data Engineer with Security Clearance

Data Engineer
Location: Reston, VA About the Role:
An opportunity with a mission-critical IC Sponsor for a Data Engineer position. The
Sponsor organization plays a significant role in delivering highly optimized, mission-ready data
conditioning and delivery systems supporting mission analytics. A Full-Scope Polygraph is
required - no exceptions. Responsibilities: Design and develop complex new software products or significantly enhance existing software Build modular, reusable services and features within a modern service-oriented architecture Work independently with minimal supervision in an Agile team environment Deploy and maintain Apache NiFi clusters Develop ETL (Extract, Transform, Load) processes for mission-critical data systems Create and maintain Ansible playbooks and roles for software-driven deployment of NiFi and Zookeeper clusters Use AWS EC2 instances for infrastructure needs Develop dashboard visualizations in Kibana based on data from Elasticsearch Integrate and interact with RESTful services via REST APIs Requirements: Active Full-Scope Polygraph Expertise with Apache NiFi and equivalent IC technologies General understanding and ability to work with Zookeeper Expert-level experience developing ETL processes 5+ years of experience with scripting languages such as Bash, Python, and Groovy Experience using AWS EC2 instances 2-5 years' experience with Ansible for automated deployments Familiarity with Git and GitLab 2-5 years' experience calling RESTful services using REST APIs Working knowledge of Linux (especially the Rocky Linux variant) Familiarity with Elasticsearch and Kibana