AI Systems Engineer - Active Top Secret Required with Security Clearance

We are seeking a highly skilled, self-motivated, and resourceful AI Systems Engineer to spearhead the design and deployment of AI capabilities supporting the highest levels of government. This is a unique opportunity to build and manage a complete AI team, vision, infrastructure, and suite of capabilities from the ground up. This role demands a deep understanding of hardware, data engineering, software engineering, containerization, and system administration, coupled with a proactive and problem-solving mindset. Seize your opportunity to fulfill our AI systems engineering requirements across our set of managed services and processes. With GDIT, you will gain unmatched experience within our fast-paced environment along with extensive options for further training, certification, and career advancement. How an AI Systems Engineer will make an Impact: Identify and recommend optimal hardware infrastructure (compute, storage, networking) required to support inference workloads within a self-hosted, offline environment.
Implement the integration of AI-specific hardware (e.g., GPUs and servers) within our existing Kubernetes clusters. Configure and optimize Kubernetes for AI workloads.
Research, deploy, and manage suitable engines for large language models and other AI models. Optimize these engines for performance and efficiency.
Evaluate and select open-weight models based on accuracy, performance, consistency, and unbiased responses.
Implement prompt engineering concepts to provide optimal output and the best user experience.
Develop Extract, Transform, Load (ETL) pipelines of structured and unstructured data from a verity of disparate sources.
Properly format, chunk, and embed documents into vector databases for advanced search and Retrieval Augmented Generation (RAG) capabilities.
Implement and manage appropriate database solutions for storing and retrieving data relevant to the AI applications. Ensure data integrity, security, and performance.
Maintain and troubleshoot the underlying Linux operating systems powering the AI infrastructure. Ensure system stability, security, and performance.
Configure on-prem S3-compatible storage solutions for storing datasets, models, and other AI-related artifacts.
Implement and maintain stringent security measures to protect the AI infrastructure and data within the environment. Adhere to internal compliance requirements.
Contribute to engineering of software that interacts with our internal models and other data platforms.
Proactively monitor the AI infrastructure, diagnose and resolve issues, and provide support to internal users of the AI capabilities.
Create comprehensive documentation for the infrastructure, deployment processes, and operational procedures.
Stay up to date with the latest advancements in hardware, software, and best practices, and adapt them for our unique environment. What You'll need to Succeed: Experience with containerization technologies, particularly Kubernetes, including hardware integration (e.g., GPU nodes).
Strong understanding of AI/ML concepts and experience deploying and managing inference engines.
Experience in designing and implementing data pipelines using relevant tools and technologies.
Software engineering/development experience.
Proficiency in database management.
Proficiency in Linux system administration, including scripting and automation.
Experience with configuring and managing S3-compatible storage solutions.
Excellent problem-solving and troubleshooting skills, with the ability to work independently in a challenging environment.
Strong understanding of security best practices for isolated environments.
Excellent communication and documentation skills.
Education: BS in Computer Engineering, Computer Science or related technology field. Experience may be substituted for education.
Required Experience: 10+ years
Required Technical Skills: DoD 8140/8570 IAT III compliance
Security Clearance Level: Active Top Secret
Location: Washington, District of Columbia; limited telework may be available GDIT Is Your Place: 401K with company match
Comprehensive health and wellness packages
Internal mobility team dedicated to helping you own your career
Professional growth opportunities including paid education and certifications
Cutting-edge technology you can learn from
Rest and recharge with paid vacation and holidays Work Requirements