Software Engineer
$160k- $230k

Location: Annapolis Junction, MD
Clearance Required: TS/SCI with Polygraph
Experience Level: 7+ years of experience
Education: Bachelor's degree in Computer Science, Engineering, or related field

Position Summary:
We are seeking a skilled and mission-driven Software Engineer to support the ML Frameworks team. In this role, you will contribute to the design, development, and deployment of a Retrieval-Augmented Generation (RAG) solution within a high-performance computing (HPC) Linux environment. This position is ideal for someone with a strong Linux background and a passion for AI/ML technologies, especially Large Language Models (LLMs) and secure AI systems.
Primary Responsibilities:

• Contribute to the development and deployment of secure RAG pipelines in an HPC Linux environment
• Work with cutting-edge AI/ML technologies, including LLM orchestration frameworks, embedding models, and inference platforms
• Develop and maintain services using Python and Golang
• Build and manage containerized services using Docker, Podman, and containerd
• Deploy services using orchestration tools like Kubernetes and Docker Compose
• Automate and monitor workflows with CI/CD pipelines, using GitLab CI and version control with Git
• Integrate monitoring tools such as Prometheus and Grafana for performance and reliability
• Participate in system administration, including Linux CLI, shell scripting, and general support tasks

Required Qualifications:

• Active TS/SCI clearance with Polygraph
• Bachelor’s degree in Computer Science, Engineering, or a related technical field
• 7+ years of professional software engineering experience
• Strong experience with Linux system administration, CLI, and shell scripting
• Proficiency in Python and Golang
• Familiarity with RAG pipelines, LLMs, and knowledge retrieval systems
• Experience with containerization technologies and orchestration tools (Docker, PodMan, Kubernetes, Docker Compose)
• Solid understanding of CI/CD principles and related tools (GitLab CI)
• Experience with metrics and monitoring tools (e.g., Prometheus, Grafana)
• Experience using Git for version control

Desired Skills & Technologies:

• Experience with GPU-enabled applications and debugging tools
• Familiarity with LLM orchestration frameworks and OpenAPI
• Experience with distributed processing frameworks such as Spark, Dask, or Ray
• Familiarity with SQL, Elasticsearch, and vector databases
• Experience with HTMX or Hyperscript
• Understanding of multi-node, multi-GPU AI training environments
• Knowledge of AI inferencing platforms such as Nvidia NIM/TRITON, vLLM, or Ray-based deployment
• Experience with the Atlassian suite (Confluence, Jira)

Our client offers a highly competitive and comprehensive benefits package designed to support your personal and professional growth, while promoting a healthy work-life balance. Benefits include:

• 100% Employer-Paid Health, Dental, and Vision Insurance – Full coverage for employees

• Zero Vesting 401(k) Plan with 10% Company Contribution – Immediate access to all contributions

• 31 Days of Paid Time Off – Includes vacation, personal time, and all federal holidays

• Student Loan Repayment Assistance – Helping you pay down your educational debt

• Unlimited Certification & Training Support – Invest in your professional development

• Flexible Work Environment – Remote work options and flexible scheduling available

• Multiple Incentive Bonuses – Performance-based rewards throughout the year

• Exclusive Company Memberships – Access to curated memberships and employee perks

This package reflects our client’s commitment to empowering their employees with meaningful benefits and recognizing outstanding performance.
 

We are an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, disability, veteran status, or any other protected status under applicable law.

https://www.staffed4u.com/