This job posting has expired

Expired on April 10, 2026

DevOps Engineer-Mid

LinuxKVMGPULLMDockerCUDAvLLMTensorRT-LLMTriton Inference ServerPostgreSQLVector databasesAnsibleKubernetesCI/CD

Job Description

Responsibility: Lead deployment and configuration of on-prem Linux-based platforms for AI workloads; Design and configure KVM virtualization; Architect and implement GPU-enabled environments for production LLM inference; Deploy and operate containerized LLM serving stacks in production; Design and validate GPU utilization, isolation, and health monitoring; Integrate deployments with CI/CD pipelines and security controls; Apply security hardening, RBAC, encryption, and audit-ready configurations; Design HA and DR strategies; Lead troubleshooting, performance tuning, and stabilization.

Responsibilities

  • Lead deployment and configuration of on-prem Linux-based platforms
  • Design and configure KVM virtualization
  • Architect and implement GPU-enabled environments for production LLM inference
  • Deploy and operate containerized LLM serving stacks
  • Design and validate GPU utilization and monitoring
  • Integrate deployments with CI/CD pipelines
  • Design HA and DR strategies

Qualifications

  • 5+ years of experience in DevOps, Platform Engineering, or Infrastructure Engineering roles
  • Strong Linux system administration skills
  • Experience deploying and operating LLMs in production
  • Experience managing GPU infrastructure

Job Information

Posted

February 9, 2026

Experience Level

mid level

Status

Expired