AI/ML Platform Engineer
The Judge Group Inc.

Location: Concord, CA
Salary: $110.00 USD Hourly - $118.00 USD Hourly
Description: This is a highly specialized role with deep experience with High Performance Computing, Storage, Nvidia GPU Infrastructure compute grid, GenAI, LLM and MlOps. We are not looking for DevOps engineer, Data Scientist or Model Developer. Candidate needs to have experience with designing large and very complex Infrastructure Solutions with Nvidia GPU servers on-prem and on cloud. In this role, you will: • Lead and design the platform and infrastructure architecture for AIML and NLP in modern hybrid cloud computing. • Participate in day-to-day standups for infrastructure and platform scrums, provide architectural solutions for public and private cloud and resolve technical blockers for the team. • Collaborate and work very closely with the engineering strategy, platform engineering and development teams to understand the infrastructure requirements and drive all aspects of AIML and GENAI solution delivery to the cloud platforms. • Lead teams within DTI and across the enterprise in researching and proposing highly available, resilient and fault tolerant infrastructure solutions for AIML and GENAI workloads. • Define and drive infrastructure and platform roadmaps that align with technology and business strategy. Perform hardware and capacity planning, analysis, and forecasts for your portfolio of applications with focus on highest availability, scalability, performance, and timely delivery. • Provide SME guidance around infrastructure and platform for product and business partners. • Research industry best practices, evaluate new technologies, develop standards and engineering best practices and recommend innovative solutions that support automation and improve platform resiliency and fault tolerance of critical applications. Required Qualifications: • 7+ years of Engineering experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education. • 5+ years of experience in leading the design and implementation of grid/cluster computing infrastructure with CPU and GPUs supporting AIML and NLP workloads. • 5+ years of experience with Azure and/or GCP/GKE, as well as experience building complex infrastructure programmatically with IaC tools (Terraform/Ansible etc.) • 2+ years of experience designing solutions and working with high-performance storage technologies including Object Storage. • 2+ years of experience working and supporting network infrastructure for high throughput and low latency High performance (HPC) computing. • 2+ years of experience with Elastic Search • 2+ years of working with big data (Big Query) • Working knowledge and understanding of developing APIs using Python. • Excellent understanding and working knowledge of cloud computing concepts like Virtual Private Cloud (VPC), landing zone, Identity and Access Management (IAM), App Service Environment, Blueprints, Control Plane etc. • Excellent verbal, written, and interpersonal communication skills. Ability to articulate technical solutions to both technical and business audiences. • Recent and demonstrated ability to influence management on technical or business solutions. • Experience with CI/CD, DevOps concepts and SRE principles. Preferred Skills • 1+ years of experience in LLM, Generative AI (developing capabilities or dev/ops) • Experience in developing APIs on GCP/Azure/API Gateways • Experience with data processing technology (Apache Spark etc.) • Experience with data virtualization technology (Tibco DV, Dremio, etc.) • Understanding of Agile practices and ability to work with Agile teams to define and track user stories. • Experience with designing and implementing complex F5 or other Load Balancer Technologies • Knowledge and understanding of Cloud computing, PaaS design principles and micro services and k8s containers. • Cloud certifications K8s, GCP & Azure preferred.

Contact: hrauthan@judge.com

This job and many more are available through The Judge Group. Find us on the web at www.judge.com

This job has expired.