High Performance Computing (HPC) AI Engineer
Back to Jobs
NYU Langone HealthGet Smart Job AI Coach in the appFree on iOS and Android

High Performance Computing (HPC) AI Engineer
101,493–140,000 / Year
Location
New York, NY
Experience
Mid
Posted
Jul 10, 2026
Apply by
August 9, 2026
Applicants
0
Early applicantFull-timeWork from Office
Job Description
IT/Health IT/Informatics
New York, NY
•
ID:
1162513_RR00120940
•
Full-Time/Regular
NYU Grossman School of Medicine is one of the nation's top-ranked medical schools. For 175 years, NYU Grossman School of Medicine has trained thousands of physicians and scientists who have helped to shape the course of medical history and enrich the lives of countless people. An integral part of NYU Langone Health, the Grossman School of Medicine at its core is committed to improving the human condition through medical education, scientific research, and direct patient care. At NYU Langone Health, equity and inclusion are fundamental values. We strive to be a place where our exceptionally talented faculty, staff, and students of all identities can thrive. We embrace inclusion and individual skills, ideas, and knowledge.
For more information, go to med.nyu.edu, and interact with us on LinkedIn, Glassdoor, Indeed, Facebook, Twitter and Instagram.
Position Summary:
We have an exciting opportunity to join our team as a High Performance Computing (HPC) AI Engineer.
The High Performance Computing (HPC) AI Engineer will leverage technical expertise to bridge the gap between traditional high-performance computing and modern artificial intelligence workloads. Reporting to the Director of the NYULH HPC Facility, this role is critical to supporting the computational needs of world-class researchers in both clinical and basic science at NYU Langone Health (NYULH). The AI Engineer will focus on managing HPC development tools, optimizing AI applications, and seamlessly integrating AI frameworks with our broader computing infrastructure, including the UltraViolet supercomputer and our specialized GPU clusters.
Job Responsibilities:
Deploy, manage, and optimize HPC development tools and software stacks tailored for machine learning, deep learning, and data science workloads.
Lead the integration of HPC systems with enterprise AI frameworks and manage scalable AI model hosting and serving environments.
Benchmark, troubleshoot, and optimize AI application performance across our hardware infrastructure, ensuring efficient utilization of computational resources.
Develop and deliver specialized training sessions, tutorials, and workshops on AI model development, deployment, and optimization within an HPC environment.
Create and maintain comprehensive technical documentation, user guides, and best practices for AI development workflows and tools.
Collaborate with scientists, principal investigators, and software engineers to deploy customized, scalable AI solutions for complex research challenges.
Monitor AI job queues and system performance within resource management and scheduling systems to ensure equitable resource distribution.
Consult with researchers to assess AI computational needs, assisting with project execution, pipeline optimization, and resource planning.
Minimum Qualifications:
To qualify you must have a Bachelors Degree Required.
5 Years of relevant experience.
Demonstrated understanding of parallel storage engineering and systems administration
Advanced skills with large-scale parallel file systems and storage tiering
Experience with SMB and NFS network storage protocols
Experience with Linux/UNIX operating systems and bash scripting
Extensive knowledge of ethernet, Infiniband, and fiber channel networking
Experience with scripting languages such as Bash, Python, or Lua
Preferred Qualifications:
- Experience supporting AI-driven research computing in biomedical, life sciences, or clinical environments.
- Familiarity with Large Language Models (LLMs), fine-tuning techniques, and Retrieval- Augmented Generation (RAG) pipelines.
- Knowledge of security best practices, including the handling of Protected Health Information (PHI) when training or hosting models.
Qualified candidates must be able to effectively communicate with all levels of the organization.
NYU Grossman School of Medicine provides its staff with far more than just a place to work. Rather, we are an institution you can be proud of, an institution where you'll feel good about devoting your time and your talents. At NYU Langone Health, we are committed to supporting our workforce and their loved ones with a comprehensive benefits and wellness package. Our offerings provide a robust support system for any stage of life, whether it's developing your career, starting a family, or saving for retirement. The support employees receive goes beyond a standard benefit offering, where employees have access to financial security benefits, a generous time-off program and employee resources groups for peer support. Additionally, all employees have access to our holistic employee wellness program, which focuses on seven key areas of well-being: physical, mental, nutritional, sleep, social, financial, and preventive care. The benefits and wellness package is designed to allow you to focus on what truly matters. Join us and experience the extensive resources and services designed to enhance your overall quality of life for you and your family.
NYU Grossman School of Medicine is an equal opportunity employer and committed to inclusion in all aspects of recruiting and employment. All qualified individuals are encouraged to apply and will receive consideration. We require applications to be completed online.
View Know Your Rights: Workplace discrimination is illegal.
NYU Langone Health provides a salary range to comply with the New York state Law on Salary Transparency in Job Advertisements. The salary range for the role is $101,493.51 - $140,000.00 Annually. Actual salaries depend on a variety of factors, including experience, specialty, education, and hospital need. The salary range or contractual rate listed does not include bonuses/incentive, differential pay or other forms of compensation or benefits.
To view the Pay Transparency Notice, please click here
Key Responsibilities
- Deploy, manage, and optimize HPC development tools and software stacks for machine learning and deep learning workloads.
- Lead integration of HPC systems with enterprise AI frameworks and manage scalable AI model hosting environments.
- Benchmark, troubleshoot, and optimize AI application performance across hardware infrastructure.
- Develop and deliver training sessions and workshops on AI model development and optimization within an HPC environment.
- Create and maintain technical documentation, user guides, and best practices for AI development workflows.
- Collaborate with scientists and engineers to deploy customized, scalable AI solutions for research challenges.
- Monitor AI job queues and system performance to ensure equitable resource distribution.
- Consult with researchers to assess AI computational needs and assist with project execution and pipeline optimization.
Requirements
- Bachelor's degree
Skills Required
Parallel storage engineeringSystems administrationLarge-scale parallel file systemsStorage tieringSMB network storage protocolsNFS network storage protocolsLinux/UNIX operating systemsBash scriptingEthernet networkingInfiniband networkingFiber channel networkingPythonLuaCommunicationLarge Language Models (LLMs)Fine-tuning techniquesRetrieval-Augmented Generation (RAG) pipelinesSecurity best practicesProtected Health Information (PHI) handling
Benefits
- Financial security benefits
- Generous time-off program
- Employee resources groups
- Holistic employee wellness program
- Physical, mental, nutritional, sleep, social, financial, and preventive care support
App exclusive · Free
Smart Job AI Coach
Your personal interview coach on every job — readiness tips, profile improvements, and role-specific prep. Available only in the Pulse Job app.
Interview readiness
See how prepared you are and what to improve for each role.
Personalized tips
Actionable suggestions based on your profile and the job.
After you apply
Keep coaching momentum from job detail through application success.
Similar roles for you
Matched using this role's title and skills. Open the job search anytime to see every listing.
Gen AI / Data Science Engineer
L&t Technology Services
₹14,00,000–₹24,00,000 / Year
Full-timeEasy applyWork from Office
Bellary Rd
AI Platform Engineer
Diligent Tec, Inc.
$130,000–$175,000 / Year
Full-timeEasy applyWork from Home
Remote1 applicant
AI Safety & Evaluation Engineer
Diligent Tec, Inc.
$130,000–$170,000 / Year
Full-timeEasy applyWork from Home
Remote1 applicant
AI Engineer
Apptad Inc
$130,000–$170,000 / Year
Full-timeEasy applyWork from Office
Frisco
Full Stack Developer
The Judge Group
$65–$90 / Hour
ContractEasy applyHybrid
Malvern
Data Engineer
L&t Technology Services
₹12,00,000–₹20,00,000 / Year
Full-timeEasy applyWork from Office
Bellary Rd