
AI Infrastructure Engineer – Training Framework Optimization
About this role
Job Description: AI Infrastructure Engineer – Training Framework Optimization
Job Function Summary
We are seeking an AI Infrastructure Engineer to optimize large-scale model training efficiency and high-throughput data pipelines. You will profile GPU bottlenecks, optimize multi-GPU distributed communication, and build scalable data loaders to support our deep learning research at scale.
Principal Responsibilities
· Optimize end-to-end model training throughput and hardware utilization across large-scale GPU clusters.
· Maintain and optimize high-performance, low-latency Data Loaders.
Qualifications/Skills Required
· Strong Python programming skills.
· Deep familiarity with PyTorch internals.
· Solid understanding of GPU architecture, including CUDA kernels, streams, events, and contexts.
· Proficient in using profiling tools to identify and resolve model compute, memory, and communication bottlenecks.
· Strong understanding of multi-GPU distributed communication principles and optimization techniques.
· Familiarity with static graph compilation technologies (e.g., torch.compile, XLA, TensorRT).
· Ability to architect and scale high-throughput Data Loaders utilizing asynchronous I/O and concurrency techniques.
Preferred Qualifications
· Familiarity with common model architectures (such as Attention mechanisms) and the ability to collaborate with researchers on co-designing more efficient model structures.
· Hands-on experience with mixed-precision training, model quantization, and convergence/accuracy alignment techniques.
More roles at Millennium
- Quantitative Researcher – AI Algorithm Specialist (Predictive Modeling & Analysis) — Hong Kong · ML · Mid-Senior
- Senior C++ Quantitative Developer — Hong Kong · Dev · Mid-Senior
- Quantitative Researcher – Portfolio Construction — Hong Kong · Quant · Mid-Senior
- Quantitative Researcher – Machine Learning Specialist — Hong Kong · ML · Mid-Senior
- Quantitative Researcher – AI Algorithm Specialist (Model Experimentation & Optimization) — Hong Kong · ML · Mid-Senior
- Quantitative Researcher – Alpha Research — Hong Kong · Quant · Mid-Senior
The Wall Street Quants is an independent job board and is not affiliated with, endorsed by, or sponsored by Millennium or any of the firms listed on this site. All company names, logos, and trademarks are the property of their respective owners and are used for identification purposes only.