Senior Machine Learning Engineer - Foundation Model
@ XPENGSenior Machine Learning Engineer - Foundation Model
This job is still taking applications, but it's been up a while.
About the job
XPENG is a smart tech leader innovating in AI, autonomous driving, EVs, and robotics. The role focuses on developing foundation models that power XPENG's self-driving systems and advance transportation.
Requirements
- 3+ years deep learning experience
- Proficiency in PyTorch
- Large-scale pretraining experience
- Multi-modal modeling expertise
- Knowledge of distributed training
Qualifications
- Master's degree or higher in CS/EE
- Experience with autonomous driving models
- Research publication record
- Strong collaboration skills
- Understanding of reinforcement learning
Full job description
Key Responsibilities
- Design and implement large-scale multi-modal architectures (e.g., vision–language–action transformers) for end-to-end autonomous driving.
- Develop pretraining and fine-tuning strategies leveraging massive labeled and unlabeled fleet data (images, video, LiDAR, CAN bus, maps, human driving behaviors, etc.).
- Research and integrate cross-modal alignment (e.g., visual grounding, temporal reasoning, policy distillation, imitation and reinforcement learning) to improve model interpretability and action quality.
- Collaborate with infrastructure engineers to scale training across thousands of GPUs using distributed training frameworks (FSDP, DDP, etc.).
- Conduct systematic ablation, evaluation, and visualization of model behavior across perception, reasoning, and planning tasks.
- Contribute to model deployment optimization, including quantization, export, and latency–accuracy trade-offs for onboard execution.
Minimum Qualifications
- Master’s degree or higher in Computer Science, Electrical/Computer Engineering, or related field, with 3+ years of experience in deep learning research or productization.
- Strong proficiency in PyTorch and modern transformer-based model design.
- Experience in large-scale pretraining or multi-modal modeling (vision, language, or planning).
- Deep understanding of representation learning, temporal modeling, and self-supervised or reinforcement learning techniques.
- Familiarity with distributed training (DDP, FSDP) and large-batch optimization.
Preferred Qualifications
- PhD in CS/CE/EE or related field, with 1+ years of relevant industry experience.
- Publication record in top-tier AI conferences (CVPR, ICCV, NeurIPS, ICLR, ICML, ECCV).
- Prior experience building foundation or end-to-end driving models, or LLM/VLM architectures (e.g., ViT, Flamingo, BEVFormer, RT-2, or GRPO-style policies).
- Familiarity with RLHF/DPO/GRPO, trajectory prediction, or policy learning for control tasks.
- Proven ability to collaborate cross-functionally with infra, perception, and planning teams to deliver production-ready models.
- A collaborative, research-driven environment with access to massive real-world data and industry-scale compute.
- An opportunity to work with top-tier researchers and engineers advancing the frontier of foundation models for autonomous driving.
- Direct impact on the next generation of intelligent mobility systems.
- Opportunity to make significant impact on the transportation revolution by the means of advancing autonomous driving.
- Competitive compensation package.
- Snacks, lunches, dinners, and fun activities.
Similar jobs in Columbus, OH
- K
High School Intervention Specialist- Specialized Learning Classroom (cross-categorical)
KIPP · Columbus, OH, United States
Posted 2 weeks ago - E
Machining Technician
EDISON WELDING INSTITUTE INC · Columbus, OH 43221, United States
Posted 3 days ago - L
Senior Security Engineer
Leidos · Columbus, OH, United States
Posted 2 weeks ago - A
Senior Manufacturing Engineer, Altius
ANDURIL INDUSTRIES · Ashville, OH, United States
Posted 3 days ago - A
Senior Manufacturing Engineer, Barracuda
ANDURIL INDUSTRIES · Ashville, OH, United States
Posted 1 day ago - A
Label Machine Operator ***$500 Sign-On Bonus***
Avery Dennison · Lewis Center, OH 43035, United States
Posted 1 day ago