Principal Software Engineer, Perception Architect

@ Zoox

Principal Software Engineer, Perception Architect

Posted 3 months ago

This job is still taking applications, but it's been up a while.

About the job

We develop autonomous products with cutting-edge sensing and perception tech. The role focuses on designing end-to-end perception architecture and leading cross-functional teams.

Requirements

8+ years in autonomous systems
Experience in perception system architecture
Mastery of Computer Vision
Proficiency in C++ and Python
Hardware acceleration expertise

Qualifications

Ph.D
or MS in related field
Deep knowledge of sensor modalities
Strong math foundation
Leadership experience

Full job description

Be the visionary Perception Architect designing the sensory "nervous system" for our next generation of autonomous products. Evolve our end-to-end perception architecture, serving as the essential liaison between Sensing teams and the core ML system. Drive architectural evolution toward next-generation sensing and compute platforms by influencing Hardware-Software Co-Design.

In this role, you will:

System Synthesis: Define the end-to-end perception architecture—assess new sensing (LiDAR, Radar, Camera) to the final fused world model.

Hardware-Software Co-Design: Partner with Compute and Sensing teams to influence the design, ensuring our algorithms have the "computational oxygen" they need.

Algorithmic Strategy: Lead the transition from current pipelines to AI innovation pipelines, while maintaining the safety and interpretability required for edge deployment.

Future-Proofing: Evaluate emerging technologies and determine their viability for the 3-5 year roadmap.

Performance Budgeting: Collaborate on rigorous metrics for latency and accuracy across diverse edge-computing environments.

Lead cross functional teams: to create a viable plan to move to new platforms and unlock further technical capabilities for Perception systems. Coordinate projects across partner teams to make sure work is aligned with the overall org direction.

Qualifications

Education: Ph.D. or MS in Computer Science, Robotics, Electrical Engineering, or a related field with a focus on Computer Vision.

Experience: 8+ years in autonomous systems with at least 2 years in an architectural role, shipping and evolving perception systems

Deep Domain Expertise: Mastery of systems focused on Computer Vision, Deep learning, Foundational models, Sensor Fusion, and State Estimation (SLAM, EKF/UKF). Deep understanding of sensor modalities and their impact to perception/autonomy systems, including: Camera, lidar, radar.

Platform Proficiency: Deep understanding of hardware acceleration, component budgeting and transition to new platforms.

Mathematical Rigor: Strong foundation in 3D geometry, linear algebra, and probabilistic robotics.

Hands on Skills: Proficiency in C++ (production-grade) and Python (rapid prototyping). Ability to run experiments across system components and run metrics platforms.

Soft Skills: Curious, Data driven, with ability to translate complex technical trade-offs to non-technical stakeholders and executive leadership.

Show full description