Senior Technical Product Manager Token Factory - Inference (remote - US) - Remote Eligible

Senior Technical Product Manager – Token Factory Inference

This position is posted by Jobgether on behalf of a partner company. We are currently looking for a Senior Technical Product Manager – Token Factory Inference in United States. This role offers the opportunity to lead the definition, development, and delivery of highly scalable machine learning inference capabilities, focusing on production-grade systems used at scale. You will own the product roadmap for the inference platform, driving decisions that balance performance, reliability, and real-world customer needs. Working closely with engineering, research, and customer-facing teams, you will translate complex technical workflows into actionable product requirements and features. The position combines technical depth with product vision, ensuring infrastructure and tooling deliver robust, high-throughput ML inference solutions. This role is remote within the U.S. and ideal for professionals passionate about AI/ML, cloud infrastructure, and shaping the future of inference at scale.

Accountabilities:

• Own and drive the product roadmap for inference capabilities, focusing on distributed, high-throughput ML systems.
• Collaborate with engineering and research teams to design scalable real-time and batch inference infrastructure.
• Act as the technical voice in customer engagements, translating ML workflows into actionable product requirements.
• Support customer PoCs involving model deployment, inference orchestration, and optimization.
• Deliver intuitive tools and robust infrastructure that improve latency, throughput, orchestration, and deployment efficiency.
• Guide product adoption by ensuring solutions meet real-world inference challenges and scale effectively.