Experience Inc. Jobs

Job Information

Nvidia Senior Product Manager, LLMOps – Synthetic Data Generation in Remote, California

We are looking for a Senior Product Manager to lead high-impact, high-visibility Synthetic Data Generation (SDG) microservice of the NeMo Microservices Platform for generative AI and large language models (LLMs). You will turn a newly announced Nemotron-4 340B model into an easy-to-use enterprise-grade SDG product portfolio consisting of SDG NIMs, reference SDG workflows and tools that can help enterprises unlock new use cases and shorten time-to-market with the help of high-quality synthetic data for pre-training foundation models, model alignment, and model evaluation. You will further expand the portfolio by building an ecosystem of model providers and finding cross-company alliances around data, models, and algorithms.

The NeMo SDG microservice is at the core of NVIDIA AI Foundry strategy as announced at GTC 2023 and further extended in July 2024 – we enable thousands of organizations to train and deploy their own custom LLMs for a wide variety of domains and scenarios by packaging innovative research into scalable, reproducible, reliable, portable data pipelines and NIMs. The Enterprise Products Group is a strong and sought after group both inside and outside of NVIDIA driving the company's generative AI strategy. We need a self-starter with the rare blend of technical and product skills around groundbreaking technology. If this fits, we would love to learn more about you!

What you'll be doing:

  • Define and drive the product vision, positioning, metrics, and execution strategy.

  • Collect and prioritize requirements from internal teams and enterprise customers.

  • Drive product adoption, continuously measure product usage and improve it based on customer feedback via log analytics, interviews, surveys, NPS, among others.

  • Drive product launches, collaborate on release assets with Product Marketing.

  • Coordinate with TPMs to align roadmaps and respond to market trends.

  • Work with the internal Data Factory team to optimize the cost, latency, throughput and quality of human-in-the-loop workflows that are needed to bootstrap SDG.

  • Engage with Data Strategy team to make sure that SDG solves for internal and external LLM training and evaluation needs.

  • Craft comprehensive product and software requirements. and focus on scalability and diverse data needs, including SDG for multimodal LLMs.

What we need to see:

  • MBA or BS/MS in Computer Science, Electrical Engineering, Operations or equivalent experience.

  • 12+ years of experience in product management at a technology company, co-founder or related technical role in a startup or equivalent experience.

  • 3+ years of experience building and shipping AI/ML solutions for enterprises.

  • Deep focus (2+ years) iterating on an AI product or service with high accuracy KPIs.

  • Teamwork and influencing skills to successfully navigate in a highly matrixed environment. At NVIDIA, your entire company is on your team!

  • Positive energy, attention for detail, drive for high-performance and personal growth, and deep care for customers to build products people love.

  • Pragmatic and data-driven project management skills to navigate the software development lifecycle, including prioritization of diverse customer requirements and product releases while delivering high quality software on time and with a lean team.

  • Strong time management skills and personal flexibility – very organized with the ability to multitask and prioritize, switch context between strategy and focused execution.

Ways to stand out from the crowd:

  • Knowledge of the latest trends around LLMs and Generative AI, Responsible AI, MLOps.

  • PhD in Computer Science, Human Computer Interaction, or equivalent.

  • Innovative leadership, resulting in first-of-kind products, patents, process improvements, business efficiency, and return on investment. We aim to redefine the state-of-the-art.

  • Key role in the development of an AI/MLOps platform and understanding of the entire AI lifecycle from data ingestion to inference and everything in-between.

  • Experience working on a frontier/specialized GenAI/LLM model and working knowledge of the data requirements for pre-training, alignment, fine-tuning, and evaluation.

NVIDIA is widely considered one of the technology world's most desirable employers. We have some of the most hardworking people in the world working with us. If you are agile and autonomous, we want to hear from you.

The base salary range is 204,000 USD - 310,500 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits (https://www.nvidia.com/en-us/benefits/) . NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

DirectEmployers