Experience Inc. Jobs

The Search & Business Chat Analytics and Monitoring Team within the Substrate Intelligence Science Organization is at the forefront of ensuring monitoring and analytics for Business Chat Copilot for quality of responses, utilizing advanced LLM-powered metrics for active and passive monitoring as well as tracking metric movement to assess quality of business chat copilot. This role will be based in LATAM.

As a Senior Applied Scientist, you will be responsible for designing quality checks that evaluate Business Chat Copilot features across different flights, builds, and rings. Additionally, you will process and analyze vast amounts of customer traffic data from MDP, MSIT, and WW environments, producing valuable insights that will drive enhancements in product performance and user experience. You will directly influence the quality of Business Chat Copilot and impact teams across multiple regions.

Key qualifications include a deep understanding of LLMs, expertise in anomaly detection, and experience building and maintaining robust machine learning pipelines. Strong analytical thinking, problem-solving skills, and the ability to work in a collaborative, fast-paced environment are essential for success in this role.

Join us in shaping the future of business chat copilot.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Responsibilities

• You will build AI-driven monitoring solutions leveraging LLMs to generate content at scale for evaluation, ensuring insights are accurate and impactful.

• You will design and calibrate advanced quality metrics that improve the accuracy and efficiency of monitoring for large-scale applications.

• You are expected to apply anomaly detection techniques to identify performance issues and outages, ensuring the reliability and smooth operation of our systems.

• You will work with cross-functional teams, including product managers, data scientists, and engineers, to refine models and deliver actionable insights.

• You will learn cutting-edge LLM techniques and stay at the forefront of AI-driven monitoring and analytics for large-scale business applications.

Qualifications

Required Qualifications:

• Bachelor's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 4+ years related experience (e.g., statistics predictive analytics, research)

• OR Master's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 3+ years related experience (e.g., statistics, predictive analytics, research)

• OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 1+ year(s) related experience (e.g., statistics, predictive analytics, research)

• OR equivalent experience.

• 2+ years experience in software deployed in production.

Preferred Qualifications:

• Master's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 6+ years related experience (e.g., statistics, predictive analytics, research)

• OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 3+ years related experience (e.g., statistics, predictive analytics, research)

• OR equivalent experience.

#M365CORE #MSAI

Microsoft is an equal opportunity employer. Consistent with applicable law, all qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations (https://careers.microsoft.com/v2/global/en/accessibility.html) .