Experience Inc. Jobs

Microsoft’s Cloud Operations and Innovation (CO+I) team builds and operates Microsoft datacenters, which in turn power Microsoft’s cloud business. The CO+I Engineering team (CO+IE) delivers services, applications, and automation supporting datacenter planning, construction, and operation. We own a large portfolio of services, including workflows that enable predicable, lowest cost datacenter construction, telemetry systems that drive high availability and optimized energy usage, and task and performance management applications that help our operation run as efficiently as possible. CO+I Engineering is a competitive advantage for Microsoft, and an important pillar in its cloud success.

We are looking for a Senior Sotware Engineer for The Data Galaxy Engineering team which is responsible for building a scalable data platform that enables the ingestion of diverse data from tools and systems across Microsoft datacenters globally. By collaborating with engineering teams that own these tools and systems, we ensure the seamless integration and governance of the data. Our team creates centralized endpoints, allowing business stakeholders and engineering teams to access the data for valuable insights and downstream processing. In addition, we have developed a key data product that empowers business stakeholders to drive insights and make informed decisions that contribute to overall business success.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

In alignment with our Microsoft values, we are committed to cultivating an inclusive work environment for all employees to positively impact our culture every day.

Responsibilities

• Lead the development of key features from inception to full deployment, driving the entire lifecycle, from prototypes and proof-of-concepts to broad customer adoption.

• Develop software specifications and prototype solutions based on high-level feature requirements, ensuring alignment with business objectives.

• Utilize data and telemetry insights to continuously improve and propose new enhancements to existing features and products.

• Design and implement scalable data pipelines and cloud services, ensuring efficient processing, storage, and retrieval of large datasets from multiple sources.

• Architect and maintain cloud-based data lakes and warehouses, ensuring scalability, security, and alignment with business use cases.

• Lead efforts in federating data from Delta tables in ADLS Gen2, ensuring seamless integration into Kusto and SQL endpoints.

• Build and improve telemetry systems to monitor the health and performance of the data pipelines and products in both pre-release and production environments.

• Develop alert and monitoring systems for rapid detection and recovery from operational issues, ensuring high system availability.

• Collaborate closely with Microsoft product teams to align with new product functionalities and ensure seamless integration into the tools and platforms used.

• Collaborate across engineering teams to implement best practices and standards in software design and development.

• Translate business requirements into technical design and development tasks, ensuring clear communication and successful execution.

• Provide technical leadership to the engineering team, mentoring junior engineers and guiding new hires through the onboarding process.

• Strive to always deliver operational and engineering excellence in all aspects of development and deployment.

• Take ownership of technical direction and architectural decisions, balancing scalability, performance, and maintainability.

• Be part of an on-call rotation every 6 weeks to ensure system reliability and rapid response to operational issues.

• Understand and be able to support or redesign release and deployment pipelines using Azure DevOps for CI/CD, ensuring efficient and reliable delivery.

Qualifications

Required/ Minimum Qualifications:

• Bachelor's Degree in Computer Science, or related technical disciplineAND 4+ yearstechnical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or PythonoORequivalent experience.

• Hands-on experience with cloud services, particularly in Azure environments (e.g., Azure Data Lake, Azure Synapse, Kusto, Azure SQL), with the ability to design, build, and manage data solutions.

• 4+ years of experience in programming languages such as Python, SQL, and Spark for data processing and orchestration in distributed environments.

• 4+ years of experience with distributed computing systems for large-scale data processing, optimizing performance and managing costs.

Other Requirements:

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to, the following specialized security screenings: Microsoft Cloud Background Check. This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Preferred/ Additional Qualifications:

• Experience in designing and deploying cloud-native data solutions on Azure, with a focus on leveraging services such as Azure Data Factory, Azure Synapse Analytics, and Delta Lake for scalable data processing.

• Proficiency in performance tuning and optimization of data pipelines and distributed systems, with an emphasis on enhancing efficiency, minimizing latency, and reducing costs across large-scale environments.

• Extensive background in security and compliance for data platforms, ensuring adherence to enterprise-level governance policies and best practices in secure data access and storage.

• Experience working with cross-functional stakeholders, including Microsoft product teams and data governance, to translate business requirements into actionable technical designs.

• Knowledge of telemetry and monitoring best practices, with proven experience in building tools and systems to assess data pipeline health, optimize workflows, and provide actionable insights for continuous improvement.

• Knowledge of best practices in data governance and quality to ensure compliance with enterprise standards and secure data access.

• Experience in building and optimizing large-scale data pipelines, with a focus on data federation, transformation, and orchestration using Delta Lake and Spark.

Software Engineering IC4 - The typical base pay range for this role across the U.S. is USD $117,200 - $229,200 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $153,600 - $250,200 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay .

Microsoft will accept applications for the role until October 9, 2024.

#COICareers

#COIEngCareers

#COIE_CEcareers

Microsoft is an equal opportunity employer. Consistent with applicable law, all qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations (https://careers.microsoft.com/v2/global/en/accessibility.html) .