Experience Inc. Jobs

Job Information

Microsoft Corporation Senior Software Engineer - Spark Platform in Bangalore, India

The Azure Data team in Microsoft, builds and operates some of the world's largest Cloud computing services. The biggest of these clusters run on Apache YARN. The team has adopted and enhanced Apache YARN to run at Azure Scale with extremely high resource utilization and enterprise grade security. The team also focuses on enabling open-source software like Apache Spark, Hive, HBase, etc. on Microsoft Azure. We work very closely with the Apache community by both contributing new features to Open Source and at the same time adopting the latest from the community. Apart from the open-source components, the team also works on several proprietary massively distributed technologies at Exabyte scales.

We are highly collaborative, data-oriented, andgreatly valuediversity of thought and ideas. If you are interested in extending the cutting edge of cloud-scale distributed systems, and building the next generation technologies, we would love to hear from you.

As a developer on the Spark platform team, you will work closely with experts in Open-source big-data technologies such as Apache Spark, Hadoop, Yarn and build containerized, highly scalable, faster performing big-data platforms on Microsoft Azure for supporting data warehousing, machine learning and analytics applications. This job will require you to build expertise on cluster anatomy, container lifecycle management, performance optimizations and scalability aspects for Spark clusters.


  1. Building cloud scale products with focus on efficiency, reliability, and security.

  2. Building relationships with customers and partners across geographies to understand business goals and technical requirements.

  3. Owning the products and driving them end to end, all the way from gathering requirements, development, testing, deployment to ensuring high availability post deployment.

  4. Contribute to the architecture & design of the products.

  5. Helping evolve engineering practices & principles that marry the flexibility of open source and fast pace of service world.

  6. Ensuring the consistency of designs of features and components for high availability, reliability, security and scale.

Triaging issues and implementing solutions to restore service with minimal disruption to the customer and business. Perform root cause analysis, trend analysis and post-mortems


Academics : B.E/ B.Tech or equivalent degrees in Computer Science (Masters is a plus).

Experience : 8+ years

Successful candidates will have excellent experience in one or more of these areas:

  1. Computer Science fundamentals in object-oriented design and Data structures.

  2. Computer Science fundamentals in algorithm design, problem solving, and complexity analysis

  3. Delivering Cloud services in an engineering role


  1. Committing or contributing to any Open Source big data technologies

  2. Enterprise products design and implementation (Java/C#/C++)

  3. Distributed systems design and implementationWorking experience on any of the below technologies will be an added advantage:

  4. Apache SPARK/Jupyter/Zepppelin

  5. Apache Hadoop (HDFS/MR)

  6. Apache YARN/Hive/HBase

  7. Docker or Kubernetes

  8. Microsoft Azure Services (any)

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request via the Accommodation request form (https://careers.microsoft.com/us/en/accommodationrequest) .

Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.