Microsoft | Jobs | SDE-II Spark | BigDataKB.com | 31-01-22

โ€”

by

Job Location: Bangalore

The Azure Big Data team in Microsoft, present exciting challenges in technologies such as big-data, cloud, distributed computing, artificial intelligence and storage. We build reliable, huge scale and high-performance distributed systems for big-data analytics on Azure. Azure Synapse is a limitless analytics service that brings together enterprise data warehousing and Big Data analytics. Azure HDInsight is one of the fastest growing Azure services that offers, popular open source technologies, such as Spark, Hadoop, Hive, Kafka, HBase with enterprise grade security and governance. We work very closely with the Apache community by both contributing new features to Open Source and adopting the latest from the community. Apart from the Open source components, the team also works on several proprietary massively distributed technologies at Exabyte scales.
If you are interested in extending the cutting edge of cloud-scale distributed systems, and building the next generation technologies, we would love to hear from you.


Responsibilities

As a Spark core engineer, you will work closely with experts in Open-source big-data technologies such as Apache Spark, Hadoop, Yarn and build containerized, highly scalable, faster performing enterprise ready big-data platforms on Microsoft Azure for supporting data warehousing, machine learning and analytics applications. This job will require you to build expertise on Spark Sql optimizer, workload optimization and distributed caching service.
Successful candidates will have excellent experience in one or more of these areas:
  • Delivering Cloud services in an engineering role.
  • Committing or contributing to any Open Source big data technologies.
  • Enterprise products design and implementation (Scala/Java/C++)
  • Distributed systems design and implementation.
  • Building cloud scale products with focus on efficiency, reliability and security.
  • Building relationships with customers and partners across geographies to understand business goals and technical requirements.
  • Owning the products and driving them end to end, all the way from gathering requirements, development, testing, deployment to ensuring high availability post deployment.
  • Contribute to the architecture & design of the products.
  • Helping evolve engineering practices & principles that marry the flexibility of open source and fast pace of service world.
  • Ensuring the consistency of designs of features and components for high availability, reliability, security and Scale.
  • Triaging issues and implementing solutions to restore service with minimal disruption to the customer and business. Perform root cause analysis, trend analysis and post-mortems.


Qualifications

Academics: B.E/ B.Tech or equivalent degrees in Computer Science (Masters is a plus).

Overall Experience: 2 – 8 years
Mandatory requirements:
  • Strong knowledge and working experience in Apache Spark, Hadoop, Yarn, Ambari, Zookeeper (Preferably Committer or PMC in any of these open-source technologies).
  • Strong knowledge of distributed file systems such as HDFS, Cloud object stores such as WASB, ABFS, S3.
  • Good experience in building and maintaining any distributed computing data platforms.
  • Clean coding habits with proficiency in Scala/Java/C++.
Big-plus if have:
  • Good coding experience in C++ and building distributed database systems.
  • Having experience in query optimizer and sql query operator implementation.
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request via the Accommodation request form.
Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.

https://bigdatakb.com/microsoft-hiring-sde-ii-spark-bigdatakb-com-28-jan-22/

Submit CV To All Data Science Job Consultants Across India For Free

๐Ÿ” Explore All Related ITSM Jobs Below! ๐Ÿš€ โœ… Select your preferred “Job Category” in the Job Category Filter ๐ŸŽฏ ๐Ÿ”Ž Hit “Search” to find matching jobs ๐Ÿ”ฅ โž• Click the “+” icon that appears just before the company name to see the Job Detail & Apply Link ๐Ÿ“๐Ÿ’ผ

Comments

Leave a Reply

Your email address will not be published. Required fields are marked *