Deutsche Bank | Jobs | Big Data Engineer – AVP | BigDataKB.com | 16-02-22

โ€”

by

Job Location: Pune

Job Title

Big Data Engineer – AVP

Division – RFT

Location – Pune

You will work as part of a cross-functional agile delivery team. You will bring an innovative approach to software development, focusing on using the latest technologies and practices, as part of a relentless focus on business value. You will be someone who sees engineering as team activity, with a predisposition to open code, open discussion and creating a supportive, collaborative environment. You will be ready to contribute to all stages of software delivery, from initial analysis right through to production support.

A strong technologist, self-starter, who is comfortable with independent engagement across functions such as Business Analysis, and Project Management, is expected.

Description

This role is for a developer with strong core application or system programming skills in Scala with good exposure to Spark and the broader Hadoop ecosystem. Risk, Finance & Treasury covers a variety of existing systems and green-field projects.

Key Responsibilities

  • Work with our clients to deliver value through the delivery of high-quality software within an agile development lifecycle.
  • Define and evolve the architecture of the components you are working on and contribute to architectural decisions at a department and bank-wide level.
  • Bring deep industry knowledge into the Squad Team to understand problems, leverage design patterns, automation to support a CI and CD pipeline to production and support emergent design within the agreed domain target architecture.
  • Contribute to the wider domain goals to ensure flow, consistent standards and approach to software development while designing to a common shared framework.
  • Work with the right and robust engineering practices.
  • Strong ability to articulate design ideas and collaborate across teams
  • Strong belief in continuous innovation โ€“ endeavor to incrementally improve existing systems through adoption of new tools and technologies.

Engineering Experience:

  • Strong experience in designing and developing distributed computing applications using Scala/Java & Apache Spark.
  • Experience in building streaming (near real time), and/or batch-oriented systems that integrate with various types of middleware solutions like Solace, Kafka.
  • Strong experience in tuning Hadoop applications to improve throughput and latency.
  • Strong experience in working with various Hadoop file system formats โ€“ Avro, Parquet, ORC and appropriate use cases.
  • Proven experience in delivering high volume, distributed computing applications all the way through to production.
  • Good working knowledge of JIRA / Defect Management tools
  • Good working Knowledge of modern, distributed version control systems such as Git.
  • Strong belief & understanding of agile testing practices such as test-driven development, behaviour driven development.
  • Working knowledge of testing tools relevant to the big data landscape, CI & CD pipelines for automated integration and deployment of code.

Technical Experience:

  • Strong programming experience in Scala will be preferred. Expert level Java programmers with basic understanding of functional programming will also be considered.
  • Strong knowledge of Spark APIs for processing large volumes of data
  • Strong knowledge of Spark SQL, DAGs, catalyst, join optimizations.
  • Experience in application-level compute resource management โ€“ pools, YARN queues.
  • Working knowledge of query engines such as Impala & Hive
  • Working knowledge of event streaming platforms such as Apache Kafka and brokers such as Solace or RabbitMQ
  • Working knowledge of unit testing and code coverage monitoring libraries such as scalatest or equivalent.
  • Foundational knowledge of all key Hadoop infrastructure components, and their deployment topology.
  • Continuous Integration & code quality management using TeamCity/Jenkins & Sonar.
  • Experience working as working with an agile delivery approach โ€“ ideally Scrum or LeSS
  • Strong experience in software development processes, models, lifecycles and methodologies

Desirable skills

  • Experience in building Real time event processing software using Spark streaming, Kafka or Flume.
  • Experience in migrating on prem, managed Hadoop applications to a public cloud platform such as GCP.
  • Experience in data analytics using python libraries.
  • Experience in open-source container orchestration systems such as Kubernetes.
  • Banking experience, particularly in Risk / Finance / Treasury

How weโ€™ll support you

  • Training and development to help you excel in your career
  • Flexible working to assist you balance your personal priorities
  • Coaching and support from experts in your team
  • A culture of continuous learning to aid progression
  • A range of flexible benefits that you can tailor to suit your needs

What weโ€™ll offer you

Please be aware there are regional differences to DB benefits and you will need to check the correct package per advert.

As part of our flexible scheme, here are just some of the benefits that youโ€™ll enjoy

  • Best in class leave policy
  • Gender neutral parental leaves
  • 100% reimbursement under childcare assistance benefit (gender neutral)
  • Flexible working arrangements
  • Sponsorship for Industry relevant certifications and education
  • Employee Assistance Program for you and your family members
  • Comprehensive Hospitalization Insurance for you and your dependents
  • Accident and Term life Insurance
  • Complementary Health screening for 35 yrs. and above

About us and our teams

https://www.db.com/company/company.htm

Our values define the working environment we strive to create โ€“ diverse, supportive and welcoming of different views. We embrace a culture reflecting a variety of perspectives, insights and backgrounds to drive innovation. We build talented and diverse teams to drive business results and encourage our people to develop to their full potential. Talk to us about flexible work arrangements and other initiatives we offer.

We promote good working relationships and encourage high standards of conduct and work performance. We welcome applications from talented people from all cultures, countries, races, genders, sexual orientations, disabilities, beliefs and generations and are committed to providing a working environment free from harassment, discrimination and retaliation.

Apply Here

Submit CV To All Data Science Job Consultants Across India For Free

๐Ÿ” Explore All Related ITSM Jobs Below! ๐Ÿš€ โœ… Select your preferred “Job Category” in the Job Category Filter ๐ŸŽฏ ๐Ÿ”Ž Hit “Search” to find matching jobs ๐Ÿ”ฅ โž• Click the “+” icon that appears just before the company name to see the Job Detail & Apply Link ๐Ÿ“๐Ÿ’ผ

Comments

Leave a Reply

Your email address will not be published. Required fields are marked *