Job Location: New York, NY
Hadoop Platform Engineer
New York, NY
As a Barclays Hadoop Platform Engineer based in New York you will be working closely with Markets Data Science Technology, to build and support a data science platform. You will be providing the tools and frameworks for quants and analysts across multiple business groups and multiple asset classes to perform quantitate analytics and build machine learning models. This role is for a platform engineer/Hadoop engineer/administrator who will design and develop the Markets Data Science platform using Cloudera Hadoop, variety of databases, and other technologies.
Barclays is one of the world’s largest and most respected financial institutions, with 329 years of success, quality and innovation behind us. We’ve helped millions of individuals and businesses thrive, creating financial and digital solutions that the world now takes for granted. An important and growing presence in the USA, we offer careers providing endless opportunity.
Working Flexibly
We’re committed to providing a supportive and inclusive culture and environment for you to work in. This environment recognizes and supports ways to balance your personal needs, alongside the professional needs of our business. Providing the opportunity for all our employees, globally to work flexibly empowers each of us to work in a way that suits our lives as well as enabling us to better service our customers’ and clients’ needs. Whether you have family commitments or you’re a career, or whether you need study time or wish to pursue personal interests, our approach to working flexibly is designed to help you balance your life.
We are currently in the early stages of implementing a hybrid working environment, which means that many colleagues spend part of their working hours at home and part in the office, depending on the nature of the role they are in. We’re flexible on how this works and it may continue to change and evolve. Depending on your team, typically this means that colleagues spend a minimum of between 20% to 60% of their time in the office, which could be over a week, a month or a quarter. However, some colleagues may choose to spend more time in the office over a typical period than their role type requires. We also have a flexible working process where, subject to business needs, all colleagues globally are able to request work patterns to reflect their personal circumstances. Please discuss the detail of the working pattern options for the role with the hiring manager.
What will you be doing?
- Working with Hadoop cluster, relational and NoSQL databases, in-memory caching, microservices and API gateways, security, and resource usage optimization
- Taking responsibility for the development of new features and document designs/proposals
- Possessing and demonstrating excellent knowledge of one programming language, preferably Python or Java, plus at least one other language
- Possessing and demonstrating excellent knowledge of one configuration tool, preferably Chef or Ansible
- Working on all aspects of analysis, design, implementation and deployment of all changes
- Focusing on good code quality and high test coverage and actively participating in code reviews
- Demonstrating the ability to work in high pressure situations and interact with business and other global teams (US, UK and others)
What we’re looking for:
- Experience supporting and working with production Hadoop cluster, knowledge of SQL, query optimizations, understanding of low level database details
- Experience configuring and maintaining databases (PostgreSQL, MS SQL Server), caches (Redis), and Kafka clusters
- Experience using Chef or Ansible in production, new deployments and maintaining existing infrastructure
- Programming in Python or Java + at least one other language, excellent with bash or similar shell scripting language
Skills that will help you in the role:
- Experience with DevOps, GitOps, CI/CD pipelines
- Experience with Grafana or similar, ITRS, or other monitoring solutions
- Experience with Kubernetes, service mesh (Istio), and API gateways
- Experience building and releasing code in production, must be comfortable working with Git
Where will you be working?
You will be working at our Americas Headquarters at 745 Seventh Avenue. This 32-story office tower is located in Times Square in the heart of Manhattan and features a cafeteria, fitness center and state-of-the-art LED signage on the facade of the building. Because this position involves regular in-person contact with other employees and stakeholders, the Company requires proof of vaccination against COVID-19. As an equal opportunity employer, the Company will provide reasonable accommodation to those individuals who are unable to be vaccinated consistent with federal, state, and local law.
#LI-Hybrid
#software
#LI-OR2021
Submit CV To All Data Science Job Consultants Across United States For Free