Job Location: New York, NY
- Working with new Big Data systems/features, increasing performance, automating processes, forecasting loading, designing and implementing tools for large data set issue analysis and verification. Our environment runs within Yahoo’s Hadoop Grid and on AWS and uses shell scripting, Python and Frontend development skills.
- Production support: troubleshoot, report, and prioritize operational issues with multiple Big Data production pipelines
- Performance Engineering: Investigating and comparing Big Data infrastructural changes for improved performance and data throughput
- Big Data Design Engineering: Work with development team to help them create highly reliable data applications
- Analyzing Big Data job performance and efficiency to meet our ongoing business demands
- Automation Engineering: Improve and promote operational scalability and standardization through statistics and machine learning
- Act as a liaison between the different tiered support teams for operability/site-up issue escalation and monitoring
- Passionate about fast-paced projects and enjoy participating in system design consulting, capacity planning and platform management.
- Minimum of 5+ years of Data engineering experience in Big Data ecosystem
- Knowledge of software engineering: processes, tools, methods
- Familiarity with object-oriented programming concepts, large-scale software architecture, networking and distributed systems, and UNIX/Linux environments
- Knowledge of SQL and relational databases
- Experience of Big Data, Hadoop, Spark clustering technology application development and troubleshooting experience
- Experience using UNIX/Linux systems
- Experience with development in Python
- Experience with AWS cloud services: EC2, EMR, EKS
- Prior experience in technical operations and additional exposure to tool/product development.
- A solid foundation in data structures and algorithms, object-oriented programming, and modern software engineering practices
- Computer Science degree or relevant experience
- The ability to use an object-oriented programming language like Java or C++, scripting languages like Python or Perl, and Unix or Linux systems
- Excellent design, coding, debugging and testing skills
- The expertise to manipulate data through query languages with data concepts such as joins, aggregation, projection, and explosion
- The ability to work with large-scale distributed systems and excellent problem solving and organizational skills
- Great team-working capabilities in an agile development environment
- The passion to build great products, work with great people and change the world
- AWS Big Data or Any Big Data Industry Leading Certification
- Basic knowledge of containers and container orchestration technologies such as Kubernetes and Docker
- Apply DevOps best practices to big data engineering and machine learning
Candidates should be flexible / willing to work across this delivery landscape which includes and not limited to Agile Applications Development, Support and Deployment. Applicants for employment in the US must have valid work authorization that does not now and/or will not in the future require sponsorship of a visa for employment authorization in the US by Capgemini.
- Qualification: 6 – 8 (2 years min relevant experience in the role), Bachelor’s Degree.
- Certification: Should have SE Level 1 and seeking level 2.
- Should be proficient in Business Analysis, Business Knowledge, Software Engineering, Testing, Data Management, Architecture Knowledge and Technical Solution Design.
In a world where change happens in a split second, our clients must master the art of balancing business transformation with operational excellence and cost reduction to protect their market leadership and safeguard their workforce.
They need the best and brightest talent to limit business disruption and foster future growth, all while striving to realize a new normal. In this context, it’s our people within Insights & Data that are the core enablers to support our clients in their growth journeys. To give our clients our best and brightest, we pride ourselves on being a fast-paced, fun, ethical place to work, where the “work hard, play hard” mentality holds true. Even more important is our clear commitment to creating a diverse workforce in all areas. In fact, for the ninth time in a row, Capgemini has been recognized as one of the World’s Most Ethical Companies by the Ethisphere Institute. In addition, we’ve been recognized as a top company for women by Working Mother Media.
Capgemini’s Insights & Data Americas practice is comprised of professionals with data, analytics, and AI expertise, covering the full data- and AI-powered transformation lifecycle. Our people extend into all industries we conduct work with our clients in the areas of; data science, data engineering, data strategy, intelligent process automation, data ecosystems, intelligent industry/IoT, enterprise management, customer-first marketing, and data partnerships/disruptors (such as SAP, Microsoft, Google, AWS, Snowflake, Oracle, Adobe, etc.).
We do great work at I&D that is at the forefront of innovation. We pride ourselves as an inclusive, talented, and accomplished workforce, so please contact us to explore your fit with us.
Click the following link for more information on your rights as an Applicant – http://www.capgemini.com/resources/equal-employment-opportunity-is-the-law About Capgemini With 270,000 women and men in nearly 50 countries, Capgemini is a responsible and multicultural global leader. Its purpose: unleashing human energy through technology for an inclusive and sustainable future. As a strategic partner to companies, Capgemini has harnessed the power of technology to enable business transformation for more than 50 years. The Group addresses the entire breadth of business needs, from strategy and design to managing operations. To do this, it relies on deep industry expertise and its command of fast evolving fields such as cloud, data, artificial intelligence, connectivity, software, digital engineering and platforms. In 2020, Capgemini reported global revenues of €16 billion. Visit us at www.capgemini.com. People matter, results count.
Submit CV To All Data Science Job Consultants Across United States For Free

