Position Description:
Data Engineer – Advanced
Position Purpose:
Lead and build a big data platform pipeline with data from multiple internal and external data sources, creating semantic layers, managing large data sets, and working with machine learning and algorithmic technologies to create a model runtime for real time event processing and interactions. Work with stakeholders with data-related technical issues and support their data infrastructure needs.
Key Accountabilities:
- Build large-scale batch and real-time data pipelines using the latest technologies
- Apply design thinking and an agile mindset in working with other engineers, data scientists and business stakeholders to continuously experiment, iterate and deliver on new initiatives
- Leverage best practices in continuous integration and delivery
- Help drive transformation by continuously looking for ways to automate existing processes and testing and optimize data quality
- Explore new capabilities and technologies to drive innovation
Knowledge & Experience:
Must-have
- 5-9 years of relevant experience
- Experience in data dealing with structured and unstructured data, data analytics and big data infrastructure and pipelines
- Designed and implemented a data infrastructure to house large sets of consumer and transaction data leveraging Cloud platform services
- Designed and implemented the infrastructure required for optimal extraction transformation, and loading of data from a wide variety of data sources using SQL, MSSQL, Spark, T-SQL, NoSQL, SAAS APIs, Python (Pandas/Numpy), on-premises or cloud including ‘big data’ technologies
- Prepared analytical datasets (ADS) to support the data science and modeling/AI team in building and deploying statistical models (e.g., predictive models)
- Built deployed and supported a production application
Nice-to-have
- Lead the build out of a data engineering team
- Experience in the cash incentive/consumer rewards space
- Data product design and implementation experience
- Experience with Amazon AWS big data services (Lambda architecture, Kinesis, Glue) or equivalent cloud services
Skills & Competencies:
- Strong computer science fundamentals with an extensive background in building highly resilient production ready applications
Attributes:
- Excellent written and verbal communication
- Ability to prioritize time
- Leadership
Candidate should be flexible to work in shift arrangement (European shift)
Skills:
- Communication (Oral/Written)
- Time Management
- Cloud Computing
- Big Data
- Continuous Integration
- Data Engineering
- Python
- AWS Big Data
What you can expect from us:
Build your career with us.
It is an extraordinary time to be in business. As digital transformation continues to accelerate, CGI is at the center of this change—supporting our clients’ digital journeys and offering our professionals exciting career opportunities.
At CGI, our success comes from the talent and commitment of our professionals. As one team, we share the challenges and rewards that come from growing our company, which reinforces our culture of ownership. All of our professionals benefit from the value we collectively create.
Be part of building one of the largest independent technology and business services firms in the world.
Learn more about CGI at www.cgi.com.
No unsolicited agency referrals please.
CGI is an equal opportunity employer.
Submit CV To All Data Science Job Consultants Across India For Free