Search Folks | is Hiring | Sr. Data Engineer | BigDataKB.com | 06-04-22

Job Location: Kolkata

Job Purpose:
The key responsibility for the role is to design and implement complex data pipelines in the organization platform. These could be on the Cloud using Cloud-native technologies or on-premises using open big data environments.

Key Responsibilities:
โ€ข Structured design thinking to modularize data pipelines, define re-use opportunities and bring efficient methods to bear on the problem
โ€ข Understanding of design choices in building a high volume and scalable pipeline
โ€ข Familiarity of data pipeline concepts from analogous tools in the big data ecosystem
โ€ข Willingness to learn the organization platform tooling concepts and deploy pipelines into the tool efficiently
โ€ข Discipline to apply the standard software development principles in your day-to-day tasks with a readiness to document and test
โ€ข Ability to work as an independent team member, capable of applying judgment to plan and execute tasks.

Essential skills:
โ€ข 2-6 years overall experience in data engineering or data analytics.
โ€ข Strong expertise in applying advanced SQL functions for data analysis and implementing complex computations
โ€ข Experience in developing and maintaining ETL pipelines, streaming jobs and data extraction using frameworks such as Apache Spark or similar data processing framework.
โ€ข Solid understanding of data warehousing, data ingestion, modelling, BI & reporting concepts.
โ€ข Ability to troubleshoot and tune performance of Apache Spark jobs operating on large datasets
โ€ข Experience with big data distribution frameworks like Cloudera | HD Insight | Data Proc | AWS EMR
โ€ข Experience working in hybrid cloud environments like AWS | Google Cloud | Azure

Desired Skills:
โ€ข Understanding of banking products, regulatory datasets and credit risk models
โ€ข Having a firm statistical background and exposure to tools like SAS, Python, R etc
โ€ข Programming background with good knowledge of either python or java.

Soft Skills:
Good interpersonal and communication skills, including the ability to inspire, mentor, coach junior data engineers

Apply Here

Submit CV To All Data Science Job Consultants Across India For Free

๐Ÿ” Explore All Related ITSM Jobs Below! ๐Ÿš€ โœ… Select your preferred “Job Category” in the Job Category Filter ๐ŸŽฏ ๐Ÿ”Ž Hit “Search” to find matching jobs ๐Ÿ”ฅ โž• Click the “+” icon that appears just before the company name to see the Job Detail & Apply Link ๐Ÿ“๐Ÿ’ผ

Comments

Leave a Reply

Your email address will not be published. Required fields are marked *