Larsen & Toubro Infotech Limited | Jobs | Senior Data Engineer, Pan India | BigDataKB.com | 31-01-22

โ€”

by

Job Location: remote

Primarily looking for an data engineer with expertise in processing data pipelines using PySpark, Spark SQL on Hadoop distributions like AWS EMR, Data bricks, Cloudera etc

Must have – PySpark, AWS S3, EMR, Big data

Good to have – databricks, Snowflake, Talend

Requirements:

Candidate must be experienced working in projects involving

Other ideal qualifications include experiences in:

Primarily looking for an data engineer with expertise in processing data pipelines using PySpark, Spark SQL on Hadoop distributions like AWS EMR, Data bricks, Cloudera etc.

Should be very proficient in doing large scale data operations using PySpark and overall very comfortable using Python

Familiarity with AWS compute, storage and IAM concepts.

Experience in working with S3 Data Lake as the storage tier.

Any ETL background (Talend, AWS Glue etc.) is a plus but not required

Cloud Warehouse experience (Snowflake etc.) is a huge plus

Carefully evaluates alternative risks and solutions before taking action

Optimizes the use of all available resources

Develops solutions to meet business needs that reflect a clear understanding of the objectives, practices and procedures of the corporation, department and business unit

Skills:

Hands on experience on PySpark, SparkSQL,AWS Cloud platform especially S3, EMR, Databricks, Cloudera, etc.

Experience on Shell scripting

Exceptionally strong analytical and problem solving skills.

Relevent experience with ETL methods and with retrieving data from dimensional data models and data warehouses.

Strong experience with relational databases and data access methods, especially SQL.

Excellent collaboration and cross-functional leadership skills.

Excellent communication skills, both written and verbal.

Ability to manage multiple initiatives and priorities in a fast-paced collaborative environment.

Ability to leverage data assets to respond to complex questions that require timely answers

has working knowledge on migrating relational and dimensional databases on AWS Cloud platform

Apply Here

Submit CV To All Data Science Job Consultants Across India For Free

๐Ÿ” Explore All Related ITSM Jobs Below! ๐Ÿš€ โœ… Select your preferred “Job Category” in the Job Category Filter ๐ŸŽฏ ๐Ÿ”Ž Hit “Search” to find matching jobs ๐Ÿ”ฅ โž• Click the “+” icon that appears just before the company name to see the Job Detail & Apply Link ๐Ÿ“๐Ÿ’ผ

Comments

Leave a Reply

Your email address will not be published. Required fields are marked *