The Briminc | Jobs | Data Engineer (Python – Must) / ETL & Spark or Hadoop | BigDataKB.com | 31-01-22

โ€”

by

Job Location: Noida

Responsibilities:
Role: Engineer
Qualification: B.Tech(CS-IT) / MCA

Desired Skills:
In-depth architectural knowledge of Spark and Hadoop
Expert in building ETL pipelines using Spark (Pyspark)
Experience using Spark with HDFS,
Experienced writing data pipelines using functional programming (Python – must, Java, or
Scala)
Advanced ANSI SQL experience
Firm understanding of Big Data and traditional data processing, understanding the differences
in-depth to make informed design decisions
Firm understanding of data Modelling OLAP vs. OLTP vs. Hybrid models
AWS, Azure, or Google Cloud knowledge (at least one cloud)

Good to have Technical Skills:
Experience using Spark with Cloud Storage and Hiveserver2 LLAP (HWC)
Proven track record of developing DAGs using Apache Airflow
Exposure to Ranger and Atlas

Core Responsibility Areas:
Working with data modeling of complex data?
Exposure to retail 3pl and international preferred
Setting up scaling tuning, no sql, db, postgresql, cassandra mongo db ms sql
Helping team make the right choice of db based on nfr
Generating er diagrams db scripts
Working with data generation tools
Working on data cleansing
handling of cache (elastic or redis) and master and transaction data for complex large volume
multinational organization with high volume and low response time
learn and implement new db and cloud and technologies
Cloud knowledge and working on aws, azure, or google cloud.

Apply Here

Submit CV To All Data Science Job Consultants Across India For Free

๐Ÿ” Explore All Related ITSM Jobs Below! ๐Ÿš€ โœ… Select your preferred “Job Category” in the Job Category Filter ๐ŸŽฏ ๐Ÿ”Ž Hit “Search” to find matching jobs ๐Ÿ”ฅ โž• Click the “+” icon that appears just before the company name to see the Job Detail & Apply Link ๐Ÿ“๐Ÿ’ผ

Comments

Leave a Reply

Your email address will not be published. Required fields are marked *