ASCENT TECHNOSYSTEMS PRIVATE LIMITED | Jobs | Data Engineer (Spark Developer) | BigDataKB.com | 14-02-22

โ€”

by

Job Location: Pune( Kalyani Nagar )

1. 3-5 years of experience as data engineer with skills mentioned below demonstrated in

production environment. Freshers certified on Spark can also apply .

Must Haves

2. Spark Developer with experience in large scale production deployment, data pipeline and large
scale computation.

3. Experience in using programming languages such as Scala, Python (PySpark) to mine and
query data for analysis and sometimes use big data SQL engines.

4. Develop data set processes for data modeling, mining and production.

5. Create Scala/Spark jobs for data transformation and aggregation.

6. Working experience with AWS services such as EMR, Athena, Glue, Redshift and Lambda.

7. Experience in developing and deploying Databricks jobs with knowledge in optimizing cluster
configurations.

8. Responsible for the maintenance, improvement, cleaning, and manipulation of data in the
businesss operational and analytics databases.

9. Defines and builds the data pipelines that will enable faster, better, data-informed decision-
making within the business.

10. Designing and developing scalable ETL packages from the business source systems and the
development of ETL routines in order to populate databases from sources and also to create
aggregates.

Nice to Haves

11. Experience with NoSQL databases, such as HBase, Cassandra, MongoDB.

12. Experience with Apache Spark streaming and batch framework.

13. Experience with Kafka, Storm, Zookeeper.

14. Spark query tuning and performance optimization.

15. Produce unit tests for Spark transformations and helper methods.

16. Recommend ways to improve data reliability, efficiency and quality.

Apply Here

Submit CV To All Data Science Job Consultants Across India For Free

๐Ÿ” Explore All Related ITSM Jobs Below! ๐Ÿš€ โœ… Select your preferred “Job Category” in the Job Category Filter ๐ŸŽฏ ๐Ÿ”Ž Hit “Search” to find matching jobs ๐Ÿ”ฅ โž• Click the “+” icon that appears just before the company name to see the Job Detail & Apply Link ๐Ÿ“๐Ÿ’ผ

Comments

Leave a Reply

Your email address will not be published. Required fields are marked *