Job Location: Hyderabad/Secunderabad( Nanakramguda )
Hiring a Data Scientist / Lead Data Engineer having 7-12 years of experience
- Good working experience in SQL, No-SQL, Power BI, Hive, Spark SQL.
- Good working experience in latest cloud ETL tools such as ADF/Glue/Dataflow
- Understand and execute in memory distributed computing frameworks like Spark and/or DataBricks.
- Build and maintain data pipelines to support large scale data management projects
- Understand and translate data, analytic requirements, and functional needs into technical requirements.
- Expertise in data structures, distributed computing, manipulating, and analyzing complex high-volume data from variety of internal and external sources
- Solid hands-on working experience in SQL and scripting.
- Knowledge in Python, TSQL, KQL.
- Experience in any orchestration/workflow tool such as Airflow/Oozie for scheduling pipelines
- Critical thinker and problem-solving skills.
- Great interpersonal and communication skills.
- Ensure alignment with data strategy and standards of data processing
- Deploy scalable data pipelines for analytical needs
- Experience in Big Data ecosystem – on-prem (Hortonworks/MapR) or Cloud (Dataproc/EMR/HDInsight)
- Data Migration from On-Prem to cloud or cloud to cloud
- Database Troubleshooting and performance optimization
- Understanding of any reporting tools such as PowerBI, Looker, Tableau or Qlikview
- Good understanding of in relational/dimensional modelling and ETL concepts
- Experience in building structured and unstructured data pipelines
- Should be able to travel abroad based on requirements