Beyondsoft International (Singapore) | Data Engineer (Big Data) | Bhagya Nagar, Telangana | Bharat | BigDataKB.com | 2023-03-08

Before u proceed below to check the jobs/CVs, please select your favorite job categories, whose top job alerts you want in your email & Subscribe to our Email Job Alert Service For FREE

 

Job Location: Bhagya Nagar, Telangana

Job Detail:

Role Responsibilities:

  • Work with business to understand the project requirements
  • Design, develop and implement data pipelines involving data fetched from diverse sources and housed in tables and views in the semantic layers
  • Responsible for ETL processes and tools as well as database loading and manipulation to ensure that the data needs are met throughout the course of the projects and support.
  • Ensure designs are in compliance with specifications
  • Prepare and produce releases of software components
  • Liaise with business and a team of developers and make sure, the best of the solutions are delivered with in time and budget
  • Collaborate with other developers, business/data analysts and leads to design, develop and test project assignments

Education and Experience:

  • Bachelor in Computer Science, Statistics, Informatics, Information Systems or another quantitative field
  • Minimum 6 years of in Data Engineer role in Big Data platform by using Hadoop concepts and framework
  • Hands on experience on Spark Core, Spark-SQL, Scala-Programming and Streaming datasets
  • Expertise in HDFS architecture, Hadoop framework – Map Reduce, Hive, PIG, Sqoop, Flume & data warehouse concepts
  • CI/CD experience (Jenkins, GitHub) is a must
  • Proficient in Hadoop MapReduce programming and Hadoop ecosystem
  • Good understanding of RDBMS principles, Shared nothing, MPP architecture
  • Hands on performance tuning, query optimization, file and error-handling, restart mechanism
  • Hands on experience on UNIX Shell Scripting and Python
  • Knowledge of Teradata, SAS, QlikView reporting etc.
  • Able to understand the complex transformation logic and translate them to Spark-SQL queries
  • Worked on Cloudera distribution framework, Oozie Workflow (or any Scheduler)
  • Familiar with Data Warehouse concepts and Change Data Capture (CDC and SCD Types)
  • Core Java skillset is an added advantage
  • Airflow is an added advantage
  • Good Knowledge and experience in any database (Teradata or Data Lake or Oracle or SQL Server) are a plus

Job Types: Full-time, Regular / Permanent

BigDataKB.com Jyotish
BigDataKB.com Jyotish - Career & Life Prediction

Salary: ₹1,800,000.00 – ₹2,400,000.00 per year

Benefits:

  • Paid sick time
  • Paid time off
  • Provident Fund

Schedule:

  • Monday to Friday

Ability to commute/relocate:

  • Hyderabad, Telangana: Reliably commute or planning to relocate before starting work (Required)

Experience:

  • Scala: 4 years (Required)
  • Hadoop: 4 years (Required)
  • Spark: 5 years (Required)

Work Location: In person

Apply Here

Submit CV To All Data Science Job Consultants Across Bharat For Free

LEAVE A REPLY

Please enter your comment!
Please enter your name here