Job Location: Bangalore
Cloud Data Engineer
Job Description
Design, develop, optimize, and maintain Cloud Data Platform pipelines that adhere to ETL principles and business goals • Utilize conceptual knowledge of data and analytics, such as dimensional modeling, ETL, reporting tools, data governance, data warehousing, structured and unstructured data to solve complex data problems • Work with business/application/solution teams to implement data strategies, build data flows, & develop conceptual/logical/physical data models • Develop, and maintain conceptual, logical, and physical data models, implement of RDBMS, operational data store (ODS), data marts, and data lakes on target platforms in cloud • Work with the database engineering and DBAs to create optimal physical data models (transactions, normalized and dimensional models; etc.,) • Define and govern data modeling and design standards, tools, best practices, and related development for enterprise data models • Hands-on experience modeling, design, configuration, installation, performance tuning, and setting up sandbox for POC • Lead/Partner with business analyst and solutions architects to conduct detailed technical assessments of enterprise data architecture, define path to transform it into a modern data powered enterprise for strategic enterprise projects and initiatives • Lead/Partner with different teams and provide deep technical expertise to evaluate, implement & deploy emerging tools and large scale data solutions for data engineering to improve productivity as a team • Conduct full technical discovery, identifying pain points, business and technical requirements, “as is” and “to be” scenarios • Compare solution alternatives across both technical and business parameters which support the define cost and service requirements • Create detailed target state technical, security, data and operational architecture and design blueprints incorporating modern data technologies and cloud data services demonstrating modernization value proposition • Lead scoping sessions to generate estimates and approaches for execution • Solve complex data problems to deliver insights that helps our business to achieve their goals • Create data products for analytics and data scientist team members to improve their productivity • Stay educated on new and emerging technologies/patterns/methodologies and market offerings/Learn about machine learning, data science, computer vision, artificial intelligence, statistics, and/or applied mathematics • Develop and deliver communication & education plans on analytic data engineering capabilities, standards, and processes • Advise, consult, mentor and coach other data and analytic professionals on data standards and practices • Experience with developing solutions on cloud computing services and infrastructure in the data and analytics space (Azure or GCP) • Experience with tools like Azure Data Factory, Databricks, Integration Runtime Services • Experience in Python or Scala • Expert in T-SQL • Big Data development experience using Kafka . Azure EventHub, IoT Hub • Familiarity with the Linux operating system • Bachelor’s degree • Minimum 1+ years of experience in architecting large-scale data solutions, performing architectural assessments, crafting architectural options and analysis, finalizing preferred solution alternative working with IT and Business stakeholders • 1+ years of data engineering or architecture experience, architecting, developing, and deploying scalable enterprise data analytics solutions • 3+ years of IT experience and equivalent blend of education and experience • Experience designing, building and operationalizing large-scale enterprise data solutions and applications using one or more of cloud data and analytics services in combination with 3rd parties • Hands-on experience analyzing, re-architecting and re-platforming on-premise data warehouses to data platforms on cloud • Experience designing and building production data pipelines from ingestion to consumption within a hybrid big data architecture • Experience designing and implementing data engineering, ingestion and curation functions on cloud using native or custom programming • Hands-on experience designing and implementing data ingestion solutions on cloud • Hands-on experience architecting and designing data lakes on cloud serving analytics and BI application integrations • Experience design/development of Large Data Warehouse and/or Database Management Systems • Expertise in data modeling principles/methods including, Conceptual, Logical & Physical Data Models • Demonstrated experience modeling high performance multi-dimensional Data Marts and Reporting structures including OLAP cubes • 1+ years of hands-on relational, dimensional, and/or analytic experience (using RDBMS, dimensional, NoSQL data platform technologies, and ETL and data ingestion protocols) • 1+ years of experience with database development (SQL, PL/SQL) and scripting
• Experience with developing solutions on cloud computing services and infrastructure in the data and analytics space (Azure or GCP) • Experience with tools like Azure Data Factory, Databricks, Integration Runtime Services • Experience in Python or Scala • Expert in T-SQL • Big Data development experience using Kafka . Azure EventHub, IoT Hub • Familiarity with the Linux operating system • Minimum 3+ years of experience integrating cloud data services for building secure data solutions • Minimum 3+ years of experience introducing and operationalizing self-service data preparation tools (e.g. Collibra, Alation , Babylon) • Minimum 3+ years of architecting and operating large production SAP/NoSQL clusters on premise or using Cloud services • Minimum 1+ years architecting and implementing metadata on cloud • Architecting and implementing data governance and security for data platforms on cloud • Designing operations architecture and conducting performance engineering for large scale data lakes a production environment • Craft and lead client design workshops and provide tradeoffs and recommendations towards building a solutions • Bachelor’s degree in Computer Science, Engineering, Technical Science or 3+ years of architecture and build experience with large scale solutions
Global VISA and Relocation Specifications:
K-C requires that an employee have authorization to work in the country in which the role is based. In the event an applicant does not have current work authorization, K-C will determine, in its sole discretion, whether to sponsor an individual for work authorization. However, based on immigration requirements, not all roles are suitable for sponsorship.
This role is available for local candidates already authorized to work in the role’s country only. K-C will not provide relocation support for this role.
Primary Location
IT Centre Bengaluru GDTC
Additional Locations
Worker Type
Employee
Worker Sub-Type
Regular
Time Type
Full time
Submit CV To All Data Science Job Consultants Across India For Free
Leave a Reply