Job Location: Bengaluru, Karnataka, India
Qualification:
2+’ experience with Bachelor’s Degree in Computer Science, Engineering, Technology or related field required
● 2 years of relevant software development experience with sound skills in database modeling (relational, multi-dimensional) & optimization and data architecture – databases e.g. Vertica
● Experience with Enterprise Business Intelligence Platform/Data platform sizing, tuning, optimization and system landscape integration in large-scale, enterprise deployments.
● Experience working extensively in multi-petabyte DW environment
● Proficiency in one of the programming language preferably Java, Scala or Python
● Proven experience in development of conceptual, logical, and physical data models for Hadoop, relational, EDW (enterprise data warehouse) and OLAP database solutions.
● Good knowledge of Agile, SDLC/CICD practices and tools
● Must have proven experience with Hadoop, Mapreduce, Hive, Spark, Scala programming. Must have in-depth knowledge of performance tuning/optimizing data processing jobs, debugging time consuming jobs.
● Hand on experience of streaming technologies like Kafka, Spark Streaming.
● Good understanding of distributed systems
● Experience in engineering large-scale systems in a product environment
Specific responsibilities include:
● You should have expertise in designing, implementing, and operating stable, scalable, solutions to flow data from production systems into analytical data platform (big data tech stack + MPP) and into end-user facing applications for both real-time and batch use cases
● The ability to do deep problem solving and build elegant, maintainable solutions to complex problems.
● Influence product requirements & operational plans. Instill best practices for development and champion their adoption, while working with product manager to estimate and plan projects in agile development framework.
● Architectural & Design Choices, Deep knowledge on one or more tech stacks, identify alternative tech choices and trade-offs
● Strong problem Solving skills, Identify feasible alternatives and freeze on the optimal choice of design approach
● Designing platforms as consumable data services across the organization using Big Data tech stack
● Do high level design independently; Functional modelling, break-down of a module
● Build and execute data modeling projects across multiple tech stacks i.e. big data, MPP, OLAP using agile development techniques
● Challenge status quo and propose innovative ways to process, model, consume data when it comes to tech stack choices or design principles
● Strong engineering mindset – build automated monitoring, alerting, self healing (restartability/graceful failures) features while building the consumption pipelines
● Translate business requirements into technical specification (fact/dimension/filters/derivations/aggregations)
● Lead by example, mentor and guide team members on everything from structured problem solving to development of best practices
● An ideal candidate will have excellent communication skills to be able to work with engineering, product and business owners to develop and define key business questions and to build data sets that answer those questions.
Submit CV To All Data Science Job Consultants Across Bharat For Free