Before u proceed below to check the jobs/CVs, please select your favorite job categories, whose top job alerts you want in your email & Subscribe to our Email Job Alert Service For FREE
Job Location: Remote
Job Detail:
Job Description
Job Title: Data Architect-Lead Data Engineer
Summary:
The Lead Data Architect-Data Engineer will support our software developers, database architects, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams, systems, and products. The right candidate will be excited by the prospect of building our company’s data architecture from the ground up to support our next generation of products and data initiatives.
Wage Type: Salaried
Essential Duties & Responsibilities:
To perform this job successfully, an individual must be able to perform each of the essential duties satisfactorily. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.
- Assemble large, complex data sets that meet functional / non-functional business requirements.
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
- Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources.
- Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics.
- Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
- Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
- Work with and manage 3rd party data quality, MDM, and metadata management tools
- Develop and test architectures that enable data extraction and transformation for predictive or prescriptive modeling.
- Build processes supporting data transformation, data structures, metadata, dependency, and workload management.
- Keep our data separated, backed up and secure across national boundaries through multiple data centers and Azure regions.
- Carries out responsibilities in a manner consistent with our values and operating principles, in accordance with policy and applicable laws, and with a commitment to continuous improvement and process excellence.
- Other duties as assigned.
Organizational Structure:
Reports to: Head of Engineering/Chief Architect
Provides guidance to other technical team members
Required Knowledge/Skills:
- 5+ years of experience in a Data Engineer role,
- Advanced SQL knowledge and deep experience working with relational databases
- Working experience using the following or similar software/tools:
- Multiple big data tools: Hadoop, Spark, Kafka, etc.
- Multiple relational SQL and NoSQL databases (MySQL, Postgres, MongoDB, Cassandra)
- Multiple data pipeline and workflow management tools: SSIS, Azkaban, Luigi, Airflow, Azure Data Factory etc.
- Azure cloud services
- Stream Processing
- Object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.
- Microsoft PowerBI and Excel/Power Query
- Strong analytic skills related to working with unstructured datasets.
- Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores
- A successful history of manipulating, processing, and extracting value from large, disconnected datasets.
Desired Experiences:
- Background or familiarity with financial/banking systems and the associated regulatory requirements
- Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
- Experience building and optimizing ‘big data’ data pipelines, architectures, and data sets.
- Experience supporting and working with cross-functional teams in a dynamic environment.
- Experience working in a start-up or rapidly growing organization
Education:
- Degree in Computer Science, IT, or similar field;
- Post degree education or a graduate degree in Computer Science, Statistics, Informatics, Information Systems, or another quantitative field is a plus
Talent:
- Strong project management and organizational skills.
- Must be a self-starter and self-motivated individual that is goal oriented, organized, and analytical and can bring a positive impact to our organization.
- Energetic, resourceful, and appropriate work intensity to get the work done
- Strong people acumen and relationship skills; Naturally pre-disposed to quickly establish positive personal and professional relationship
Other:
- Ability to interpret a variety of instructions furnished in written, oral, diagram or schedule form.
- Must be able to lift to 20 pounds.
Submit CV To All Data Science Job Consultants Across United States For Free