CivicDataLab
Remote
Job Information
Industry
Work Experience
Salary
Remote Job
About us
Job Description
This is a remote position.
Who we are
We at CivicDataLab, work with the goal to use data, tech, design and social science to strengthen the course of civic-engagements in India. We work to harness the potential of the open-source movement to enable citizens to engage better with public reforms. Our work is centered around building data strategy, data platforms and data science applications to push data-driven decision-making at scale. Moreover, we work closely with governments, non-profits, think tanks, media houses, academia and more to build overall data and tech capacity.
What We are looking for
A data engineer to support our current and upcoming interventions through open data platforms and open-source tools, focusing on building robust data pipelines focusing on automated data mining, data cleaning, data standardization, wrangling and munging. We are looking for people who are strongly aligned with our values and have an innate sense of problem-solving, automating processes and adapting well to dynamic environments. They will work alongside data strategists, public policy researchers and other stakeholders to develop automated ETL (Extract, Transform and Load) data pipelines and know how to model, store and manage bulk datasets. This will help us co-create comprehensive data analytics tools and dashboards for our diverse stakeholders.
Why work with us
We help you not just define your ‘impact’ but also work with you towards finding a path to learn, realise and quantify its effect on our ecosystem.
Our past work and experience of working with communities and civic tech, in general, has connected us as a branch to a network of civil society actors and organisations. You’ll have the opportunity to leverage this network, to work on pressing, yet thought-provoking issues, in sectors like Judiciary, Public Finance, Economics, Public Education and Urban Development.
We also feel that this is our biggest strength, what we can offer you is not a feature to work on but a passage to an infinitely long road of people, problems, ideas and opportunities that may help you find your place amidst the chaos.
How we work
At CivicDataLab, people work from their individual locations, being proactive in communication is the key. We use open-source tools and agile methodologies in organising our work. We meet once every quarter in some part of the country to reconvene, learn from each other and help the organisation grow.
Here’s a brief on our current and upcoming work:
https://drive.google.com/file/d/1NBpC7Zh-QKVCe1P4ebru-YVguVB55Ho/view?usp=sharing
Our Hiring Process
The entire hiring process averages between 3-4 weeks and consists of simple five simple steps:
-
You apply with your detailed portfolio/CV and a cover letter
-
We have an Introductory discussion
-
Based on how our discussion goes, we’ll give you a take-home assignment
-
We meet, ideally in a week’s time, to discuss the assignment
-
If all goes well, we’ll have a final ‘Culture Discussion’ round, and you get to meet the rest of the team
Note: Our hiring process works in weekly cycles, where we will collect the applications every week and start the funnel for the selected candidates together in subsequent weeks. Please expect a response within 7-14 days of your application.
Cover letter and a written application
The first step of the process is sending across your portfolio along with a cover letter. On average, we review applications about 2-3 days after they’re submitted. When we make a decision, you’ll receive a form to fill in more details.
Introductory Discussion
This is intended to be a general conversation to get to know you better and tell you more about CDL. We want to learn more about your interests, what you’re working on and why you want to work at CDL. These discussions typically last for 30 mins and are usually conducted over a video call. Once our team deliberates, they’ll email you with the details for the take-home assignment.
Take-home assignment
We would collaborate with you on the take-home assignment that lasts for a week. What we really want is to see what it’s like to work with you and how you take suggestions and think about design. The team will get a decision to you within 2-3 days of the submission.
Assignment Discussion
Here, you’ll share your screen and collaborate with our team to further enhance your assignment outcomes. The discussion typically runs for 60 to 90 mins. Based on the inputs from the team, we will get to a decision in 1-2 days.
Culture Discussion & Meet the Team
You will be introduced to the entire team in this round. We encourage a free and open discussion. Based on the feedback from the team, we will get a decision for you in 2-3 days, along with the offer letter.
Requirements
What You’ll Be Doing
-
Lead development of scalable data pipelines involving data mining, data standardization, munging, storage and indexing.
-
Deploy and manage various SQL operations on data to slice it according to the analytics requirements.
-
Work on developing comprehensive data models and pipeline architecture, implementation and orchestration.
-
Build and monitor robust data APIs powering various data analytics tools and dashboards.
-
Develop robust log management and monitoring frameworks.
-
Bring new emerging data technologies at CivicDataLab.
-
Publish and contribute our data pipelines as open and reusable resources.
-
Engage regularly with our diverse stakeholders and open source communities to co-create data and technology solutions.
Skills you should bring
-
3-5 years of thorough experience working with Python and SQL
-
Should have a thorough understanding of handling and manipulating data and querying mechanisms (SQL and alike) as well as data cleaning and manipulation.
-
Should have sound knowledge of best practices for indexing and querying, normalizing, working with distributed databases, caching methodologies and more.
-
Ability to gauge requirements for the project, make decisions and coordinate with other team members.
-
Ability to actively engage with multiple stakeholders (like open-source communities, governments, civil society organizations, researchers, media and more) to plan and execute development sprints.
Good to have
-
Knowledge of open-source data scraping frameworks and tools such as Selenium and Scrapy.
-
Knowledge of Apache Airflow to automate processes.
-
Experience working with data pipelines that help standardization of data.
-
Hands-on experience with CKAN
-
Working knowledge of managing geospatial data using open-source tools like QGIS and more.
-
Prior experience in actively working and contributing to FOSS (Free and Open Source Software) communities.
-
Familiarity in working with Agile methodologies and Scrum processes.
-
Experience with scalable infrastructure practices such as microservice architecture, infrastructure as code, distributed systems, scaling methods, load balancing and more.
-
Engaging with government or social sector research-based organizations on past projects will be a big plus.
-
Prior experience of working remotely.
-
Familiarity with maintaining large open-source projects.
-
A good sense of humor.
Benefits
Perks of Working with Us
Home Office and Wellness Allowance
Since you work remotely, we want to make sure your home office is comfortable. You can use this perk to set up a home office. This includes internet services, other tech infrastructure, etc. If you’re interested in taking classes that enhance your overall physical or mental well-being, you have an INR 60,000 annual stipends to do so. For some people, that might mean a monthly massage. Some take photography lessons or learn a musical instrument or buy a gym membership. It’s up to you; the point is to learn something that you feel enriches you as a person.
Professional growth and development Allowance
At CivicDataLab, we encourage everyone to take up things that help one grow professionally, and you get an annual kitty of INR 60,000 to do so. This includes attending or speaking at conferences and workshops, taking courses, acquiring hardware or software licences or even joining summer schools. We feel that learning a skill should never be a hurdle to solve important problems for the community.
CivicDataLab encourages the usage of coworking spaces. Please make sure you’re using a true coworking space that’s meant solely for working, not a club or social space.
Submit CV To All Data Science Job Consultants Across India For Free
