Analytics Engineer
MarTech & Personalization
Description:
As an Analytics Engineer, you will be responsible for the design, development and monitoring of data products (especially feature store), packages and processes that will help streamline the creation and deployment of data science solutions made by our Data Scientists.
What you will do:
- Work with our Data Scientists to design datasets that are useful for creating statistical and machine-learning models.
- Design, develop, and maintain feature stores as well as the accompanying feature pipelines that will be used in creating training data as well as batch inference features.
- Implement data quality and integrity checks and ensure the quality and availability of data sources in accordance with their SLAs.
- Align with Data Engineering and Data Governance team to achieve maturity in the data.
- Be the expert on various business or data domains to support the data science initiatives
- Create and maintain software packages for use by our Data Scientists to help improve their model development workflow.
- Build CI/CD pipelines to improve time to deploy data pipelines and proactively catch issues before they hit production
- Provide guidance on best practices for code and architecture of data pipelines and do code and architecture reviews to ensure adherence to best practices
- Communicate technical architecture and solutions, as well as explain the competitive advantage of various technologies to a broad audience
- Create and maintain architecture and systems documentation
What we are looking for:
- With a bachelor's degree in any quantitative discipline (i.e. Computer Science, Math, Physics, etc)
- Must have at least 2 years of experience in creating building and maintaining ETL pipelines
- Must be proficient in Data Lake Platforms (Databricks, etc) and manipulating data within them
- Has high proficiency in SQL
- Must have good proficiency in data modeling techniques
- At least 2 years of experience in working with AWS or any Cloud providers (such as GCP or Azure)
- Has experience in working with Databricks or Spark platforms
- Must have at least 1 year of experience in managing stakeholders