Database Engineer
NATURE OF WORK
-
Design and implement scalable, resilient database and data movement solutions using AWS services, supporting PostgreSQL, MySQL, and Oracle workloads.
-
Build and maintain reliable data replication pipelines from source databases to Amazon S3, ensuring data is delivered in a timely, consistent, and ingestion-ready format for downstream consumption by the Central Data Engineering team.
-
Create and manage database replication and resolve replication failures or data quality issues.
-
Apply and enforce data security and compliance controls across databases and data pipelines, including encryption at rest and in transit, access controls, secrets management, and data masking where required.
-
Automate operational and administrative tasks through scripting and infrastructure-as-code to reduce manual effort, improve repeatability, and increase platform stability.
-
Implement and maintain monitoring, alerting, and logging for databases, replication tools, and supporting AWS resources to proactively detect performance, availability, and data integrity issues.
-
Act as the Databricks platform administrator for the organization, responsible for workspace configuration, cluster policies, access management, compute governance, and cost controls.
-
Manage and optimize Databricks compute resources to ensure secure, cost-efficient, and reliable platform usage in alignment with organizational standards and workload requirements.
-
Collaborate closely with Central Data Engineering and other stakeholders to align on data delivery expectations, platform standards, operational handoffs, and continuous improvements.
REQUIRED QUALIFICATIONS
-
Medium to advanced proficiency in SQL, with the ability to write, analyze, and troubleshoot queries for operational and data replication use cases.
-
Hands‑on experience with scripting languages such as Shell and/or Python to support automation, monitoring, and routine administrative tasks.
-
Experience administering services running in AWS, including foundational knowledge of cloud infrastructure, security controls, and operational best practices.
-
Working knowledge of Data Engineering or Data Warehousing concepts, including data pipelines, ingestion patterns, and analytical data platforms.
-
Experience with Databricks is a strong advantage, particularly in supporting platform administration, access management, or compute usage.