Senior Data Engineer

Role summary / purpose We are seeking a Senior Data Engineer to lead critical data infrastructure and migration initiatives for our next-generation application platform. This role is essential for establishing a robust, scalable data foundation as we transition from legacy systems to modern cloud-based architecture. Key responsibilities • Database Architecture & Design : Design and implement PostgreSQL databases and schemas from the ground up, ensuring optimal performance, scalability, and maintainability • Legacy System Migration : Lead the migration of large-scale Oracle databases from on-premises infrastructure to AWS RDS PostgreSQL clusters, managing data integrity and minimizing downtime • Real-Time Data Products : Build and optimize data products leveraging Apache Kafka, Apache Flink, and Apache Hudi to deliver reliable data streams to downstream consumers • Schema Analysis & Optimization : Evaluate existing database schemas, identify optimization opportunities, recommend structural improvements, and ensure database integrity throughout changes • Change Data Capture & Auditing : Design and implement comprehensive change auditing solutions that track data modifications, provide audit trails, and support compliance requirements • Data Governance & Documentation : Develop and maintain a data catalog and comprehensive schema documentation to facilitate seamless integration with application development teams Required skills • Database Expertise : Deep proficiency in PostgreSQL database design, administration, and optimization; strong understanding of relational database principles and SQL • Data Migration : Proven experience migrating large enterprise databases (Oracle to PostgreSQL preferred) with strong change management practices • Cloud Infrastructure : Hands-on experience with AWS services, particularly RDS, EC2, and associated networking and security configurations • Streaming & Real-Time Processing : Solid experience with Apache Kafka, Apache Flink, and data lakehouse technologies (Hudi, Delta Lake, or similar) • Data Modeling : Ability to design normalized and denormalized schemas, understand trade-offs, and optimize for both OLTP and analytical workloads • Change Data Capture (CDC) : Experience implementing CDC patterns and audit logging systems for tracking data lineage and changes • Communication : Strong ability to translate complex data concepts for technical and non-technical stakeholders; skilled at documenting architectures and schemas Nice-to-have / preferred skills • Experience with AWS Data Pipeline tools (Glue, Lambda, or Step Functions) • Knowledge of data quality and validation frameworks • Familiarity with infrastructure-as-code tools (Terraform, CloudFormation) • Prior experience in application modernization or legacy system replacements • Understanding of data security, encryption, and compliance requirements (GDPR, HIPAA, etc.)