What you will be doing

We are looking for an experienced Principal Data Engineer to lead the design and evolution of the data platform that powers our AML/KYC  and Fraud products. Our platform depends on ingesting, transforming and serving billions of signals every day: sanctions and watchlist data, adverse media, corporate registries, transaction events and customer records, all flowing into a real-time financial crime intelligence knowledge graph used by thousands of customers across the world.

As a Principal Data Engineer you will set the medium to long term technical direction for our data infrastructure. You will partner with Engineering, Data Science, Product and SRE leadership on cross-tribe initiatives, coach engineers at every level, and tackle the data problems that no single team can solve alone. You will also represent ComplyAdvantage at engineering and industry events.

Your impact will shape the data foundations on which ComplyAdvantage's AI, screening and monitoring products are built. Your work will directly affect how quickly and accurately our customers can detect money laundering, terrorist financing, sanctions evasion and other financial crime, and make that crime a thing of the past.

Scope of the role

Scope of Principal Engineers at ComplyAdvantage

• Sets the medium to long term technical direction for the data domain, working with the VP of Engineering and senior data science, data governance and engineering leaders.
• Leads the architectural design of complex, business-critical data systems that span multiple tribes and affect the whole company.
• Shapes how engineering teams work across the organisation, including data quality standards, tooling and ways of working.
• Tackles the hardest data problems and ships work with direct impact on company goals.
• Acts as an active interviewer, helps improving the hiring process, and coaches engineers across the engineering organisation.
• Represents ComplyAdvantage at meet-ups, conferences and industry forums.

Data engineering and engineering skills required of the role

• Architect petabyte-scale data platforms across batch, micro-batch and streaming, making explicit trade-offs between latency, throughput, cost and operational complexity.
• Design and own the lineage, quality, freshness and observability of the financial crime knowledge graph and the pipelines that feed it.
• Build and evolve the foundational data infrastructure: ingestion frameworks, the event bus, feature and serving stores, the lakehouse, orchestration and the developer experie