Tech Lead Data Engineering – Real-Time & Streaming – Finance - Freelance

As part of the development of real-time data products within an international and highly industrialized environment, our client is looking for an experienced Tech Lead Data Engineering to design, build and operate reliable, scalable and secure data solutions.

The mission covers the full data lifecycle, from data ingestion and stream processing to the delivery of APIs and services consumed by internal and external stakeholders. The environment requires strong standards in terms of reliability, security, observability, performance and maintainability.

The ideal candidate will be a highly technical and hands-on leader, able to translate complex business requirements into robust technical designs while supporting engineering teams through architecture discussions, code reviews and knowledge sharing.

The consultant will be responsible for:

• Designing and implementing real-time data products based on Apache Kafka, Apache Flink and event-driven architectures.

• Building resilient ingestion, processing, transformation and data delivery pipelines for both streaming and batch workloads.

• Developing microservices and well-documented REST APIs using OpenAPI standards.

• Integrating and deploying data services in an AWS environment.

• Defining data models, data quality rules, validation processes and schema governance practices.

• Implementing automated testing and CI/CD pipelines covering build, test, deployment and rollback activities.

• Setting up comprehensive observability across logs, metrics, traces, dashboards and alerts.

• Supporting production operations, including monitoring, incident management, performance optimisation, root-cause analysis and continuous improvement.

• Applying security best practices covering authentication, authorisation, encryption, secrets management and least-privilege access.

• Producing architecture documents, API specifications, operational runbooks and deployment documentation.

• Leading technical discussions and contributing to architecture and code reviews.

• Defining engineering standards and providing mentoring and knowledge transfer to less experienced engineers.

• Delivering production-ready solutions that meet functional, performance, reliability, security and maintainability requirements.