Tech Lead Data Engineer - Finance - Freelance

Context

As part of the development of real-time data products within an international and highly industrialized environment, our client is looking for an experienced Tech Lead Data Engineering to design, build and operate reliable, scalable, and secure data solutions.

The mission covers the full data lifecycle, from data ingestion and stream processing to the delivery of APIs and services consumed by internal and external stakeholders. The environment requires strong standards in terms of reliability, security, observability, performance, and maintainability.

The ideal candidate will be a highly technical and hands-on leader, able to translate complex business requirements into robust technical designs while supporting engineering teams through architecture discussions, code reviews, and knowledge sharing.

Missions

• Design and implement real-time data products based on Apache Kafka, Apache Flink, and event-driven architectures.
• Build resilient ingestion, processing, transformation, and data delivery pipelines for both streaming and batch workloads.
• Develop microservices and well-documented REST APIs using OpenAPI standards.
• Integrate and deploy data services in an AWS environment.
• Define data models, data quality rules, validation processes, and schema governance practices.
• Implement automated testing and CI/CD pipelines covering build, test, deployment, and rollback activities.
• Set up comprehensive observability across logs, metrics, traces, dashboards, and alerts.
• Support production operations, including monitoring, incident management, performance optimization, root-cause analysis, and continuous improvement.
• Apply security best practices covering authentication, authorization, encryption, secrets management, and least-privilege access.
• Produce architecture documents, API specifications, operational runbooks, and deployment documentation.
• Lead technical discussions and contribute to architecture and code reviews.
• Define engineering standards and provide mentoring and knowledge transfer to less experienced engineers.
• Deliver production-ready solutions that meet functional, performance, reliability, security, and maintainability requirements.

Tools & Environment

• Apache Kafka, Apache Flink
• Event-driven architectures
• REST APIs, OpenAPI specifications, microservices
• AWS services: MSK, Kinesis, Lambda, API Gateway, ECS/EKS, S3, IAM
• Data quality, schema management, automated testing
• CI/CD tools: GitLab CI, GitHub Actions, or equivalent
• Observability tools: CloudWatch, Prometheus, Grafana, OpenTelemetry
• Security: OAuth2/OIDC, authentication, authorization, encryption, secrets management

Working Conditions

• Contract linked to an international and highly industrialized finance environment
• Role focused on real-time and streaming data engineering
• Fluent English required
• Experience in financial markets or regulated industries is an advantage