Data Engineer - Public Sector - Freelance

Data Engineer – AWS / Big Data / Machine Learning (Freelance)

Location: Luxembourg
Contract: Freelance – 6 months, renewable
Start Date: ASAP
Working Model: On-site
Industry: Public Sector
Experience: Minimum 3 years
Language: Fluent English

Context

Our client is seeking an experienced Data Engineer to join a data-driven project in Luxembourg.

You will be responsible for designing, building, and maintaining scalable data pipelines and architectures that support data-driven decision-making across the organisation.

The role combines hands-on data engineering, database optimisation, streaming analytics, and machine learning to transform large volumes of structured and unstructured data into reliable, actionable insights.

Key Responsibilities

• Build, maintain, and optimise data pipelines and ETL processes.

• Manage and monitor databases, troubleshoot issues, and improve performance.

• Design and develop scalable big data architectures on AWS, leveraging technologies such as DynamoDB, MySQL, ClickHouse, and Apache Druid.

• Identify database bottlenecks and implement performance improvements.

• Collect, integrate, and process structured and unstructured data from databases, APIs, IoT devices, and streaming sources.

• Apply machine learning techniques, including pattern recognition, text mining, and clustering, to analyse large datasets.

• Optimise data storage formats, including Parquet, and improve query performance.

• Support data analysis, reporting, and dashboard development.

• Collaborate with data scientists, technical teams, and business stakeholders to deliver accessible, reliable, and high-quality data.

Technical Skills & Environment

Key Technical Requirements

• Strong knowledge of AWS S3 and AWS Redshift.

• Solid experience with SQL and NoSQL databases.

• Hands-on programming experience with Rust.

• Knowledge of PyTorch and machine learning applications.

• Strong understanding of networking protocols, particularly TCP/IP and DNS.

• Good understanding of OLAP and analytical data processing.

Additional Technologies & Environment

• AWS Services: Glue, Athena, Kinesis, Bedrock

• Databases: DynamoDB, MySQL, ClickHouse, Apache Druid

• Programming: Python, SQL, Rust

• Machine Learning: Keras, PyTorch, scikit-learn

• Operating Systems: Linux/Unix

• Data Engineering: ETL pipelines, distributed architectures, data storage optimisation, Parquet

• Networking: TCP/IP, DNS, SMTP, HTTP

• Analytics: Data visualisation, reporting, and dashboard development

Your Profile

• Bachelor's or Master's degree in Computer Science, IT, Engineering, or a related technical field.

• At least 3 years of professional experience as a Data Engineer or in an equivalent data engineering role.

• Proven experience working with large datasets, distributed architectures, and data processing solutions.

• Experience developing and optimising data pipelines and database performance.

• Experience working with time-series or numerical datasets, ideally in the water, energy, utilities, or public sectors.

• Strong analytical and problem-solving abilities.

• Autonomous, proactive, and comfortable working in Agile environments.

• Excellent communication and collaboration skills.

• Fluent English, both written and spoken.

• EU nationality or an already valid Luxembourg work permit.

Working Conditions

• Location: Luxembourg

• Contract: Freelance assignment

• Duration: Initial 6-month contract, renewable

• Start: As soon as possible

• Work Arrangement: On-site in Luxembourg, with one day of remote work per week

• Sector: Public Sector

Interested?

If you are a Data Engineer with strong AWS, database, and machine learning expertise, looking for your next freelance assignment in Luxembourg, we would be happy to hear from you.

Apply now to discuss this opportunity!