Rui Lobo
Software & Data Engineer
About
I am a Dublin-based Software and Data Engineer who owns 10+ Apache Flink streaming applications in production. I started out building full-stack web applications with Python and Django, and today I design and run large-scale data systems in Java and AWS. I focus on the problem first — the language is something I pick up when the problem needs it.
End-to-End Delivery
Problem Solving & Root Cause Analysis
Mentoring & Technical Leadership
Adaptability & Fast Learner
Streaming
Apache Flink, Kafka
Batch & ETL
Spark, Databricks, AWS Glue
Cloud & Infra
AWS, Terraform
Practices
Git, CI/CD, Agile, SonarQube, Snyk
Java
Python
Apache Flink
Apache Kafka
Apache Spark
AWS
SQL
Django
Experience & Education
Big Data Engineer · Flutter UKI
Dublin · 2021 – Present- Progressed from feature development to leading end-to-end delivery — defining technical architecture, setting timelines, and coordinating across QA, DevOps and Data Science.
- Own 10+ Apache Flink streaming applications in production; migrated them from on-premises to AWS across the full pipeline — infrastructure (Terraform, EC2), application code (Java, Flink, Kafka), storage (DynamoDB, HBase), and monitoring (CloudWatch, Grafana).
- Led the Real-Time Tournament Overlay (RTO) project — new features, improved reliability, and ML-model integration — and introduced the team's delivery standards (unit tests, Jira planning, documentation, QA) that became the reference for later projects.
- Take ownership of production issues, performing root-cause analysis and fixes for memory leaks and latency bottlenecks; enforce code quality with Snyk and SonarQube.
- Mentor engineers, run code reviews, and act as the team's go-to person for technical questions.
MSc Applied Software Development · CCT College Dublin
Dublin · 2021AWS Training
2022 – 2025Personal Projects
Bakery Management
A full-stack Bakery Management System I designed and run in production — Django + PostgreSQL backend, JavaScript/Bootstrap front end. Covers authentication, inventory and supplier management, recipe costing, and margin calculations. I'm now extending it with a Spark/Databricks batch microservice that enriches its historical data with cost-trend and demand insights.
DevXpand
DevXpand is a learning platform for developers. Features: Administrative area, in which the courses will be created and inserted the didactic material, such as videos and documents. Student area being possible to view the enrolled courses; Q&A forum for each course
BlueBuilding
Web application that automatically creates cryptocurrency's reports. This is a web application project that allows the user to create a report on a specific cryptocurrency. The application collects a variety of information and compiles it into a single report.
Exchange Rate Prediction Model
Exchange rate forecast model using the CRISP-DM model and presented using Jupyter Notebook. This is an application to predict the euro exchange rate. It uses some data mining tools to predict the exchange rate for the next day.
Twitter - Sentiment Analysis
The software uses Twitter Data to develop Sentiment Analysis of key words. It analyses all tweets posted in English since April 2020 that contain the specified keywords. Each tweet is classified (positive, neutral or negative). It also makes a word cloud with the words most related to the keywords.