fb-pixel

Location

Poland

Rate

$65  / per hour

Years of experience

10

About

I am an accomplished Big Data Developer with a robust background in creating and managing data solutions using Java, Python, and Scala. I have deep expertise in tools such as Apache Spark, Kafka, and AWS, and am skilled in both ETL and real-time data pipeline development. My career is marked by a commitment to merging technical prowess with business objectives to deliver strategic data architectures. Currently, I lead a team of data engineers at The Stepstone Group Polska, where I focus on fostering a collaborative environment, coaching, and mentoring team members, and staying abreast of the latest trends in big data and cloud technologies. In my role as Chapter Leader for Data Development, I build communities for data engineers, implement best practices, and conduct technical workshops. I have significant experience in developing ETL/ELT pipelines, designing data marts, and creating PowerBI dashboards. My work includes preparing automatic data quality reports, creating REST services on AWS, and closely collaborating with product owners and data science teams. I have successfully led projects such as developing a data quality rule-based framework and a framework to speed up ETL pipeline creation. My technical stack includes MLOps, Terraform, Airflow, and various programming languages, demonstrating my versatility and depth of knowledge in the field.

Tech Stack

Big Data, Airflow, AWS, Data modelling, ETL, GraphQL, Java, Kafka, MLOps, Python, SAS programming, Scala, Software design, Spark, SQL, Terraform

Experience

  • Developing ETL/ELT Pipelines: Creating and managing ETL/ELT pipelines in Apache Spark, ensuring efficient data processing and transformation.
  • Real-Time Pipeline Development: Developing real-time data pipelines using Kafka, allowing for timely data streaming and processing.
  • Process Scheduling in Airflow: Managing and scheduling processes in Apache Airflow, including the development of custom operators and sensors.
  • Data Modelling and Analysis: Designing data marts and global data domains for data platforms using Domain-Driven Design (DDD) principles.
  • Creating REST Services on AWS: Developing RESTful services on AWS, facilitating seamless data integration and access.
  • Technical Leadership and Mentorship: Coaching and mentoring team members, building a community for data engineers, and leading tech workshops to promote best practices.
  • Collaborating with Data Science Teams: Working closely with data science teams and product owners to develop new features and ensure alignment with business goals.

Employment history

Chapter Lead for Data Development, The Stepstone Group Polska 2022 - Present

– Building a community for data engineers
– Working on best practices, development and training plans
– Heavy weight on coaching and mentoring
– Conducting tech workshops

Staff Big Data Developer, The Stepstone Group Polska 2022 - Present

– Technology Stack: MLOps, Terraform, Airflow, Scala, Java, Python, Graph databases, SQL, ETL, AWS, Spark, Kafka, Data modelling

– Data pipelines
– Developing ETL/ELT pipelines in Spark
– Developing real time pipelines in Kafka
– Process scheduling in Airflow
– Developing custom operators/sensors in Airflow
Data modelling & analysis
– Designing data marts
– Designing global domains for data platform with DDD
– Preparing PowerBI dashboards
– Developing automatic data quality reports
– Creating REST services on AWS
– Creating POCs for emerging tech – e.g. Neo4J, GraphQL, MLFlow
– Close cooperation with product owner for new feature
– Close cooperation with data science teams
– Talent recruitment and team members coaching
– Implementing cross team best practices, tools & frameworks

Example projects :
– Customer service reporting data mart
– Graph based company normalization pipeline
– GUI for ML model deployment
– Data quality rule based framework
– Framework for speedup of ETL pipeline creation (AWS Glue/Spark)
– Data mart & reporting for Redshift usage

Senior Big Data Developer, The Stepstone Group Polska 2019 - 2022

– Creating and managing efficient ETL/ELT pipelines to ensure seamless data processing and transformation.
– Building and maintaining real-time data pipelines using Kafka to support timely data streaming and processing.
– Managing and scheduling processes in Apache Airflow, including the development of custom operators and sensors.
– Designing data marts and global data domains for data platforms using Domain-Driven Design (DDD) principles.
– Developing RESTful services on AWS to facilitate seamless data integration and access.

Big Data Developer, The Stepstone Group Polska 2016 - 2019

– Creating and managing efficient ETL processes using SAS to ensure seamless data extraction, transformation, and loading.
– Designing and implementing end-to-end and integration tests to ensure the quality and reliability of data processes.
– Developing tools to generate synthetic data for testing and development purposes.
– Leading and contributing to the data integration efforts for a bank’s enterprise fraud management system.
– Working closely with data science teams to support new feature development and ensure data quality and integrity.

Junior Big Data Developer, The Stepstone Group Polska 2015 - 2016

– Supporting the creation and maintenance of efficient ETL/ELT pipelines using Apache Spark.
– Assisting in the development and management of real-time data pipelines using Apache Kafka.
– Participating in designing data models and conducting data analysis to support business needs.
– Assisting with scheduling data processing tasks using Apache Airflow.
– Working closely with senior developers to learn best practices and gain hands-on experience in big data technologies.

Associate Software Engineer, Accenture 2014 - 2015

– Technology Stack: Data engineering, SAS programming
– Creating ETL processes in SAS
– Preparing automated e2e, integration tests
– Creating data generation tools
– Main project – Data integration for bank enterprise fraud management system

Education history

Warsaw University of Technology 2010 - 2014 Bachelor's degree - Electrical and Computer Engineering
Download profile as PDF

We’ve helped 83 clients with IT recruitment and software development.

Read about a few of them below...

DevsData LLC Reviews 5.0 stars 37 reviews
Powered byClutch logo
Powered byClutch logo
See more testimonials
Similar blind CVs/resumes
Poland

Kubernetes DevOps Resume Sample

Specialized in automation, cloud solutions, and container technologies
Kubernetes-icon
Kubernetes
AWS-icon
AWS
Azure-icon
Azure
Bash-icon
Bash
GCP
Python-icon
Python
Rate $55  /  per hour
Poland

OpenCV Computer Vision Engineer Resume

I am a Computer Vision Engineer
Python-icon
Python
Bash-icon
Bash
C#-icon
C#
C++-icon
C++
Unity3D
Rate $33  /  per hour
Poland

Network Security Engineer Resume Sample

I refined my skills in IT Security and infrastructure management
Network
Cloud-icon
Cloud
Network Administrator
Python-icon
Python
Splunk
Rate $32  /  per hour
Poland

SQL Data Analyst Resume Sample

Data Analyst skilled in SQL, Python, and ETL with a track record of boosting productivity and efficiency.
SQL-icon
SQL
ETL
Git-icon
Git
JavaScript-icon
JavaScript
MS Excel
Numpy-icon
Numpy
Pandas-icon
Pandas
Power BI
Python-icon
Python
Rate $38  /  per hour
Poland

NOC Engineer Resume Sample

Experienced DevOps Engineer and Node.js Developer skilled in network management and virtualization.
Linux administrator
Ansible
AWS-icon
AWS
Backend
Docker-icon
Docker
GCP
Java-icon
Java
JavaScript-icon
JavaScript
Kubernetes-icon
Kubernetes
Network Administrator
Node.js-icon
Node.js
Terraform
Rate $39  /  per hour
Turkey

Fractional CTO Resume Sample

Experienced Data Engineer and CTO specializing in ML, cloud solutions, and bioinformatics.
CTO
AWS-icon
AWS
Azure-icon
Azure
Bioinformatics
Data Engineering
ETL
JavaScript-icon
JavaScript
Kafka
Kubernetes-icon
Kubernetes
Python-icon
Python
Rate $72  /  per hour
Poland

IAM Analyst, Identity and Access Management Resume Sample

Experienced IT services leader specializing in CyberSecurity and Managed Security Services delivery.
IAM
Apache
Cybersecurity
DevOps-icon
DevOps
DNS
IT Consultant
ITIL
Linux-icon
Linux
MySQL-icon
MySQL
Network Administrator
PHP-icon
PHP
WordPress-icon
WordPress
Rate $32  /  per hour
Poland

Service Desk Analyst Resume Sample

Experienced IT Service Desk Analyst with strong skills in Office 365, scripting, and virtual machine management.
Service Desk
Confluence
Jira
Microsoft 365
Powershell
Remote Desktop Protocol (RDP)
VMware
Rate $24  /  per hour
Poland

Technical Lead, Tech Lead Resume Sample

Experienced AI and .NET developer with strong leadership and R&D skills in diverse industries.
Lead
.NET-icon
.NET
AI
ITIL
MS SQL
Scrum-icon
Scrum
Rate $60  /  per hour

I agree to and accept that DevsData LLC will provide better user experience by collecting, analyzing and cataloging information about Internet electronic addresses that I have connected with my devices and about the type of my devices (such as the type and version of software) as well as by making automatic decisions (not involving sensitive data). The agreement applies for the legally binding period, or until either the user or DevsData LLC withdraws from the agreement. Withdrawing from the agreement will result in removing the user's data. Please see our privacy policy.

We use cookies to provide the best experience for you. >More about cookie policyarrow

Book a call with our team

For software development projects, minimum engagement is $15,000.

whatsapp
Prefer email?
Quote mark

Best back-end engineers I've ever worked with...​

“I interviewed about a dozen different firms. DevsData LLC is truly exceptional – their backend developers are some of the best I’ve ever worked with. I’ve worked with a lot of very well-qualified developers, locally in San Francisco, and remotely, so that is not a compliment I offer lightly. I appreciate their depth of knowledge and their ability to get things done quickly. “

Avatar

Nicholas Johnson

CEO OF ORANGE CHARGER LLC;

MENTOR AT YCOMBINATOR

Success

Thank you


We'll get back to you within 1 business day.