fb-pixel

Location

Poland

Rate

$20  / per hour

Years of experience

5+

About

I am an experienced Data Engineer with over five years of diverse experience in Information Technology. My expertise includes the development and implementation of various Big Data applications, primarily in cloud environments, and fostering a DevOps culture with CI/CD practices. I excel in both team settings and independent work, thanks to my strong communication skills and problem-solving abilities. I have successfully designed and implemented complex ETL pipelines, automated data processing, and created CI/CD pipelines in Azure DevOps, significantly improving efficiency and reliability. My career includes roles at BI4ALL, Procter & Gamble, Atos, and Nissan Sales CEE, where I developed scalable Big Data applications, optimized databases, and built data pipelines using tools like Databricks, Azure, and AWS. I hold multiple certifications, including Databricks and Microsoft credentials, and a Master’s degree in Computer Science with a specialization in Data Engineering from Warsaw University of Technology. Additionally, I am proficient in several programming languages, databases, and data visualization tools, and have a keen interest in automotive, sports, and emerging technologies like blockchain and cryptocurrencies.

Tech Stack

Cloud, AWS, Azure, Big Data, Docker, Python, SQL

Experience

  • Designed and implemented complex ETL pipelines using Databricks (Python, PySpark, Spark SQL) and Azure Data Factory to efficiently ingest and transform data from multiple sources into a Data Lake and Azure SQL Database.
  • Developed and maintained a highly scalable Big Data application using Python, Spark SQL, PySpark, and deployed it on Azure Kubernetes Service with Spark pods implementation, handling 100 million records per processing.
  • Built and managed Data Pipelines and Jobs with Databricks (Delta Live Tables, PySpark, Python, SQL) and Azure Data Factory to streamline data processing.
  • Created CI/CD pipelines in Azure DevOps to automate development implementation with Databricks and Azure Data Factory, enabling faster and more reliable deployment of data pipelines.
  • Led a team of Data Engineers in refactoring the application architecture and implementing the Big Data App solution, utilizing Agile methodology.
  • Optimized PostgreSQL and MSSQL databases to improve query performance and efficiency in data processing tasks.
  • Automated data processing and improved efficiency using Databricks Jobs and Data Pipelines (DLT) with Spark, enhancing overall data processing accuracy.

Employment history

Data Engineer, BI4ALL February 2023 - Present

● Successfully designed and implemented a complex ETL pipeline usingDatabricks(Python,PySpark,SparkSQL)andAzureData Factory to efficiently ingest and transform data from multiple sources into a Data Lake and Azure SQLDatabase.
● Automated data processing using Databricks Jobs and Data Pipelines (DLT), improving overall efficiency and accuracy of the data processing with Spark.
● Created CI/CD pipelines in Azure DevOps to automate developmentimplementationwithDatabricksandAzureData Factory, enabling faster and more reliable deployment of data pipelines.

DevOps / Data Engineer / IT Manager, Procter & Gamble March 2022 - February 2023

● Developed and maintained a highly scalable Big Data application using Python, Spark SQL, PySpark and deployed it on Azure Kubernetes Service with Spark pods implementation (100M records per processing)
● Created a Docker-based app development environment (Python, Spark, YAML) and integrated it with Redis Cache for efficient app development.
● Created customlog queries usingAzureLogAnalyticsQuery Language (KQL) to search, filter, and analyze app performance.
● Ingested data with Python, PySpark, Spark SQL and optimised query, processing using Spark.
● Optimized PostgreSQL database to improve query performance.
● Built and managed Data Pipelines and Jobs with Databricks (Delta LiveTables,PySpark,Python,SQL) and Azure DataFactory to streamline data processing.
● BuiltandmaintainedCI/CDpipelinesusingAzureDevOpsand managed infrastructure environments with Terraform.
● Led a team of 2 Data Engineers in the refactoring of the application architecture and implementation of the Big Data App solution, utilizing Agile methodology.

Junior Data Scientist, Atos August 2021 - February 2022

● Designed and implemented an ETL pipeline withDatabricks (Python, Pyspark, Spark SQL) and Azure Data Factory to load data into MySQL database.
● Created reports and dashboards with Tableau and PowerBI for data-driven decision-making.
● Assisted increating MachineLearningmodelsforpredictive analytics.
● UtilizedAzureSynapseAnalyticsandAzureLogAnalyticsto troubleshoot and resolve data processing issues

Data Engineer, Nissan Sales CEE September 2019 - August 2021

● Built scripts using Python, PySpark and Spark SQL to schedule Databricks Jobs for financial calculations and task automation.
● Developed and maintained data models in MSSQL database, migrating to Azure SQL Database.
● Built data pipelines with Azure DataFactory for data processing.
● Implemented Azure Functions with Python and Spark for data extractions.
● BuiltAzureDevOpsprojectstructure andCI/CDpipelinesfor consistent deployment of code and infrastructure. Integrated environments

Education history

Warsaw University of Technology June 2023 Master of Engineering: Computer Science - Specialization in Data Engineering.
● Master's thesis: "NoSQL databases in Big Data solutions".
Warsaw University of Technology January 2022 Bachelor of Engineering: Electrical Engineering
● Engineering's thesis: "Project of software to automatically select electric cars".
● Head of Software department in Scientific Association Proton Dynamic and Aria.

We've delighted 83 clients with our IT recruitment and software development services.

DevsData LLC Reviews 5.0 stars 37 reviews
Powered byClutch logo
Powered byClutch logo
See more testimonials
Similar blind CVs/resumes
Poland

Swagger Developer Resume Sample

Senior Java Software Developer skilled in backend architecture, database management, and team mentoring.
Swagger-icon
Swagger
Angular-icon
Angular
Bash-icon
Bash
Docker-icon
Docker
Git-icon
Git
Hibernate-icon
Hibernate
Java-icon
Java
JavaScript-icon
JavaScript
Kafka
Kubernetes-icon
Kubernetes
Microservices
MySQL-icon
MySQL
Oracle
PL/SQL
Python-icon
Python
Spring Framework
Rate $25  /  per hour
Poland

CEO Resume Sample

A CEO over 15 years of leadership experience.
ERP
Asana
AWS-icon
AWS
CRM
Microsoft Azure
MS Office
Oracle
Salesforce
SAP
Slack
Rate $25  /  per hour
Poland

Rest API Developer Resume Sample

Full-stack developer with experience in building REST APIs, React front-ends, and integrating cloud services.
REST APIs
API-icon
API
AWS-icon
AWS
CSS-icon
CSS
Express.js-icon
Express.js
Firebase
GraphQL-icon
GraphQL
HTML-icon
HTML
JavaScript-icon
JavaScript
MongoDB-icon
MongoDB
NestJS
PostgreSQL-icon
PostgreSQL
React-icon
React
React.js
REST
Rate $17  /  per hour
Ukraine

Senior Android Developer Resume Sample

Senior Android Developer with expertise in Kotlin, app architecture, and complex backend integration.
Android-icon
Android
AWS-icon
AWS
C++-icon
C++
Git-icon
Git
Java-icon
Java
Jenkins-icon
Jenkins
Kotlin-icon
Kotlin
Mobile-icon
Mobile
Rate $15  /  per hour
UK

C Level Resume Sample

Experienced CTO with 20+ years in AI, data science, and tech leadership, driving innovation, growth, and sustainability.
Management-icon
Management
AWS-icon
AWS
Azure-icon
Azure
C#-icon
C#
C++-icon
C++
CSS-icon
CSS
Elasticsearch
Git-icon
Git
Github
HTML-icon
HTML
Java-icon
Java
JavaScript-icon
JavaScript
Jenkins-icon
Jenkins
MongoDB-icon
MongoDB
PHP-icon
PHP
Project Management
Project Planning
Python-icon
Python
SQL-icon
SQL
Rate $60  /  per hour
Poland

Chief Technology Officer Resume Sample

A results-driven technology executive with over a decade of experience.
Management-icon
Management
.NET-icon
.NET
Angular-icon
Angular
ASP.NET
C++-icon
C++
Docker-icon
Docker
Lead
Project Management
Python-icon
Python
React-icon
React
Rate $30  /  per hour
Poland

Work From Home Resume Sample

Senior .NET Developer with expertise in backend architecture, business analysis, and system integration.
.NET-icon
.NET
Angular-icon
Angular
ASP.NET
C#-icon
C#
Microservices
MS SQL
Typescript-icon
Typescript
Rate $15  /  per hour
Poland

Sample COO Resume

A COO with over 20 years of experience in banking.
ERP
CRM
Google Analytics
Jira
Marketing
MS SQL
Oracle
Power BI
Project Management
ServiceNow
Workday
Rate $20  /  per hour
Poland

Board Member Resume Sample

A highly experienced executive with over 20 years of leadership.
MS Office
Asana
ERP
Finance
Jira
Microsoft Excel
Oracle
Project Management
SAP
Workday
Rate $25  /  per hour

I agree to and accept that DevsData LLC will provide better user experience by collecting, analyzing and cataloging information about Internet electronic addresses that I have connected with my devices and about the type of my devices (such as the type and version of software) as well as by making automatic decisions (not involving sensitive data). The agreement applies for the legally binding period, or until either the user or DevsData LLC withdraws from the agreement. Withdrawing from the agreement will result in removing the user's data. Please see our privacy policy.

We use cookies to provide the best experience for you. >More about cookie policyarrow

Book a call with our team

For software development projects, minimum engagement is $15,000.

whatsapp
Prefer email?
Quote mark

Best back-end engineers I've ever worked with...​

“I interviewed about a dozen different firms. DevsData LLC is truly exceptional – their backend developers are some of the best I’ve ever worked with. I’ve worked with a lot of very well-qualified developers, locally in San Francisco, and remotely, so that is not a compliment I offer lightly. I appreciate their depth of knowledge and their ability to get things done quickly. “

Avatar

Nicholas Johnson

CEO of Orange Charger LLC,

Ex-Tesla Engineer,

Mentor at YCombinator

Rebecca Botvin's avatar

Rebecca Botvin Commercial Director

Tom Potanski's avatar

Tom Potanski Manager

Success

Thank you


We'll get back to you within 1 business day.