fb-pixel

Location

Poland

Rate

$61  / per hour

Years of experience

10+

About

As a seasoned software engineer with a strong focus on big data and machine learning, I have honed my skills in a variety of programming languages including Scala, Java, Python, and Haskell. My expertise extends to platforms such as Linux and Windows, and I have significant experience with both relational and NoSQL databases like PostgreSQL, Cassandra, and Hadoop. My professional journey began as a Junior Java Developer at CoCoNet Polska, where I designed and implemented internet banking solutions. I then advanced to roles at Adpilot and Cloud Technologies, where I specialized in creating and enhancing high-performance Real Time Bidding (RTB) systems. At So1, I developed a system for smart retail promotions, further solidifying my skills in Scala, Java, and AWS. In my current role as a Senior Big Data Scala Engineer at GetInData, I design and create data pipelines using Data Vault architecture. I've developed a Spark library to generate Data Vault entities in Data Lake, significantly reducing production time. My work includes improving CDC ETL Data Pipelines with tools like Debezium and NiFi, and I have created Scala-based tools for monitoring and automatic fixing of these pipelines. Additionally, I have implemented data lineage with Atlas and facilitated incremental data replication between Hive warehouses. My educational background includes a Master's and Bachelor's degree in Computer Science from the University of Warsaw, where I was actively involved in activities such as the .Net group and Geek Club.

Tech Stack

Scala, C, C++, Cassandra, Hadoop, Haskell, Java, Linux, Lua, PostgreSQL, Python, R

Experience

  • Designing and creating data pipelines in Data Vault architecture.
  • Developing a Spark library to generate Data Vault entities in Data Lake ,reducing production time from months to days.
  • Designing, creating, and improving CDC ETL Data Pipelines using Debezium and NiFi.
  • Creating a tool in Scala for monitoring, verification, and automatic fixing of CDC data pipelines.
  • Refactoring NiFi data pipelines to event-based, enabling easier process management, monitoring, and auditing.
  • Creating and improving high-performance Real Time Bidding (RTB) systems.
  • Developing a system for smart retail promotions.

Employment history

Senior Big Data Scala & Engineer, GetInData March 2022 - Present 2024
  • Designing and creating data pipelines in Data Vault architecture
  • Created a Spark library to generate Data Vault entities in Data Lake
  • Reduced Data Pipeline production time from months to days by creating common library.
  • Designing creating and improving CDC ETL Data Pipelines using Debezium and NiFi.
  • Created tool in Scala for monitoring, verification and automatic fixing of CDC data pipelines.
  • Refactored NiFi data pipelines to event based, which enabled easier process managment, monitoring and auditing.
  • Enabling data lineage by adding Atlas in various pipelines.
  • Created tool based on ReAir for incremental data replication between two Hive warehouses
Senior Software Engineer, So1 November 2020 - February 2022
  • Developed a system to optimize and automate retail promotions using Scala, Java, and Python.
  • Implemented and maintained data processing pipelines with Akka, Kafka, and MySQL.
  • Leveraged AWS services such as S3 and Redshift for storage and data processing, and managed deployments with Jenkins and Ansible.
Senior Software Engineer, Cloud Technologies January 2018 - October 2020
  • reated and improved RTB systems using Scala, Java, and Python to ensure high performance and reliability.
  • Worked with Redis, Cassandra, and Aerospike for real-time data processing and storage.
  • Utilized Hadoop and Spark for big data processing and analytics, following BDD/TDD methodologies for development.
Software Engineer, Adpilot February 2016 - January 2018
  • Developed and optimized RTB systems using Scala, Java, and Python to enhance performance and scalability.
  • Employed Redis and Cassandra for data storage and retrieval, ensuring efficient data management.
  • Used Jenkins and Ansible for continuous integration and deployment, along with tools like SBT, Maven, and Git for build and version control.
Junior Java Developer, CoCoNet Polska May 2015 - January 2016
  • Developed banking software for corporate customers using J2EE, Spring, and Hibernate.
  • Deployed and managed applications on Tomcat servers, ensuring smooth operation and performance.
  • Utilized SVN for version control and Jira for project management, ensuring efficient tracking and collaboration.

Education history

University of Warsaw 2014 - 2016 Faculty of Mathematics, Informatics and Mechanics,
Masters’s Degree in Computer Science
University of Warsaw 2011 - 2014 Faculty of Mathematics, Informatics and Mechanics,
Bachelor’s Degree in Computer Science
I Kraszewski High School 2008 - 2011 extended mathematics, physics and computer science
Download profile as PDF

We’ve helped 83 clients with IT recruitment and software development.

Read about a few of them below...

DevsData LLC Reviews 5.0 stars 37 reviews
Powered byClutch logo
Powered byClutch logo
See more testimonials
Similar blind CVs/resumes
Poland

Production Support Engineer Resume

My expertise extends to working with databases and I am familiar with DevOps tools
Support-icon
Support
Hibernate-icon
Hibernate
Java-icon
Java
JavaScript-icon
JavaScript
Oracle
Spring Framework
Rate $17  /  per hour
Poland

Data Architect Resume Sample

Experienced tech and team lead
Big Data-icon
Big Data
Apache Spark
AWS-icon
AWS
Hadoop
Python-icon
Python
Scala-icon
Scala
Scrum-icon
Scrum
SQL-icon
SQL
Rate $49  /  per hour
Poland

QA Analyst Resume Sample

I have gained extensive experience in quality assurance and software testing
Quality Assurance
AWS-icon
AWS
Jenkins-icon
Jenkins
MySQL-icon
MySQL
PHP-icon
PHP
Python-icon
Python
Rate $28  /  per hour
Argentina

Retool Developer Resume Sample

Deeply devoted to the study of programming technology
Retool
Power BI
Python-icon
Python
SQL-icon
SQL
Tableau-icon
Tableau
Rate $20  /  per hour
Italy

Cloud Architect Resume Sample

Experienced Cloud Solution Architect skilled in AWS, Terraform, serverless architectures, and team leadership.
AWS Cloud
Amazon S3
AWS-icon
AWS
Docker-icon
Docker
DynamoDB
Java-icon
Java
JavaScript-icon
JavaScript
MongoDB-icon
MongoDB
MySQL-icon
MySQL
PostgreSQL-icon
PostgreSQL
Python-icon
Python
Redis-icon
Redis
Terraform
Typescript-icon
Typescript
Rate $37  /  per hour
Italy

MySql DBA Resume Sample

An experienced professional in the IT field.
MySQL-icon
MySQL
Apache
Bash-icon
Bash
C-icon
C
Java-icon
Java
JavaScript-icon
JavaScript
JQuery-icon
JQuery
Oracle
PL/SQL
PostgreSQL-icon
PostgreSQL
SQL Server
Rate $15  /  per hour
Poland

Agile Business Analyst Resume Sample

I bring over a decade of expertise as a Product Manager and Team Leader
Business Analyst (BA)
AI
Figma-icon
Figma
Google Analytics
Jira
Machine Learning
Rate $40  /  per hour
Poland

Azure Cloud Architect Resume Sample

Senior Software Developer with extensive experience in .NET, Azure, DevOps, microservices, and team leadership.
Azure-icon
Azure
Agile
Angular-icon
Angular
ASP.NET
C#-icon
C#
Docker-icon
Docker
Git-icon
Git
Kubernetes-icon
Kubernetes
Rate $50  /  per hour
Poland

Nocode Developer Resume Sample

During my career, I've held various roles in product marketing and management
Management-icon
Management
Manager
Marketing
Rate $28  /  per hour

I agree to and accept that DevsData LLC will provide better user experience by collecting, analyzing and cataloging information about Internet electronic addresses that I have connected with my devices and about the type of my devices (such as the type and version of software) as well as by making automatic decisions (not involving sensitive data). The agreement applies for the legally binding period, or until either the user or DevsData LLC withdraws from the agreement. Withdrawing from the agreement will result in removing the user's data. Please see our privacy policy.

We use cookies to provide the best experience for you. >More about cookie policyarrow

Book a call with our team

For software development projects, minimum engagement is $15,000.

whatsapp
Prefer email?
Quote mark

Best back-end engineers I've ever worked with...​

“I interviewed about a dozen different firms. DevsData LLC is truly exceptional – their backend developers are some of the best I’ve ever worked with. I’ve worked with a lot of very well-qualified developers, locally in San Francisco, and remotely, so that is not a compliment I offer lightly. I appreciate their depth of knowledge and their ability to get things done quickly. “

Avatar

Nicholas Johnson

CEO OF ORANGE CHARGER LLC;

MENTOR AT YCOMBINATOR

Success

Thank you


We'll get back to you within 1 business day.