fb-pixel

Location

Poland

Rate

$61  / per hour

Years of experience

10+

About

As a seasoned software engineer with a strong focus on big data and machine learning, I have honed my skills in a variety of programming languages including Scala, Java, Python, and Haskell. My expertise extends to platforms such as Linux and Windows, and I have significant experience with both relational and NoSQL databases like PostgreSQL, Cassandra, and Hadoop. My professional journey began as a Junior Java Developer at CoCoNet Polska, where I designed and implemented internet banking solutions. I then advanced to roles at Adpilot and Cloud Technologies, where I specialized in creating and enhancing high-performance Real Time Bidding (RTB) systems. At So1, I developed a system for smart retail promotions, further solidifying my skills in Scala, Java, and AWS. In my current role as a Senior Big Data Scala Engineer at GetInData, I design and create data pipelines using Data Vault architecture. I've developed a Spark library to generate Data Vault entities in Data Lake, significantly reducing production time. My work includes improving CDC ETL Data Pipelines with tools like Debezium and NiFi, and I have created Scala-based tools for monitoring and automatic fixing of these pipelines. Additionally, I have implemented data lineage with Atlas and facilitated incremental data replication between Hive warehouses. My educational background includes a Master's and Bachelor's degree in Computer Science from the University of Warsaw, where I was actively involved in activities such as the .Net group and Geek Club.

Tech Stack

Big Data, C, C++, Cassandra, Data Engineering, Hadoop, Haskell, Java, Linux, Lua, PostgreSQL, Python, R, Scala

Experience

  • Designing and creating data pipelines in Data Vault architecture.
  • Developing a Spark library to generate Data Vault entities in Data Lake ,reducing production time from months to days.
  • Designing, creating, and improving CDC ETL Data Pipelines using Debezium and NiFi.
  • Creating a tool in Scala for monitoring, verification, and automatic fixing of CDC data pipelines.
  • Refactoring NiFi data pipelines to event-based, enabling easier process management, monitoring, and auditing.
  • Creating and improving high-performance Real Time Bidding (RTB) systems.
  • Developing a system for smart retail promotions.

Employment history

Senior Big Data Scala & Engineer, GetInData March 2022 - Present 2024
  • Designing and creating data pipelines in Data Vault architecture
  • Created a Spark library to generate Data Vault entities in Data Lake
  • Reduced Data Pipeline production time from months to days by creating common library.
  • Designing creating and improving CDC ETL Data Pipelines using Debezium and NiFi.
  • Created tool in Scala for monitoring, verification and automatic fixing of CDC data pipelines.
  • Refactored NiFi data pipelines to event based, which enabled easier process managment, monitoring and auditing.
  • Enabling data lineage by adding Atlas in various pipelines.
  • Created tool based on ReAir for incremental data replication between two Hive warehouses
Senior Software Engineer, So1 November 2020 - February 2022
  • Developed a system to optimize and automate retail promotions using Scala, Java, and Python.
  • Implemented and maintained data processing pipelines with Akka, Kafka, and MySQL.
  • Leveraged AWS services such as S3 and Redshift for storage and data processing, and managed deployments with Jenkins and Ansible.
Senior Software Engineer, Cloud Technologies January 2018 - October 2020
  • reated and improved RTB systems using Scala, Java, and Python to ensure high performance and reliability.
  • Worked with Redis, Cassandra, and Aerospike for real-time data processing and storage.
  • Utilized Hadoop and Spark for big data processing and analytics, following BDD/TDD methodologies for development.
Software Engineer, Adpilot February 2016 - January 2018
  • Developed and optimized RTB systems using Scala, Java, and Python to enhance performance and scalability.
  • Employed Redis and Cassandra for data storage and retrieval, ensuring efficient data management.
  • Used Jenkins and Ansible for continuous integration and deployment, along with tools like SBT, Maven, and Git for build and version control.
Junior Java Developer, CoCoNet Polska May 2015 - January 2016
  • Developed banking software for corporate customers using J2EE, Spring, and Hibernate.
  • Deployed and managed applications on Tomcat servers, ensuring smooth operation and performance.
  • Utilized SVN for version control and Jira for project management, ensuring efficient tracking and collaboration.

Education history

University of Warsaw 2014 - 2016 Faculty of Mathematics, Informatics and Mechanics,
Masters’s Degree in Computer Science
University of Warsaw 2011 - 2014 Faculty of Mathematics, Informatics and Mechanics,
Bachelor’s Degree in Computer Science
I Kraszewski High School 2008 - 2011 extended mathematics, physics and computer science
Download profile as PDF

We’ve helped 83 clients with IT recruitment and software development.

Read about a few of them below...

DevsData LLC Reviews 5.0 stars 37 reviews
Powered byClutch logo
Powered byClutch logo
See more testimonials
Similar blind CVs/resumes
Poland

Kubernetes DevOps Resume Sample

Specialized in automation, cloud solutions, and container technologies
Kubernetes-icon
Kubernetes
AWS-icon
AWS
Azure-icon
Azure
Bash-icon
Bash
GCP
Python-icon
Python
Rate $55  /  per hour
Poland

OpenCV Computer Vision Engineer Resume

I am a Computer Vision Engineer
Python-icon
Python
Bash-icon
Bash
C#-icon
C#
C++-icon
C++
Unity3D
Rate $33  /  per hour
Poland

Network Security Engineer Resume Sample

I refined my skills in IT Security and infrastructure management
Network
Cloud-icon
Cloud
Network Administrator
Python-icon
Python
Splunk
Rate $32  /  per hour
Poland

SQL Data Analyst Resume Sample

Data Analyst skilled in SQL, Python, and ETL with a track record of boosting productivity and efficiency.
SQL-icon
SQL
ETL
Git-icon
Git
JavaScript-icon
JavaScript
MS Excel
Numpy-icon
Numpy
Pandas-icon
Pandas
Power BI
Python-icon
Python
Rate $38  /  per hour
Poland

NOC Engineer Resume Sample

Experienced DevOps Engineer and Node.js Developer skilled in network management and virtualization.
Linux administrator
Ansible
AWS-icon
AWS
Backend
Docker-icon
Docker
GCP
Java-icon
Java
JavaScript-icon
JavaScript
Kubernetes-icon
Kubernetes
Network Administrator
Node.js-icon
Node.js
Terraform
Rate $39  /  per hour
Turkey

Fractional CTO Resume Sample

Experienced Data Engineer and CTO specializing in ML, cloud solutions, and bioinformatics.
CTO
AWS-icon
AWS
Azure-icon
Azure
Bioinformatics
Data Engineering
ETL
JavaScript-icon
JavaScript
Kafka
Kubernetes-icon
Kubernetes
Python-icon
Python
Rate $72  /  per hour
Poland

Technical Lead, Tech Lead Resume Sample

Experienced AI and .NET developer with strong leadership and R&D skills in diverse industries.
Lead
.NET-icon
.NET
AI
ITIL
MS SQL
Scrum-icon
Scrum
Rate $60  /  per hour
Poland

Active Directory Administrator Resume Sample

Experienced IT Specialist skilled in Active Directory, Windows, and cloud solutions with strong troubleshooting.
Active Directory
DNS
Powershell
Windows Server
Rate $28  /  per hour
Poland

Data Governance Analyst Resume Sample

Experienced Data Governance Analyst skilled in data quality, integration, and regulatory compliance.
Data Governance
Business Analyst (BA)
Business Intelligence
Oracle
Power BI
SQL-icon
SQL
Teradata
Rate $54  /  per hour

I agree to and accept that DevsData LLC will provide better user experience by collecting, analyzing and cataloging information about Internet electronic addresses that I have connected with my devices and about the type of my devices (such as the type and version of software) as well as by making automatic decisions (not involving sensitive data). The agreement applies for the legally binding period, or until either the user or DevsData LLC withdraws from the agreement. Withdrawing from the agreement will result in removing the user's data. Please see our privacy policy.

We use cookies to provide the best experience for you. >More about cookie policyarrow

Book a call with our team

For software development projects, minimum engagement is $15,000.

whatsapp
Prefer email?
Quote mark

Best back-end engineers I've ever worked with...​

“I interviewed about a dozen different firms. DevsData LLC is truly exceptional – their backend developers are some of the best I’ve ever worked with. I’ve worked with a lot of very well-qualified developers, locally in San Francisco, and remotely, so that is not a compliment I offer lightly. I appreciate their depth of knowledge and their ability to get things done quickly. “

Avatar

Nicholas Johnson

CEO OF ORANGE CHARGER LLC;

MENTOR AT YCOMBINATOR

Success

Thank you


We'll get back to you within 1 business day.