Location
PolandRate
$61
/ per hour
Years of experience
10+About
As a seasoned software engineer with a strong focus on big data and machine learning, I have honed my skills in a variety of programming languages including Scala, Java, Python, and Haskell. My expertise extends to platforms such as Linux and Windows, and I have significant experience with both relational and NoSQL databases like PostgreSQL, Cassandra, and Hadoop. My professional journey began as a Junior Java Developer at CoCoNet Polska, where I designed and implemented internet banking solutions. I then advanced to roles at Adpilot and Cloud Technologies, where I specialized in creating and enhancing high-performance Real Time Bidding (RTB) systems. At So1, I developed a system for smart retail promotions, further solidifying my skills in Scala, Java, and AWS. In my current role as a Senior Big Data Scala Engineer at GetInData, I design and create data pipelines using Data Vault architecture. I've developed a Spark library to generate Data Vault entities in Data Lake, significantly reducing production time. My work includes improving CDC ETL Data Pipelines with tools like Debezium and NiFi, and I have created Scala-based tools for monitoring and automatic fixing of these pipelines. Additionally, I have implemented data lineage with Atlas and facilitated incremental data replication between Hive warehouses. My educational background includes a Master's and Bachelor's degree in Computer Science from the University of Warsaw, where I was actively involved in activities such as the .Net group and Geek Club.Tech Stack
Big Data, C, C++, Cassandra, Data Engineering, Hadoop, Haskell, Java, Linux, Lua, PostgreSQL, Python, R, ScalaExperience
- Designing and creating data pipelines in Data Vault architecture.
- Developing a Spark library to generate Data Vault entities in Data Lake ,reducing production time from months to days.
- Designing, creating, and improving CDC ETL Data Pipelines using Debezium and NiFi.
- Creating a tool in Scala for monitoring, verification, and automatic fixing of CDC data pipelines.
- Refactoring NiFi data pipelines to event-based, enabling easier process management, monitoring, and auditing.
- Creating and improving high-performance Real Time Bidding (RTB) systems.
- Developing a system for smart retail promotions.
Employment history
Senior Big Data Scala & Engineer, GetInData
March 2022 - Present 2024
- Designing and creating data pipelines in Data Vault architecture
- Created a Spark library to generate Data Vault entities in Data Lake
- Reduced Data Pipeline production time from months to days by creating common library.
- Designing creating and improving CDC ETL Data Pipelines using Debezium and NiFi.
- Created tool in Scala for monitoring, verification and automatic fixing of CDC data pipelines.
- Refactored NiFi data pipelines to event based, which enabled easier process managment, monitoring and auditing.
- Enabling data lineage by adding Atlas in various pipelines.
- Created tool based on ReAir for incremental data replication between two Hive warehouses
Senior Software Engineer, So1
November 2020 - February 2022
- Developed a system to optimize and automate retail promotions using Scala, Java, and Python.
- Implemented and maintained data processing pipelines with Akka, Kafka, and MySQL.
- Leveraged AWS services such as S3 and Redshift for storage and data processing, and managed deployments with Jenkins and Ansible.
Senior Software Engineer, Cloud Technologies
January 2018 - October 2020
- reated and improved RTB systems using Scala, Java, and Python to ensure high performance and reliability.
- Worked with Redis, Cassandra, and Aerospike for real-time data processing and storage.
- Utilized Hadoop and Spark for big data processing and analytics, following BDD/TDD methodologies for development.
Software Engineer, Adpilot
February 2016 - January 2018
- Developed and optimized RTB systems using Scala, Java, and Python to enhance performance and scalability.
- Employed Redis and Cassandra for data storage and retrieval, ensuring efficient data management.
- Used Jenkins and Ansible for continuous integration and deployment, along with tools like SBT, Maven, and Git for build and version control.
Junior Java Developer, CoCoNet Polska
May 2015 - January 2016
- Developed banking software for corporate customers using J2EE, Spring, and Hibernate.
- Deployed and managed applications on Tomcat servers, ensuring smooth operation and performance.
- Utilized SVN for version control and Jira for project management, ensuring efficient tracking and collaboration.
Education history
University of Warsaw
2014 - 2016
Faculty of Mathematics, Informatics and Mechanics,
Masters’s Degree in Computer Science
Masters’s Degree in Computer Science
University of Warsaw
2011 - 2014
Faculty of Mathematics, Informatics and Mechanics,
Bachelor’s Degree in Computer Science
Bachelor’s Degree in Computer Science
I Kraszewski High School
2008 - 2011
extended mathematics, physics and computer science
We've delighted 83 clients with our IT recruitment and software development services.
Read about a few of them below...