fb-pixel

Location

Poland

Rate

$20  / per hour

Years of experience

12+

About

With over a decade of experience as a Principal Data Engineer, System Architect, and Hadoop ecosystem specialist, I have successfully led and contributed to numerous international projects across various industries, including Telco, Finance, Entertainment, Manufacturing, Pharma, and Advertisement. My expertise spans design and delivery of analytical-oriented solutions, OpenSource-based data processing, and project management methodologies such as Agile Scrum and Waterfall. Proficient in multiple programming languages and databases, I excel in architecting and implementing complex analytical platforms using cutting-edge technologies like Apache Hadoop, Apache Spark, and cloud services from Azure and AWS. In my recent projects, I've demonstrated my skills as an Architect and Data Engineer for Telcos in Germany and Poland, where I designed scalable platforms for network quality monitoring and managed data ingestion processes for multiple data sources. Additionally, I served as Lead Architect for a global truck manufacturer, designing analytical platforms for IoT sensor data analysis, with a focus on security and GDPR compliance. My extensive experience also includes roles as a Solution Architect for a global Pharma company, where I optimized historical studies data usage through a new analytical platform, and as a Team Leader and Architect for GG Network, where I spearheaded the creation of one of Poland's first big Hadoop clusters, showcasing my expertise in parallel computing and big data analytics.

Tech Stack

Teradata, Ansible, Apache, AWS, Azure, MySQL, PostgreSQL, Python, R, Scala

Experience

  • Design and Delivery of Analytical Solutions: Leading the design and delivery of analytical-oriented solutions, leveraging expertise in Big Data technologies and methodologies to meet business requirements across various industries.
  • OpenSource-Based Data Processing: Utilizing OpenSource-based data processing tools and platforms, such as Apache Hadoop and Apache Spark, to architect and implement scalable data processing solutions.
  • Project Management: Managing projects using Agile and Waterfall methodologies, ensuring timely delivery and alignment with project objectives and client expectations.
  • Data-Oriented Trainings: Delivering data-oriented trainings to enhance team skills and capabilities in data processing and analytics.
  • Architectural Design and Implementation: Architecting and implementing analytical platforms for clients in Telco, Manufacturing, Pharma, and other sectors, focusing on scalability, performance, and security.
  • Team Supervision and Collaboration: Supervising and collaborating with teams of engineers and developers to implement data ingestion processes, data marts, and other components of analytical solutions.
  • Workshop Facilitation and Roadmap Creation: Facilitating workshops with clients to document existing architecture, assess capabilities, and define recommendations and roadmaps for future analytical initiatives.

Employment history

Architect and Data Engineer, Telco in Germany March 2020 - Present

• Responsible for creating a high-scalable environment to analyze telecommunication network data logs, ensuring the platform’s ability to monitor network quality effectively.
• Implementing technologies such as Hortonworks Data Platform (HDP), Apache Spark, Elasticsearch, and Kibana to build the analytical platform.
• Collaborating closely with stakeholders and teams to integrate various components, including Spark, Elasticsearch, and ECE (Elastic Cloud Enterprise), to ensure seamless functionality.

Principal Data Engineer, Polish Telco May 2019 - March 2020

• Implementing and quality-assuring data ingestion and data mart creation processes for over 50 data sources as defined by the customer, ensuring accuracy and efficiency.
• Overseeing a team of engineers, providing guidance and supervision in DevOps tasks and data integration activities to ensure project success.
• Leveraging technologies such as HDP, HDF, Kylo, Nifi, Apache Spark, Semantic Layer, Kerberos, Ansible, and Jupyter to implement the required data processes and achieve project goals.

Lead Architect, Global Truck Manufacturer March 2017 - July 2017

• Designing an analytical platform for analyzing data from IoT sensors installed on trucks, focusing on standard use cases like risk analysis and predictive maintenance.
• Ensuring compliance with GDPR regulations by implementing a secure access layer within the platform architecture.
• Integrating various technologies such as Hadoop, HDP, Kylo, Apache Hive, Apache Nifi, Microsoft Azure, Teradata, and IBM WMQ to develop and deploy the analytical platform.

Lead Architect, Global Truck Manufacturer July 2017 - November 2017

• Analyzing the existing data system architecture across the organization, conducting workshops with key stakeholders, and preparing a target platform design and capability assessment.
• Designing a multilayered data repository to store and manage data effectively, ensuring scalability and performance.
• Delivering a detailed roadmap for the designed system, outlining steps for implementation and future enhancements.

Solution Architect / Principal Data Engineer, Global Pharma November 2016 - March 2017

• Designing a new analytical platform and processes to optimize the usage of historical studies data, including analysis of existing platform and implementing new tools and processes.
• Designing a new data lake to store and manage data effectively, including ELT processes for text analytics and structured data processing.
• Implementing technologies such as Cloudera, Hadoop, Elasticsearch, Kibana, Kylo, Nifi, Tikka, Maven, Apache Spark, Scala, Python, and Apache Hive to achieve project objectives.

Solution Architect, Scandinavian Telco October 2016 - December 2016

• Conducting workshops with customers to document the existing architecture of the analytical ecosystem and create a capabilities assessment to define recommendations and roadmap.
• Creating a concept for a centralized Data Hub (Data Lake combined with Data Warehouse), outlining architecture and capabilities required to meet business needs.
• Implementing recommendations from the capabilities assessment phase, including kerberization of the HDP cluster and ELT processes running on the cluster.

Lead Architect, Global Airline September 2016 - March 2017

• Implementing ingestion processes for the Data Lake, ensuring efficient and reliable data acquisition from various sources.
• Utilizing technologies such as CDH, Vagrant, Kylo, Apache Hive, Apache Spark, and Apache Nifi to develop and deploy the ingestion processes.
• Collaborating with stakeholders and teams to ensure alignment with project goals and requirements, and communicating progress and issues effectively.

Senior Data Engineer, Scandinavian Telco May 2016 - September 2016

• Designing an analytical ecosystem based on Teradata UDA solutions to combine Data Warehouse, Data Discovery Platform, and Data Lake implemented on Hadoop technology.
• Providing essential security measures to the analytical ecosystem, ensuring data privacy and compliance with regulations.
• Integrating technologies such as HDP, Teradata, Oracle, and Data Virtualization to achieve the desired analytical capabilities and functionalities.

Solution Architect / Senior Data Engineer, Netherlands Telco January 2016 - May 2016

• Conducting workshops with customers to document the existing architecture of the analytical ecosystem and create a capabilities assessment to define recommendations and roadmap.
• Planning and implementing recommendations from the capabilities assessment phase, including kerberization of the HDP cluster and ELT processes running on the cluster.
• Utilizing technologies such as HDP, Teradata, Oracle, and Data Virtualization to develop and deploy the recommended solutions.

Solution Architect, Teradata February 2015 - January 2016

• Working as a member of an international architecture task force to create Data Lake Design patterns using Teradata UDA stack, focusing on Storage and Data Processing layers.
• Delivering design patterns for Storage and Data Processing layers of the Data Lake, ensuring alignment with best practices and client requirements.
• Collaborating with team members and stakeholders to ensure the successful delivery and adoption of the design patterns across different projects and organizations.

Team Leader and Architect, GG Network – Polish Social Media platform April 2009 - October 2012

• Leading the creation of one of the first big Hadoop Clusters in Poland, including designing the overall platform architecture and data flow processes.
• Implementing technologies such as CDH, Apache Hive, Apache Hadoop, Spring, Python, MapReduce, Apache Flume, MySQL, PostgreSQL, and Pentaho to develop and deploy the Hadoop Cluster.
• Designing a Lambda Architecture based analytics solution, enabling real-time data processing and analytics on the Hadoop Cluster.

Education history

University of Warsaw 2003-2011 M.S. Computer Science
Download profile as PDF

We’ve helped 83 clients with IT recruitment and software development.

Read about a few of them below...

DevsData LLC Reviews 5.0 stars 37 reviews
Powered byClutch logo
Powered byClutch logo
See more testimonials
Similar blind CVs/resumes
Poland

Qlikview/Qliksense Developer Resume Sample

Senior BI/DW Engineer with 9 years of expertise in ETL, data warehousing, and BI development.
Qilk Sense
Agile
AWS-icon
AWS
Bash-icon
Bash
Business Intelligence
Informatica
Java-icon
Java
MS SQL
Obiee
Oracle
PL/SQL
Python-icon
Python
SAP
Tableau-icon
Tableau
UML
XML-icon
XML
Rate $40  /  per hour
Poland

Security Analyst Resume Sample

Cyber Security Engineer skilled in vulnerability management, incident handling, and security controls.
Cybersecurity
Agile
Azure-icon
Azure
Data Analysis
Jira
Linux-icon
Linux
Network
Scrum-icon
Scrum
SQL-icon
SQL
Tableau-icon
Tableau
Rate $30  /  per hour
Poland

Firmware Developer Resume Sample

A highly skilled Cross-site Thinking Engineer with over 10 years of experience.
Software design
Bash-icon
Bash
C-icon
C
C++-icon
C++
Docker-icon
Docker
Git-icon
Git
MySQL-icon
MySQL
Oracle
Python-icon
Python
Rate $10  /  per hour
Italy

Hardware Designer Resume Sample

An experienced hardware engineer with over 20 years of expertise.
Altera Quartus
Altium Designer
AutoCAD
Git-icon
Git
Jira
MATLAB-icon
MATLAB
Python-icon
Python
Rate $18  /  per hour
Slovakia

Microsoft Power Automate Developer Resume Sample

A dynamic and experienced Senior Software Engineering Manager.
Microsoft Power Automate
Azure DevOps
Git-icon
Git
Jira
Microsoft Teams
Power BI
Python-icon
Python
SQL Server
Rate $23  /  per hour
Serbia

Robotic Process Automation Resume Sample

A dedicated Process Automation Manager with over six years of experience.
RPA
Git-icon
Git
Jenkins-icon
Jenkins
Microsoft Excel
Microsoft Power BI
MS SQL
Python-icon
Python
SAP
ServiceNow
Rate $30  /  per hour
Poland

Delivery Manager Resume Sample

Global programs lead with expertise in Agile, ITIL, infrastructure, and service delivery management.
Agile
ITIL
Management-icon
Management
Project Management
Scrum-icon
Scrum
Rate $40  /  per hour
Poland

Filmmaker Resume Sample

Experienced filmmaker, videographer, and social media content creator specializing in commercials and ads.
Freelance
Social Media Content Creation
Rate $40  /  per hour
Poland

Help Desk Manager Resume Sample

Experienced Help Desk Manager skilled in IT support, issue diagnosis, and customer service management.
Support-icon
Support
Customer Service
ITIL
Rate $20  /  per hour

I agree to and accept that DevsData LLC will provide better user experience by collecting, analyzing and cataloging information about Internet electronic addresses that I have connected with my devices and about the type of my devices (such as the type and version of software) as well as by making automatic decisions (not involving sensitive data). The agreement applies for the legally binding period, or until either the user or DevsData LLC withdraws from the agreement. Withdrawing from the agreement will result in removing the user's data. Please see our privacy policy.

We use cookies to provide the best experience for you. >More about cookie policyarrow

Book a call with our team

For software development projects, minimum engagement is $15,000.

whatsapp
Prefer email?
Quote mark

Best back-end engineers I've ever worked with...​

“I interviewed about a dozen different firms. DevsData LLC is truly exceptional – their backend developers are some of the best I’ve ever worked with. I’ve worked with a lot of very well-qualified developers, locally in San Francisco, and remotely, so that is not a compliment I offer lightly. I appreciate their depth of knowledge and their ability to get things done quickly. “

Avatar

Nicholas Johnson

CEO of Orange Charger LLC,

ex-Tesla Engineer,

Mentor at YCombinator

Success

Thank you


We'll get back to you within 1 business day.