Location
PolandRate
Years of experience
14+About
I am a Senior Data Engineer with extensive experience in developing and optimizing ETL processes, data modeling, and database design. Currently, I work at Appriss, where I analyze, design, and implement custom Python ETL processes to enhance data ingestion and performance. My role involves mapping client data to the Appriss Retail Data Model (ARDM) format, migrating internal processes to Azure, and utilizing Docker to create APIs for data access from Greenplum DB. Previously, as a Technical Consultant at Appriss, I designed SQL databases, optimized SQL queries, and integrated various data ingestion methods, ensuring smooth data transformation and importation into Appriss Secure. Prior to Appriss, I was a Software Developer at OSG Records Management, where I developed applications for processing and managing scanned documents, integrated systems for importing and exporting data, and optimized SQL Server databases. My earlier roles include a Software Developer position at the University of Warsaw, working on a project for Samsung, and serving as a Programming Instructor. I hold a Master's degree in Computer Science from the University of Warsaw and have completed specialized studies in Big Data at the Polish-Japanese Academy of Information Technology. My technical skills include Python, ETL, Azure, PostgreSQL, Greenplum, C#, and T-SQL, and I hold multiple Microsoft certifications in Azure and SQL Server technologies.Tech Stack
SQL, Azure, ETL, PostgreSQL, PythonExperience
- Custom Python ETL Processes: Analyzing, designing, and implementing custom Python ETL processes to enhance data ingestion and performance at Appriss.
- Azure Migration and Optimization: Designing and migrating internal processes to Azure, utilizing Azure VMs and Greenplum on Azure to improve scalability and efficiency.
- Data Mapping and Modeling: Mapping client data to the Appriss Retail Data Model (ARDM) format, ensuring accurate and consistent data transformation.
- Database Design and SQL Optimization: Designing SQL databases, optimizing SQL queries, and configuring SQL Server settings to enhance performance and efficiency during the tenure as a Technical Consultant at Appriss and Software Developer at OSG Records Management.
- Integration and API Development: Developing and maintaining APIs using Docker and Greenplum DB, and integrating various data ingestion methods such as queues, SFTP, and Webservices to ensure seamless data access and transformation.
Employment history
– Analyzing, designing and preparing custom python ETL processes for data ingest
– improving performance of internal python solutions
– mapping client’s data to ARDM (appriss retail data model) format
– designing and moving internal processes to Azure (using Azure VMs and Greenplum on Azure)
– preparing docker with API for accessing data from Greenplum DB
– analysing and designing ETL processes for ingesting client’s data
– designing SQL DBs and optimizing SQL queries (indexes, queries improvements, SQL Server settings change)
– preparing ETL processes
– integrating with client’s system to ingest data: queues, SFTP, Webservices
– transforming and importing data to Appriss Secure
– configuration Appriss Secure according to client’s needs
– preparing application for processing paper documents: scanning (TWAIN, ISIS), files importing, OCR using ABBYY Engine, manual indexing missing data, export according to clients’ requirements e.g. multipage tiff files, pdfs with text layer, xml files, Excel files, WCF Services
– analysis and designing of processes for documents management received from clients
– preparing applications for importing data from client e.g. www web sites, WCF Services, application for downloading data from FTP
– integration with clients’ systems for importing and exporting data
– preparing applications and reports for internal company’s needs, integration of OSG’s internal systems
– developing and optimizing systems for processing scanned documents
– SQL database design, administering SQL Servers, optimization of SQL queries (indexes, queries corrections, adjustment of SQL Server)
Short description:
project for Samsung company, preparing server for testing IMS architecture for smartphones
Short description:
I was responsible for conducting compensatory classes of programming for first year students