Senior Big Data Engineer

  • Warsaw
  • Applications have closed

Website DevsData LLC

Job summary

You will engineer solutions to support our data driven decisions. You will be working with our analysts and data scientists to deliver key data that will be used to improve customer satisfaction.  If you enjoy working with a modern data tech stack and are curious to leverage technology to inform business decisions, then this is the right job for you.

In this role, you will:

  • Work closely with Data owners to understand the data needs, define, scope and plan new product features
  • Build aggregates and rollups to enable Data Analysts to do deep dives into our wealth of proprietary data
  • Be accountable for operational efficiency and be proactive in monitoring data pipelines
  • Identify areas to improve architecture, application design and scalability in our existing data warehousing architecture, which is built with Fivetran, Postgres, ECS, and Python
  • Make smart platform and engineering decisions based on data analysis and collaboration
  • Design, build, deploy, manage new data models and complex ETL/ELT pipelines into production
  • Manage and own our massively scaling datasets
  • Ensure unit test coverage and promote code quality
  • Research new tools and technologies applicable to new and existing use cases
  • Some technologies we use that you should be comfortable with SQL, BigQuery, Python, Fivetran, ECS, SNS, SQS, Cloudwatch, Terraform, PostgreSQL, Bash

You should:

  • Have bachelor’s degree in Computer Science, Computer Engineering, or similar discipline (or equivalent experience); and prior experience in software engineering or data
  • Be abile to communicate directly with both technical and non-technical stakeholders
  • Understand the tradeoffs between structured vs unstructured data models
  • Have experience working with data warehouses, NoSQL and relational databases
  • Be great at writing SQL
  • Have experience with cloud infrastructures, specifically AWS

Nice to have:

  • Understanding of dimensional modeling techniques (e.g. relational vs. star)