Data Engineering Technical Lead, SaaS Platform

Innovyze Irvine United States of America Development
Warning! Vacancy expired

Company Description

nnovyze is a leading global provider of smart water infrastructure modelling and simulation software solutions for government agencies, engineering consultants, municipalities and utilities, a $1B+ annual market opportunity in the US alone.

Our clients include the majority of the largest UK, Australasian, East Asian and North American cities, foremost utilities on all five continents, and ENR top-rated design firms. With unparalleled expertise and offices in North America, Europe, and Asia Pacific, the Innovyze connected portfolio of best-in- class product lines empower thousands of engineers to competitively plan, manage, design, protect, operate and sustain highly efficient and reliable infrastructure systems, and provides an enduring platform for customer success.

Opportunity for Impact

Innovyze operates in the water infrastructure software market which is experiencing structural growth, driven by multiple factors, including: emerging economies building water infrastructure to accommodate rapid urbanization; developed countries requiring increasingly sophisticated management of aging water resources; increasing levels of storms and floods as a result of climate change; and the need to manage the cost of water infrastructure ownership as total water infrastructure assets continue to grow.

Position

The Data Engineering Technical Lead will be responsible for Innovyze’s big data stack and pipelines. This is a key position within our SaaS development organization which is set to handle massive data scale and ground-breaking machine learning solutions. Reporting to the Director of engineering, this person will be a key player in building Innovyze’s data operations for the SaaS platform for Operational Analytics and AI.

Responsibilities:

  • Lead the development and implementation of end-to-end Data Pipelines on AWS leveraging Snowflake, Postgres and a vast number of AWS data services.
  • Effectively coach, mentor, and lead other developers in all big data matters.
  • Architect and implement complex Data Models (both relational and non-relational) in Innovze’s various data repositories across the SaaS platform.
  • Architect and implement complex, high volume/ high frequency data loading and transformation processes leveraging state of the art ETL methods and tools.
  • Provides technical guidance and support to colleagues in the design and implementation of solutions.
  • Function as the technical lead for end-to-end BI and Data Engineering Solutions
  • Work closely with stakeholders to define best in class Data Solutions

Requirements

  • Bachelor's Degree in Computer Science or related field, or equivalent experience.
  • Minimum 5-7 years’ experience on a software team preferably building back-end data services, APIs, or microservices in a large-scale production environment.
  • Good experience working with relational databases and writing SQL.
  • Working Knowledge of Snowflake or Redshift.
  • Strong Data Modelling and Warehousing concepts and experience.
  • Strong AWS big data experience with services such as Redshift, Aurora, RDS, S3, Athena, EMR.
  • Experience and understanding of MPP Database Solutions and Data Warehousing Technologies.
  • Nice to have: Experience in building large scale Lambda or Kappa architectures in production.
  • Experience using containers on Kubernetes.
  • Experience with workflow schedulers like Airflow or AWS Step Functions.
  • Experience with BI tools such as Tableau, Looker, Qlik, etc.
  • Java proficiency – A plus.