Astronomer/Airflow Architect

Job Description

<p><strong>Role: Astronomer/Airflow Architect</strong></p><p><strong>Location: Mississauga, ON (Hybrid)</strong></p><p><br></p><p><strong>The Solutions Architect specializing in Cloud Orchestration, will work with a small group of technologists and become a trusted advisor delivering technical solutions leveraging Apache Airflow hosted on the Astronomer platform. In this role, he will engineer a wide range of use cases where, Apache Airflow sits at the center of the solution, with the goal of rapidly developing solutions for the use cases. </strong></p><p><br></p><ul><li><strong>Help guide a small group of technologists in their Apache Airflow journeys, including identifying new use cases and onboarding new domain teams.</strong></li><li><strong>Review, optimize, and tune data ingestion and extraction pipelines orchestrated by Airflow.</strong></li><li><strong>Development of frameworks to manage and engineer a large number of pipelines for the entire domain.</strong></li><li><strong>Build architecture, data flow, and operational diagrams and documents, with detailed physical and logical layers.</strong></li><li><strong>Provide reference implementations of various activities, including composing data pipelines in Airflow, implementing new Airflow features, or integrating Airflow with 3rd party solutions.</strong></li><li><strong>Keep up with the latest Astro and Airflow features, in order to better advise the technologies on impactful improvements they can make.</strong></li><li><strong>Collaborate to build reusable assets, automation tools, and documented best practices.</strong></li><li><strong>Interact with Domain and Engineering teams to channel product feedback and requirements discussions.</strong></li><li><strong>Work with technology team members to ensure that are realizing value in their Airflow and Astronomer journeys</strong></li></ul><p><strong>Skills Required:</strong></p><ul><li><strong>Experience with Apache Airflow in production environments.</strong></li><li><strong>Experience in designing and implementing ETL, Data Warehousing, and ML/AI use cases.</strong></li><li><strong>Proficiency in Python.</strong></li><li><strong>Knowledge of Azure cloud-native data architecture. </strong></li><li><strong>Demonstrated technical leadership on team projects.</strong></li><li><strong>Strong oral and written communication skills.</strong></li><li><strong>Willingness to learn new technologies and build reference implementations.</strong></li><li><strong>Experience in migrating workflows from legacy schedulers (Tidal) to Apache Airflow.</strong></li><li><strong>Experience in integrating with Azure Data Factory pipelines.</strong></li><li><strong>Experience </strong></li><li><strong>Snowflake and Databricks experience.</strong></li><li><strong>Experience working with containers.</strong></li><li><strong>SQL experience.</strong></li><li><strong>Kubernetes experience, either on-premise or in the cloud.</strong></li><li><strong>Enterprise data experience in regulated environments.</strong></li></ul><p></p>