+ All Categories

Home > Documents > Building Providers & DAGs in the Airflow Ecosystem · DATADOG Druid E (asol fcc±ook Ads FTP g RPG...

Building Providers & DAGs in the Airflow Ecosystem · DATADOG Druid E (asol fcc±ook Ads FTP g RPG...

Date post:	09-Aug-2021
Category:	Documents
Upload:	others
View:	4 times
Download:	0 times

Download Report this document

Share this document with a friend

Embed Size (px):

11

Building Providers & DAGs in the Airflow Ecosystem

Transcript

Page 1: Building Providers & DAGs in the Airflow Ecosystem · DATADOG Druid E (asol fcc±ook Ads FTP g RPG HTTp Jdbc SQU salesforce . ASTRONOMER REGISTRY Building Blocks for your Apache Airflow

Building Providers & DAGs in the Airflow Ecosystem

Page 2: Building Providers & DAGs in the Airflow Ecosystem · DATADOG Druid E (asol fcc±ook Ads FTP g RPG HTTp Jdbc SQU salesforce . ASTRONOMER REGISTRY Building Blocks for your Apache Airflow

Airflow 2.0 TrajectoryDemo ELT DAGBYO & ShareQ&A

Page 3: Building Providers & DAGs in the Airflow Ecosystem · DATADOG Druid E (asol fcc±ook Ads FTP g RPG HTTp Jdbc SQU salesforce . ASTRONOMER REGISTRY Building Blocks for your Apache Airflow

DAG

Provider

Module Module

Page 4: Building Providers & DAGs in the Airflow Ecosystem · DATADOG Druid E (asol fcc±ook Ads FTP g RPG HTTp Jdbc SQU salesforce . ASTRONOMER REGISTRY Building Blocks for your Apache Airflow

Airflow 1.0Single core package

Dependency hell

Scattered docs

Airflow 2.0Decoupled providers

Minimal dependencies

BYO provider framework

Page 5: Building Providers & DAGs in the Airflow Ecosystem · DATADOG Druid E (asol fcc±ook Ads FTP g RPG HTTp Jdbc SQU salesforce . ASTRONOMER REGISTRY Building Blocks for your Apache Airflow

DAG

Provider

Module Module

Page 6: Building Providers & DAGs in the Airflow Ecosystem · DATADOG Druid E (asol fcc±ook Ads FTP g RPG HTTp Jdbc SQU salesforce . ASTRONOMER REGISTRY Building Blocks for your Apache Airflow

🔗 Enhance the story of Airflow integrations

🤝 Help the community share and discover Airflow providers and DAGs

📈 Speed up the developer experience

👌Surface quality metrics and certifications

Page 7: Building Providers & DAGs in the Airflow Ecosystem · DATADOG Druid E (asol fcc±ook Ads FTP g RPG HTTp Jdbc SQU salesforce . ASTRONOMER REGISTRY Building Blocks for your Apache Airflow

Need to connect A to B...Where to start?

Page 8: Building Providers & DAGs in the Airflow Ecosystem · DATADOG Druid E (asol fcc±ook Ads FTP g RPG HTTp Jdbc SQU salesforce . ASTRONOMER REGISTRY Building Blocks for your Apache Airflow

Page 9: Building Providers & DAGs in the Airflow Ecosystem · DATADOG Druid E (asol fcc±ook Ads FTP g RPG HTTp Jdbc SQU salesforce . ASTRONOMER REGISTRY Building Blocks for your Apache Airflow

DEMO

Page 10: Building Providers & DAGs in the Airflow Ecosystem · DATADOG Druid E (asol fcc±ook Ads FTP g RPG HTTp Jdbc SQU salesforce . ASTRONOMER REGISTRY Building Blocks for your Apache Airflow

Contribute

Page 11: Building Providers & DAGs in the Airflow Ecosystem · DATADOG Druid E (asol fcc±ook Ads FTP g RPG HTTp Jdbc SQU salesforce . ASTRONOMER REGISTRY Building Blocks for your Apache Airflow

Q&A

Recommended

Datadog and HashiCorp Debugging in the Cloud with · 2020. 11. 20. · Datadog @phrawzty - What is infrastructure as code? - Understanding observability - Live demo Agenda. Infrastructure

PowerPoint Presentation · 10.00 5.00 0.00 700 Airflow 1 Airflow 2 Airflow 3 Airflow 4 519-633-8801 Airflow (cfm at STP) Canada N5P 3R9 TEL: 33 Gaylord Road, St. Thomas, ON., Title:

asol alrml.pdf · Title: 4D6963726F736F667420576F7264202D20E3E4C8DA20C3D5E6E120C7E1D1E3E12E646F63>

DATADOG TIPS #1

Data: Monitoring to Analytics to Understanding // Alexis Le-Quoc, Datadog [FirstMark's Data Driven]

Scaling monitoring with Datadog

Application Performance Monitoring using Datadog

SED575 - Building Datadog · Many of these businesses used Datadog to monitor their increasingly wide range of infrastructure conﬁgurations, and Datadog began to scale. On today's

Datadog with Scaling monitoring · 2021. 3. 11. · Datadog - cont’d. Metrics and Alerts. Correlation features. Collaboration features. Custom Dashboards

Outdoor Airflow Measurement System · Outdoor Airflow Measurement System DESCRIPTION ... accurately determine true airflow rates even when the primary airflow measurement stations

Airflow Management

Datadog- Monitoring In Motion

77-1131 - Building Airflow System Control Applications · BUILDING AIRFLOW SYSTEM CONTROL APPLICATIONS 2 Airflow Control Applications ... AIRFLOW CONTROL FUNDAMENTALS

AIRFLOW MANAGEMENT PRODUCTS TURNING VANE & CHIMNEY AIRFLOW

Federator.ai for Datadog Installation and Configuration Guide · 2020. 12. 8. · Datadog agent must be ready if Federator.ai runs in the same Kubernetes cluster that is being monitored.

Federator.ai for Datadog Installation and Configuration Guide€¦ · Federator.ai for Datadog Installation and Configuration Guide 2 Overview Federator.ai ProphetStor Federator.ai

ASOL HS-G1 & SOL Geography 1.4 Identify the physical shape of the US and VA.