Skill: Local Testing

[fritz-astronomer]

A skill for local testing. I don't know when I'll get a chance to get to this, but putting it on my list.

@BasPH @jonathanleek @TJaniF fyi

Should include

• knowledge about dag.test()
• knowledge about astro dev bash, astro dev pytest
• knowledge of structural DAG tests
• knowledge of separating out functions with @task for easier unit testing
• knowledge about local fake-driven testing, and local mock integration testing
  • testcontainers
  • docker compose override
  • creating connections / airflow_settings.yaml / astro env

[fritz-astronomer]

A guide/pptx I wrote a real long time ago

https://astronomerio.notion.site/Unit-Testing-Airflow-df3511878a5c44ddbbcc3376aae98ef8?source=copy_link

[fritz-astronomer]

Learn / docs

https://www.astronomer.io/docs/learn/testing-airflow
https://www.astronomer.io/docs/learn/debugging-dags
https://www.astronomer.io/docs/learn/connections
https://www.astronomer.io/docs/astro/cli/test-your-astro-project-locally/

[fritz-astronomer]

Events, webinars, ebooks

https://www.astronomer.io/events/webinars/airflow-best-practices-debugging-and-testing-video/
https://www.astronomer.io/events/webinars/best-practices-for-debugging-your-airflow-dags-video/
https://www.astronomer.io/events/webinars/how-to-easily-test-your-airflow-dags-with-the-new-dag-test-function-video/
https://www.astronomer.io/ebooks/debugging-apache-airflow-dags/ (gated)

https://www.astronomer.io/blog/testing-your-apache-airflow-dags/

https://github.com/astronomer/airflow-testing-ebook-companion
(additional link, ungated)

[fritz-astronomer]

https://github.com/jonathanleek/arch_mock_agent