Add airflow-custom-provider skill - #261
Open
odaneau-astro wants to merge 4 commits into
Open
Conversation
Covers packaging a hook/operator/sensor integration as an installable Airflow provider: directory skeleton, the get_provider_info() contract and apache_airflow_provider entry point, constraints that silently break discovery or scheduler parsing, the wheel-build-and-astro-dev-start verification loop, and when a provider package is warranted versus a plain operator in a single DAG repo's include/ or plugins/. Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
Rewrites the skill against a fresh clone of astronomer/airflow-provider-sample to confirm the package skeleton, get_provider_info() required fields, and entry-point contract. Adds a decision table for provider package vs. a lighter include/plugins operator, a UI connection-form snippet, and af config providers/connections verification steps for the functional testing loop. Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
Fixes an inverted/garbled rule about __init__ constructors, corrects a cross-reference, and applies the Astronomer style guide (Latin abbreviations, "repository" not "repo", "folder" not "directory") plus a pass to remove AI-writing tells (em dashes, hollow intensifiers).
Manually followed the skill end to end (build a real provider, astro dev init/start) and found the documented local-wheel step doesn't work: the Astro Runtime image's ONBUILD chain installs requirements.txt before it copies the wheel into the image, so a relative path in requirements.txt fails with "Distribution not found". Fixes it with an explicit Dockerfile RUN after FROM, verified against runtime:3.3-7. Also adds the alternative path teams actually want for sharing a provider: publish to public or private PyPI and reference it normally in requirements.txt, including the Airflow-version-dependent --index-url/--extra-index-url flag and a pointer to Astronomer's private-package build-secret docs for keeping credentials out of git.
odaneau-astro
marked this pull request as ready for review
September 5, 2026 14:21
odaneau-astro
requested review from
a team,
amoghrajesh,
jlaneve and
kaxil
and removed request for
amoghrajesh,
jlaneve and
kaxil
September 5, 2026 14:22
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
get_provider_info(), theapache_airflow_providerentry point, custom connection types).Test plan
get_provider_info()/ entry-point verification commands against a real provider installastro dev initandastro dev startto confirm it installed cleanly.