release(ai-gateway): AI Gateway 2.0 by tomek-labuk · Pull Request #5385 · Kong/developer.konghq.com

tomek-labuk · 2026-06-01T09:42:35Z

TODO:

Revert this PR
upload the spec to konnect and sync the oas_data thingy (we also need to update https://github.com/Kong/developer.konghq.com/blob/release/ai-gateway-2.0/app/_api/konnect/ai-gateway/_index.md so that it has the same product I'd we have in konnect

Description

Bootstrap new entities and add support for setting them up with deck, admin-api and konnect-api. Note: the urls might change so we probably need to update them.

Fabian added a hack in the original PR 5057 - the one that says hack: to make ai gateway ...- so that the schemas render locally, it won't work in preview apps.

Note: we need to remove that commit before we release it and update app/_data/konnect_oas_data.json and app/_api/konnect/ai-gateway/_index.md with the right info after we upload the API spec to konnect. See this commit.

This also adds a dummy OAS spec, we need to sync the final version once it's ready.

Preview Links

http://release-ai-gateway-2-0--kongdeveloper.netlify.app/

Landing pages:

AI Gateway Entities:

Reference pages:

AI Providers:

AI Policies hub

https://deploy-preview-5385--kongdeveloper.netlify.app/ai-gateway/policies/

AI Policies

Checklist

Tested how-to docs. If not, note why here.
All pages contain metadata.
Any new docs link to existing docs.
All autogenerated instructions render correctly (API, decK, Konnect, Kong Manager).
Style guide (capitalized gateway entities, placeholder URLs) implemented correctly.
Every page has a description entry in frontmatter.
Add new pages to the product documentation index (if applicable).

netlify · 2026-06-01T09:42:43Z

👷 Deploy Preview for kongdeveloper processing.

Name	Link
🔨 Latest commit	`3133303`
🔍 Latest deploy log	https://app.netlify.com/projects/kongdeveloper/deploys/6a57b98fbe27f200070aac1f

version of the product and page

right folder and add ai-gateway as a product to it.

and update all the files accordingly

Fixes an issue where a specific include relied on the `products` key to render something specific

pages when there's a major_release Make sure that the current page and candidate pages share the same major_release

Fixes an issue where mesh pages where picking up `/dev/` as their latest releases because we only filtered by the max number within a major release. It should exclude unreleased versions.

page doesn't have a canonical

don't raise in production if there are pending entries and update the log statement to be more clear

…r AI Gateway 2.0 (#5308)

* Migrate overview Signed-off-by: Diana <75819066+cloudjumpercat@users.noreply.github.com> * Apply feedback Signed-off-by: Diana <75819066+cloudjumpercat@users.noreply.github.com> * Attempt at fixing the diagram Signed-off-by: Diana <75819066+cloudjumpercat@users.noreply.github.com> * comment out diagram Signed-off-by: Diana <75819066+cloudjumpercat@users.noreply.github.com> --------- Signed-off-by: Diana <75819066+cloudjumpercat@users.noreply.github.com>

* test * fix * syntax

* migrate overview Signed-off-by: Diana <75819066+cloudjumpercat@users.noreply.github.com> * Apply feedback Signed-off-by: Diana <75819066+cloudjumpercat@users.noreply.github.com> * Comment out diagram Signed-off-by: Diana <75819066+cloudjumpercat@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com> --------- Signed-off-by: Diana <75819066+cloudjumpercat@users.noreply.github.com> Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

* entities * entities * Apply suggestions from code review Co-authored-by: lena-larionova <54370747+lena-larionova@users.noreply.github.com> * feat(aigw): add kongctl support to entity_examples block * fix(aigw): remove comments from entities * fix(aigw): use a valid default name for the ai-gateway * fix(aigw): drop ai_gateway_ prefix from kongctl, it doesn't work for the file format which is the one we use on the entities page * feat(aigw): add kongctl format support to AI Gateway entity examples Extends the entity_example block to render kongctl YAML for AI Gateway entities, mirroring the existing event-gateway support. Bare $UPPERCASE env var values in entity data are rendered as !env VAR_NAME YAML tags. * fix(aigw): remove em dashes and positional language from entity docs Replace em dashes with plain punctuation and rewrite "below"/"above" references to link/name the target section instead. Add a Prose style section to CLAUDE.md so future content follows the same rules. * add vertex * Update app/_ai_gateway_entities/ai-vault.md Co-authored-by: lena-larionova <54370747+lena-larionova@users.noreply.github.com> --------- Co-authored-by: lena-larionova <54370747+lena-larionova@users.noreply.github.com> Co-authored-by: Fabian Rodriguez <fabian.rodriguez@konghq.com>

* port from aigw-v2-fwd-proxy' * remove merge error tools section * Apply suggestions from code review Co-authored-by: Diana <75819066+cloudjumpercat@users.noreply.github.com> * misc fixes * fix tools block * fix tools block * lower case Control Plane and Data Plane Co-authored-by: Diana <75819066+cloudjumpercat@users.noreply.github.com> * undo broken capture group * undo broken capture group * fix indent * vale --------- Co-authored-by: Diana <75819066+cloudjumpercat@users.noreply.github.com> Co-authored-by: Angel <angel.guarisma@konghq.com>

* Add openai how-to * small fixes --------- Co-authored-by: Angel <angel.guarisma@konghq.com>

* Migrate RAG injector * Apply suggestions from code review Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Diana <75819066+cloudjumpercat@users.noreply.github.com> --------- Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com> Co-authored-by: Diana <75819066+cloudjumpercat@users.noreply.github.com>

* feat(operator): AI Gateway docs — KonnectAIGateway rename + IdentityProvider Two breaking CRD changes from KO 2.2 (July 10): - AIGatewayControlPlane renamed to KonnectAIGateway (commit e1a708c) - New AIGatewayIdentityProvider CRD (key-auth / openid-connect) added (commit e5c22cc) Docs updated: - 4-step getting started series: install, deploy, policies, consumers - Consumers step now creates AIGatewayIdentityProvider before consumers - Reference page: resource model table, reference chain, new IdentityProvider section - Series, index, and landing page wiring - QA test plan: new Section 7 (Identity Providers), all KonnectAIGateway rename fixes - Fix broken related_resources link in support doc (rate-limiting/examples → rate-limiting) CRD corrections carried forward from prior audit: - AIGatewayModelProvider (was AIGatewayProvider) - Auth uses SensitiveDataSource (secretRef), aiGatewayRef throughout - AIGatewayConsumerCredential: aiGatewayConsumerRef + apiKey.secretRef - AIGatewayDataPlane auto-provisions mTLS cert Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> * feat(operator): AI Gateway getting started series and reference docs * fix vale issues * fix codex feedback * Apply suggestions from code review pt 1 Co-authored-by: Diana <75819066+cloudjumpercat@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Diana <75819066+cloudjumpercat@users.noreply.github.com> * Fix build failure Signed-off-by: Diana <75819066+cloudjumpercat@users.noreply.github.com> * tech preview badges, remove qa file Signed-off-by: Diana <75819066+cloudjumpercat@users.noreply.github.com> --------- Signed-off-by: Diana <75819066+cloudjumpercat@users.noreply.github.com> Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com> Co-authored-by: Diana <75819066+cloudjumpercat@users.noreply.github.com>

* fix(ai-gateway): on-prem doc * Apply suggestions from code review Co-authored-by: Diana <75819066+cloudjumpercat@users.noreply.github.com> --------- Co-authored-by: Diana <75819066+cloudjumpercat@users.noreply.github.com>

* test * works * Apply suggestions from code review Co-authored-by: Diana <75819066+cloudjumpercat@users.noreply.github.com> * fix broken link --------- Co-authored-by: Diana <75819066+cloudjumpercat@users.noreply.github.com>

* init content * feat(ai-gateway): Use Claude Code with Azure AI + Claude CLI Squashes: init content, init content, initial config, copilot fixes, Fel fixes, Fel fixes, works. Drops an accidental app/.repos/kuma submodule pointer regression (4d676877 -> a92a32a8) that crept into "init content" and persisted through every later commit on this branch. * Apply suggestions from code review Co-authored-by: Diana <75819066+cloudjumpercat@users.noreply.github.com> --------- Co-authored-by: Angel <angel.guarisma@konghq.com> Co-authored-by: Diana <75819066+cloudjumpercat@users.noreply.github.com>

* set canonical urls for existing pages * set canonical URLs for everything; fix links on mcp v1 doc

* feat(aigw): Alternate kongctl claude code how-to * test * Apply suggestions from code review Co-authored-by: Angel <Guaris@users.noreply.github.com> * config * update copy to reflect new config * fixes for copilot * minor fixes * Apply feedback Signed-off-by: Diana <75819066+cloudjumpercat@users.noreply.github.com> --------- Signed-off-by: Diana <75819066+cloudjumpercat@users.noreply.github.com> Co-authored-by: Angel <angel.guarisma@konghq.com> Co-authored-by: Angel <Guaris@users.noreply.github.com> Co-authored-by: Diana <75819066+cloudjumpercat@users.noreply.github.com>

* Add how-to * make changes that I think fixes it Signed-off-by: Diana <75819066+cloudjumpercat@users.noreply.github.com> * Small fixes from testing Signed-off-by: Diana <75819066+cloudjumpercat@users.noreply.github.com> * vale is annoying Signed-off-by: Diana <75819066+cloudjumpercat@users.noreply.github.com> * fix canonical url Signed-off-by: Diana <75819066+cloudjumpercat@users.noreply.github.com> --------- Signed-off-by: Diana <75819066+cloudjumpercat@users.noreply.github.com> Co-authored-by: Diana <75819066+cloudjumpercat@users.noreply.github.com>

* get started fixe * test * Update app/_how-tos/ai-gateway/get-started-with-ai-gateway.md

* Add codex how-to * fix * Apply suggestions from code review Co-authored-by: jbaross <james.baross@konghq.com> --------- Co-authored-by: jbaross <james.baross@konghq.com>

…Vertex AI (#5952) * initial content * initial configs * initial configs * whitespace fix * fixes for copilot Squashes: fixes for copilot, Fel fixes. Drops an accidental app/.repos/kuma submodule pointer regression (4d676877 -> a92a32a8) that crept into "fixes for copilot". * works * Apply suggestions from code review Co-authored-by: Diana <75819066+cloudjumpercat@users.noreply.github.com> * add canonical url Signed-off-by: Diana <75819066+cloudjumpercat@users.noreply.github.com> * fix(aigw): add env variable to aigw prereq --------- Signed-off-by: Diana <75819066+cloudjumpercat@users.noreply.github.com> Co-authored-by: Angel <angel.guarisma@konghq.com> Co-authored-by: Diana <75819066+cloudjumpercat@users.noreply.github.com> Co-authored-by: Fabian Rodriguez <fabian.rodriguez@konghq.com>

Signed-off-by: Diana <75819066+cloudjumpercat@users.noreply.github.com>

* managing AI Gateway with kongctl * add note to config page about env to avoid confusion * Apply suggestions from code review Co-authored-by: Lucie Milan <32450552+lmilan@users.noreply.github.com> --------- Co-authored-by: Lucie Milan <32450552+lmilan@users.noreply.github.com>

…ssion. (#5971)

* Add kongctl config and tooling * Apply suggestions from code review Co-authored-by: Julia <101819212+juliamrch@users.noreply.github.com> --------- Co-authored-by: Julia <101819212+juliamrch@users.noreply.github.com>

* init content * tidy up copy * Apply suggestions from code review Co-authored-by: Diana <75819066+cloudjumpercat@users.noreply.github.com> --------- Co-authored-by: Diana <75819066+cloudjumpercat@users.noreply.github.com>

Signed-off-by: Diana <75819066+cloudjumpercat@users.noreply.github.com>

* initial config * fix(aigw): split config into multiple steps --------- Co-authored-by: Fabian Rodriguez <fabian.rodriguez@konghq.com>

tomek-labuk added do not merge Issues/ PRs whose changes should not be merged at this time release-docs Docs for release product:ai-gateway labels Jun 1, 2026

tomek-labuk changed the title ~~release: AI Gateway 2.0~~ release(ai-gateway): AI Gateway 2.0 Jun 1, 2026

tomek-labuk requested a review from gperanich June 5, 2026 04:20

fabianrbz force-pushed the release/ai-gateway-2.0 branch 2 times, most recently from 57c9b79 to 73bfe81 Compare June 22, 2026 08:50

tomek-labuk closed this Jun 24, 2026

tomek-labuk reopened this Jun 25, 2026

fabianrbz force-pushed the release/ai-gateway-2.0 branch from 73a28b0 to 2721425 Compare July 2, 2026 23:18

fabianrbz and others added 19 commits July 3, 2026 13:37

feat(major-release): load entity_examples in prereqs based on the major

0c217b7

version of the product and page

fix(ai-gateway): move metering-and-billing/meter-llm-traffic to the

e4c2d55

right folder and add ai-gateway as a product to it.

feat(major-release): move mcp how-tos to /gateway/v1/

3228e47

feat(major-release): add _landing_pages/ai-gateway/v1/mcp.yaml

a9e0e27

and update all the files accordingly

fix(major-release): expose the products available in the prereqs

62adaba

Fixes an issue where a specific include relied on the `products` key to render something specific

fix: remove breadcrumbs from the how-to

3178d66

fix(major-release): the way how_to_list and reference_list calculate the

bffbd95

pages when there's a major_release Make sure that the current page and candidate pages share the same major_release

fix(major-release): remove how_to_list from ai pages

244d001

fix(major-release): scope releases to latest - excluding unreleased

03163c5

Fixes an issue where mesh pages where picking up `/dev/` as their latest releases because we only filtered by the max number within a major release. It should exclude unreleased versions.

feat(major-release): always render the major version banner even if the

98e72ef

page doesn't have a canonical

fix(major-release): add comment explaining how app/_config/releases work

636cfe9

fix(major-release): when loading major releases config

c054e4b

don't raise in production if there are pending entries and update the log statement to be more clear

feat(ai-gateway): AI Gateway 2.0 entities (#5263)

d88e647

update agent and mcp server entities

14b9b06

update mcp server

d8e30f8

Remove on-prem mentions

b8b96bc

feat(ai-gateway): Update load balancing capabilities documentation fo…

37929a4

…r AI Gateway 2.0 (#5308)

update min_version

dc97689

Update min_version for Resource sizing guidelines doc

ef4f10f

lena-larionova and others added 30 commits July 13, 2026 16:21

fix konnect api url in entity example (#5931)

3f200a2

Fix(AIGW): getstarted fixes (#5927)

255d1d6

* test * fix * syntax

feat(ai-gateway): Use Claude Code with OpenAI (#5935)

d585069

* Add openai how-to * small fixes --------- Co-authored-by: Angel <angel.guarisma@konghq.com>

fix(ai-gateway): on-prem doc (#5945)

85f0269

* fix(ai-gateway): on-prem doc * Apply suggestions from code review Co-authored-by: Diana <75819066+cloudjumpercat@users.noreply.github.com> --------- Co-authored-by: Diana <75819066+cloudjumpercat@users.noreply.github.com>

Fix(AIGW) forward proxy (#5949)

de68251

* test * works * Apply suggestions from code review Co-authored-by: Diana <75819066+cloudjumpercat@users.noreply.github.com> * fix broken link --------- Co-authored-by: Diana <75819066+cloudjumpercat@users.noreply.github.com>

update missing redirects for plugins (#5933)

8eb2885

chore(aigw): Set canonical urls (#5934)

f8b3375

* set canonical urls for existing pages * set canonical URLs for everything; fix links on mcp v1 doc

Fix(AIGW): Fix get started guide for latest version of kongctl (#5938)

47fe708

* get started fixe * test * Update app/_how-tos/ai-gateway/get-started-with-ai-gateway.md

add more provider cards (#5962)

b4b5a56

fix(ai-gateway): A2A prereq (#5964)

3b8c2e0

feat(ai-gateway): Add codex how-to (#5961)

b422b17

* Add codex how-to * fix * Apply suggestions from code review Co-authored-by: jbaross <james.baross@konghq.com> --------- Co-authored-by: jbaross <james.baross@konghq.com>

feat(ai-gateway): Add bedrock how-to for Claude (#5942)

62c8699

draft gemini how to (#5959)

32ce09e

Signed-off-by: Diana <75819066+cloudjumpercat@users.noreply.github.com>

fix: remove duplicate konctl instructions (#5970)

1e530e3

fix: replace YOUR_OPENAI_API_KEY by OPENAI_API_KEY as saved in the se…

fc1ccf9

…ssion. (#5971)

fix(ai-gateway): Update MCP get started (#5963)

9bea7ce

* Add kongctl config and tooling * Apply suggestions from code review Co-authored-by: Julia <101819212+juliamrch@users.noreply.github.com> --------- Co-authored-by: Julia <101819212+juliamrch@users.noreply.github.com>

Feat(aigw): v2 dashscope claude cli (#5967)

8f39d00

* init content * tidy up copy * Apply suggestions from code review Co-authored-by: Diana <75819066+cloudjumpercat@users.noreply.github.com> --------- Co-authored-by: Diana <75819066+cloudjumpercat@users.noreply.github.com>

Adjust adoption wording (#5951)

ad45cfd

Signed-off-by: Diana <75819066+cloudjumpercat@users.noreply.github.com>

Fix(aigw): v2 azure combined config (#5972)

3133303

* initial config * fix(aigw): split config into multiple steps --------- Co-authored-by: Fabian Rodriguez <fabian.rodriguez@konghq.com>

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

release(ai-gateway): AI Gateway 2.0#5385

release(ai-gateway): AI Gateway 2.0#5385
tomek-labuk wants to merge 297 commits into
mainfrom
release/ai-gateway-2.0

tomek-labuk commented Jun 1, 2026 •

edited by Guaris

Loading

Uh oh!

netlify Bot commented Jun 1, 2026 •

edited

Loading

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

10 participants

Uh oh!

Conversation

tomek-labuk commented Jun 1, 2026 • edited by Guaris Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Description

Preview Links

Checklist

Uh oh!

netlify Bot commented Jun 1, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

👷 Deploy Preview for kongdeveloper processing.

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

10 participants

tomek-labuk commented Jun 1, 2026 •

edited by Guaris

Loading

netlify Bot commented Jun 1, 2026 •

edited

Loading