Skip to content

chore(gateway): hasa/* LiteLLM 게이트웨이 편입 - #703

Merged
riskpw merged 1 commit into
mainfrom
feat/hasa-gateway
Sep 1, 2026
Merged

chore(gateway): hasa/* LiteLLM 게이트웨이 편입#703
riskpw merged 1 commit into
mainfrom
feat/hasa-gateway

Conversation

@riskpw

@riskpw riskpw commented Sep 1, 2026

Copy link
Copy Markdown
Member

요약

운영 반영

  • 운영 `/Volumes/MAC_APP/litellm/litellm.config.yaml` 동일 블록 추가 + `pm2 restart litellm`
  • 운영 `.env` `LLM_GATEWAY_PROVIDERS=openrouter,ollama-cloud,nvidia,hasa` + openmake-llm delete→start→save (restart 는 .env 미반영)

검증

  • 게이트웨이 직접 호출 `hasa/qwen3-coder` (master key + x-api-key BYOK) 200
  • 배포 후 chat.openmake.cc 채팅이 127.0.0.1:13401 경유하는지 usage/로그 확인

🤖 Generated with Claude Code

https://claude.ai/code/session_01BtAjkS2BAQ7JxMsidkdYQD

ollama-cloud 와 같은 패턴(openai/* + api_base). BYOK 는 x-api-key 헤더로 전달.
운영 .env LLM_GATEWAY_PROVIDERS 에 hasa 추가는 배포 시 별도 반영.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01BtAjkS2BAQ7JxMsidkdYQD
@github-actions

github-actions Bot commented Sep 1, 2026

Copy link
Copy Markdown
Contributor

평가 회귀 리포트 (c2ebcd5)

평가 통과율 통과/전체 베이스라인 상태
Routing (Gate 5) 100.0% 120/120 50.0%
Response (Gate 6) 100.0% 30/30 50.0%
  • 데이터셋 버전: routing=0.8.3, response=0.8.3
  • 베이스라인은 OMK_EVAL_PASS_THRESHOLD / OMK_EVAL_RESPONSE_THRESHOLD 환경변수 기준 (이력 비교 아님)
  • 상세 결과: Actions 실행의 evaluation-results-c2ebcd51427aafa80d2ecd0fecd1959a88d284ce 아티팩트 참조

@riskpw
riskpw merged commit 1aceb0f into main Sep 1, 2026
1 check passed
@riskpw
riskpw deleted the feat/hasa-gateway branch September 1, 2026 23:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant