Skip to content

feat: add release 0.0.0 version substitution to run configuration and updat…#163

Open
omkargaikwad23 wants to merge 7 commits intomainfrom
release-please--ci_evals_test
Open

feat: add release 0.0.0 version substitution to run configuration and updat…#163
omkargaikwad23 wants to merge 7 commits intomainfrom
release-please--ci_evals_test

Conversation

@omkargaikwad23
Copy link
Copy Markdown
Contributor

…e cloudbuild environment variables

@omkargaikwad23 omkargaikwad23 requested review from a team as code owners April 24, 2026 06:59
@github-actions github-actions Bot requested a review from isaurabhuttam April 24, 2026 06:59
@omkargaikwad23 omkargaikwad23 added autorelease: triggered Release please has triggered a release for this. and removed autorelease: triggered Release please has triggered a release for this. labels Apr 24, 2026
@omkargaikwad23 omkargaikwad23 changed the title feat: add release version substitution to run configuration and updat… feat: add release 0.0.0 version substitution to run configuration and updat… Apr 24, 2026
Comment thread evals/run_config.yaml
# limitations under the License.

extension_id: cloud-sql-postgresql
release_version: ${RELEASE_VERSION}
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we should use separate yaml file this can be confusing we want to have standard config files across evalbench

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'd prefer to keep these lines in run_config.yaml. The evalbench framework expects a single configuration file via the --experiment_config flag, and these fields are part of that run's specific configuration. Splitting them into a separate file would require us to add an extra step in Cloud Build to merge files together before running, which adds unnecessary complexity.

Comment thread cloudbuild.yaml Outdated
Comment thread cloudbuild.yaml
Comment thread cloudbuild.yaml Outdated
Copy link
Copy Markdown
Contributor Author

@omkargaikwad23 omkargaikwad23 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Resolved the comments

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

autorelease: triggered Release please has triggered a release for this.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants