Skip to content

Run regression test suite with 3.11.0 official - #229

Merged
jmarrec merged 7 commits into
developfrom
3.11.0
Aug 26, 2026
Merged

Run regression test suite with 3.11.0 official#229
jmarrec merged 7 commits into
developfrom
3.11.0

Conversation

@jmarrec

@jmarrec jmarrec commented Aug 26, 2026

Copy link
Copy Markdown
Contributor

Pull request overview

  • I also uploaded the results to the Google Sheet tracker here
image

new failure here, not sure why, but probably not especially related to fan_componentmodel.

Without Spaces

image

With Spaces

image

```
openstudio highlevel_tests.rb
openstudio sql_tests.rb
openstudio utilities_tests.rb
openstudio segfault_tests.rb
```
…lures, 0 errors, 0 skips

3.10.0 had: 261 tests, 572 assertions, 31 failures, 0 errors, 1 skips

```
real	24m42.584s
user	190m22.115s
sys	1m51.582s
```
… now enabled by default since 3.5.0)

3.11.0: 561 tests, 1147 assertions, 24 failures, 1 errors, 7 skips

3.10.0: 558 tests, 1132 assertions, 32 failures, 1 errors, 16 skips   - took 32 min 54s

```
USE_EPLUS_SPACES=false CUSTOMTAG=WithoutSpaces openstudio model_tests.rb
cd test
git add -f *3.11.0_out_WithoutSpaces*
```
…ailures, 1 errors, 6 skips`

3.10.0: `openstudio model_tests.rb` `558 tests, 1177 assertions, 28 failures, 1 errors, 15 skips` 32m55.725s

```
real	39m1.643s
user	487m58.412s
sys	15m24.858s
```

(Was compiling openstudio with 3 threads while I was doing it, so timings aren't reliable)
@jmarrec jmarrec self-assigned this Aug 26, 2026
@jmarrec jmarrec added Other PR type: Something else, like maintenance of the repo, or just committing test results Developer Issue labels Aug 26, 2026
@jmarrec
jmarrec merged commit 6e880a6 into develop Aug 26, 2026
5 checks passed
@jmarrec
jmarrec deleted the 3.11.0 branch August 26, 2026 13:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Developer Issue Other PR type: Something else, like maintenance of the repo, or just committing test results

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant