Skip to content

Upload profiling jobs when done - #301

Merged
max-models merged 43 commits into
develfrom
upload-profiling-jobs-when-done
Jul 31, 2026
Merged

Upload profiling jobs when done#301
max-models merged 43 commits into
develfrom
upload-profiling-jobs-when-done

Conversation

@max-models

@max-models max-models commented Jul 28, 2026 •
edited
Loading

Copy link
Copy Markdown
Member

Closes #296, #307
Merge after #300

  • Upload one job at a time to profiling-data
  • Skip the intermediate step of copying the .h5 files to a separate export folder before copying them to the profiling-data repo

@max-models
max-models marked this pull request as draft July 28, 2026 14:31
spossann and others added 27 commits July 29, 2026 08:15
@spossann
remove mentions of case_commands from docstrings, as it cannot be pas…
cc6204a 
…sed anywhere.
@spossann
remove _params from .gitignore; added new profiling example: Poisson …
b65a11d 
…strong;still debugging .sh scripts
@max-models
uncommented the mkdir
6cec198
@max-models
Run bash jobs sequentially
c2223ee
@max-models
Set python path to self.venv_path / bin / python
15fc06a
@max-models
Removed MPI import from src/struphy/models/cold_plasma.py
fb77efc
@max-models
Removed rank = ... from models
b2dad5f
@max-models
Update feectools to not call get_rank()
cc63ae6
@max-models
Added launched_under_mpi() to check if the code is launched with mpir…
08ce4e7 
…un or not
@max-models
Set mpi4py.rc.initialize = False and mpi4py.rc.finalize = False in pr…
aee92cd 
…ofiling/profiling_job.py
@max-models
Update scope-profiler version to 0.2.4 to avoid the mpi get_rank call
49be235
@max-models
Make sure we are running in output_root for the output folder to be c…
9f9ebee 
…orrect
@max-models
Merge branch '300-add-a-poisson-solver-case-to-the-profiling-examples…
dc73ddc 
…' into upload-profiling-jobs-when-done
@max-models
Removed rank == 0 check
4ffe864
@max-models
formatting
9d4c8a0
@max-models
ruff check
a2e8279
@max-models
Merge branch '300-add-a-poisson-solver-case-to-the-profiling-examples…
fe58169 
…' into upload-profiling-jobs-when-done
@max-models
Cleanup
0dd6695
@max-models
Change output folder
88bdac7
@max-models
Merge branch '300-add-a-poisson-solver-case-to-the-profiling-examples…
c4c990d 
…' into upload-profiling-jobs-when-done
@max-models
formatting
001e35f
@max-models
Formatting
6026df8
@max-models
Pyccel language is recorded in , not in the name
172f666
@max-models
Removed old code for counting active processes (now they are serial a…
6c242b9 
…nyway).
@max-models
Remove get_comm from src/struphy/utils/mpi_launch.py
3623cdd
@max-models
Removed unneccesary MPI imports
2cf8af0
@max-models
Removed unneccesary MPI imports
80e8f81
@max-models max-models mentioned this pull request Jul 30, 2026
Open
@max-models max-models mentioned this pull request Jul 30, 2026
Merged
@max-models
max-models marked this pull request as ready for review July 31, 2026 08:46
@max-models
max-models requested a review from spossann July 31, 2026 08:46
@max-models
max-models merged commit 195db66 into devel Jul 31, 2026
26 checks passed
@max-models
max-models deleted the upload-profiling-jobs-when-done branch July 31, 2026 13:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@spossann spossann spossann approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

Push the individual runs to the profiling repo (do not wait for the full case to finish)

2 participants

@max-models @spossann