ExaHyPE issueshttps://gitlab.lrz.de/groups/exahype/-/issues2019-05-02T17:55:34+02:00https://gitlab.lrz.de/exahype/ExaHyPE-Engine/-/issues/280Pass coordinates to nonConservativeProduct2019-05-02T17:55:34+02:00Ghost UserPass coordinates to nonConservativeProduct~~Currently, it is the only PDE function where we do not pass the coordinates in.~~
We actually do not pass the coordinates to the flux and the eigenvalues kernels, too.
18 kernel files need to be changed.
Workaround
----------
Specif...~~Currently, it is the only PDE function where we do not pass the coordinates in.~~
We actually do not pass the coordinates to the flux and the eigenvalues kernels, too.
18 kernel files need to be changed.
Workaround
----------
Specify the coordinates or a coefficient depending on the coordinates as material parameter.https://gitlab.lrz.de/exahype/ExaHyPE-Engine/-/issues/286Observed issues using AMR with erase2019-08-02T16:52:06+02:00Ghost UserObserved issues using AMR with eraseI have observe a couple of issue that can be reproduced with the current version of application SFDI:
1. Only one refine level and erase lead to the error reported below. This happen with applications:
SFDI, parfile, after step 121, ti...I have observe a couple of issue that can be reproduced with the current version of application SFDI:
1. Only one refine level and erase lead to the error reported below. This happen with applications:
SFDI, parfile, after step 121, time=0.0100127:
[SFDI_2D_1refissue.exahype](/uploads/1bc47bc22d0e688354210422775a3eae/SFDI_2D_1refissue.exahype)
GPRDR, parfile:
[GPRDR_2D.exahype](/uploads/d1bce4d670a633a4b76abe519ceb102a/GPRDR_2D.exahype)
101.299009 [hilbert],rank:0, core:30, tid:13 error exahype::solvers::ADERDGSolver::surfaceIntegral(...) Riemann solve was not performed on all faces of cell= (solverNumber:0,neighbourMergePerformed:[,,,],hasCompletedLastStep:0,parentIndex:3492,hasVirtualChildren:0,type:Cell,refinementEvent:None,level:6,offset:[1.07173,0.244726],size:[0.0168776,0.0168776],previousTimeStamp:inf,previousTimeStepSize:inf,timeStepSize:0.000121198,timeStamp:0.0100127,solutionIndex:91946,solutionAveragesIndex:91949,solutionCompressedIndex:-...
2. After a certain time it continue to run but the time does not increase, see the log below. The same issue appears also with a coarsest mesh ("maximum_mesh_size": 1.0) but later:
parfile:
[SFDI_2D_issue1.exahype](/uploads/c31d7ac41db8ae6e36dac320299a233a/SFDI_2D_issue1.exahype)
```
48460.082966 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48460.082980 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(Repository) finished grid setup after 20 iterations
48460.082992 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::updateMeshAndSubdomains(...) finalise mesh refinement (if applicable)
48460.083004 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::updateMeshAndSubdomains(...) reinitialise cells and send data to neigbours (if applicable)
48460.194436 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::updateMeshAndSubdomains(...) recompute solution locally (if applicable) and compute new time step size
48460.385842 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::printTimeStepInfo(...) step 15681 t_min =0.298657
48460.385869 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::printTimeStepInfo(...) dt_min =0.000111607
48460.385885 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::printTimeStepInfo(...) inner cells/inner unrefined cells=48460/25257
48460.385902 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::printTimeStepInfo(...) inner max/min mesh width=[0.16,0.16]/[0.0177778,0.0177778]
48460.385915 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::printTimeStepInfo(...) max level=6
48460.385929 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::printTimeStepInfo(...) outer cells/outer unrefined cells=590/456
48460.385976 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::runAsMaster(...) memoryUsage =4693 MB
48460.664413 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::runTimeStepsWithFusedAlgorithmicSteps(...) local recomputation requested by at least one solver
48460.711840 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::updateMeshAndSubdomains(...) pre-spreading of limiter status
48461.121757 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::updateMeshAndSubdomains(...) perform mesh refinement
48461.121796 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48461.265934 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48461.265964 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #1, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48461.266009 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48461.266022 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48461.413310 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48461.413336 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #2, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48461.413380 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48461.413393 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48461.560601 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48461.560629 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #3, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48461.560671 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48461.560684 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48461.707636 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48461.707664 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #4, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48461.707708 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48461.707722 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48461.853066 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48461.853091 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #5, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48461.853132 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48461.853144 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48461.999806 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48461.999834 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #6, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48461.999879 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48461.999924 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48462.147141 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48462.147168 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #7, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48462.147211 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48462.147224 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48462.293720 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=1, all solvers attained stable state=1, max level=6
48462.293745 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #8, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48462.293787 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48462.293800 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=2, all solvers attained stable state=1, max level=6
48462.440954 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=3, all solvers attained stable state=1, max level=6
48462.440980 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #9, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48462.441020 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48462.441032 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=4, all solvers attained stable state=1, max level=6
48462.588360 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=5, all solvers attained stable state=1, max level=6
48462.588385 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #10, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48462.588425 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48462.588438 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=6, all solvers attained stable state=1, max level=6
48462.735102 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=1, max level=6
48462.735127 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #11, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48462.735167 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48462.735179 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=1, all solvers attained stable state=1, max level=6
48462.884632 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48462.884659 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #12, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48462.884701 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48462.884715 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48463.035295 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48463.035321 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #13, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48463.035361 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48463.035374 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48463.184642 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=1, all solvers attained stable state=1, max level=6
48463.184669 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #14, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48463.184711 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48463.184724 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=2, all solvers attained stable state=1, max level=6
48463.334715 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48463.334742 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #15, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48463.334783 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48463.334797 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48463.484046 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48463.484072 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #16, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48463.484112 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48463.484125 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48463.632638 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=1, all solvers attained stable state=1, max level=6
48463.632665 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #17, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48463.632705 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48463.632718 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=2, all solvers attained stable state=1, max level=6
48463.781876 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #18, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=0
48463.781928 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48463.781941 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(Repository) finished grid setup after 18 iterations
48463.781953 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::updateMeshAndSubdomains(...) finalise mesh refinement (if applicable)
48463.781964 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::updateMeshAndSubdomains(...) reinitialise cells and send data to neigbours (if applicable)
48463.894936 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::updateMeshAndSubdomains(...) recompute solution locally (if applicable) and compute new time step size
48464.081949 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::printTimeStepInfo(...) step 15682 t_min =0.298657
48464.081988 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::printTimeStepInfo(...) dt_min =0.000111607
48464.082004 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::printTimeStepInfo(...) inner cells/inner unrefined cells=48460/25257
48464.082021 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::printTimeStepInfo(...) inner max/min mesh width=[0.16,0.16]/[0.0177778,0.0177778]
48464.082034 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::printTimeStepInfo(...) max level=6
48464.082046 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::printTimeStepInfo(...) outer cells/outer unrefined cells=590/456
48464.082093 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::runAsMaster(...) memoryUsage =4693 MB
48464.369570 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::runTimeStepsWithFusedAlgorithmicSteps(...) mesh update requested by at least one solver
48464.418752 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::updateMeshAndSubdomains(...) pre-spreading of limiter status
48464.827970 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::updateMeshAndSubdomains(...) perform mesh refinement
48464.828009 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48464.974119 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48464.974148 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #1, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48464.974190 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48464.974202 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48465.122067 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48465.122095 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #2, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48465.122138 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48465.122153 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48465.269962 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48465.269989 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #3, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48465.270062 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48465.270076 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48465.417461 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48465.417487 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #4, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48465.417526 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48465.417537 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48465.564058 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48465.564084 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #5, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48465.564126 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48465.564139 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48465.711640 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48465.711667 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #6, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48465.711708 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48465.711720 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48465.859318 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48465.859344 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #7, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48465.859385 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48465.859398 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48466.007531 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48466.007558 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #8, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48466.007601 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48466.007614 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48466.155125 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48466.155152 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #9, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48466.155194 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48466.155207 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48466.301976 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=1, all solvers attained stable state=1, max level=6
48466.302002 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #10, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48466.302044 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48466.302056 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=2, all solvers attained stable state=1, max level=6
48466.449749 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=3, all solvers attained stable state=1, max level=6
48466.449774 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #11, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48466.449810 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48466.449823 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=4, all solvers attained stable state=1, max level=6
48466.598445 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=5, all solvers attained stable state=1, max level=6
48466.598474 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #12, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48466.598521 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48466.598533 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=6, all solvers attained stable state=1, max level=6
48466.749009 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=1, max level=6
48466.749042 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #13, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48466.749093 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48466.749106 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=1, all solvers attained stable state=1, max level=6
48466.902091 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48466.902119 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #14, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48466.902161 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48466.902173 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48467.053397 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48467.053424 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #15, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48467.053463 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48467.053475 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48467.204646 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=1, all solvers attained stable state=1, max level=6
48467.204672 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #16, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48467.204710 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48467.204723 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=2, all solvers attained stable state=1, max level=6
48467.354426 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48467.354451 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #17, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48467.354489 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48467.354502 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48467.503538 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48467.503563 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #18, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48467.503600 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48467.503613 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48467.653651 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=1, all solvers attained stable state=1, max level=6
48467.653677 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #19, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48467.653716 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48467.653729 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=2, all solvers attained stable state=1, max level=6
48467.803491 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #20, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=0
48467.803575 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48467.803589 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(Repository) finished grid setup after 20 iterations
48467.803602 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::updateMeshAndSubdomains(...) finalise mesh refinement (if applicable)
48467.803614 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::updateMeshAndSubdomains(...) reinitialise cells and send data to neigbours (if applicable)
48467.915869 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::updateMeshAndSubdomains(...) recompute solution locally (if applicable) and compute new time step size
48468.101707 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::printTimeStepInfo(...) step 15683 t_min =0.298657
48468.101733 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::printTimeStepInfo(...) dt_min =0.000111607
48468.101750 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::printTimeStepInfo(...) inner cells/inner unrefined cells=48460/25257
48468.101766 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::printTimeStepInfo(...) inner max/min mesh width=[0.16,0.16]/[0.0177778,0.0177778]
48468.101779 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::printTimeStepInfo(...) max level=6
48468.101801 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::printTimeStepInfo(...) outer cells/outer unrefined cells=590/456
48468.101850 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::runAsMaster(...) memoryUsage =4693 MB
48468.378415 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::runTimeStepsWithFusedAlgorithmicSteps(...) local recomputation requested by at least one solver
48468.427412 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::updateMeshAndSubdomains(...) pre-spreading of limiter status
48468.837452 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::updateMeshAndSubdomains(...) perform mesh refinement
48468.837492 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48468.982716 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48468.982745 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #1, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48468.982791 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48468.982803 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48469.129704 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48469.129732 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #2, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48469.129777 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48469.129790 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48469.278224 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48469.278251 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #3, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48469.278294 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48469.278307 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48469.426106 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48469.426132 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #4, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48469.426172 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48469.426184 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48469.572144 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48469.572172 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #5, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48469.572212 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48469.572226 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48469.720586 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48469.720612 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #6, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48469.720654 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48469.720697 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48469.868148 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48469.868175 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #7, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48469.868215 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48469.868227 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48470.016876 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=1, all solvers attained stable state=1, max level=6
48470.016902 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #8, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48470.016943 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48470.016955 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=2, all solvers attained stable state=1, max level=6
48470.164718 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=3, all solvers attained stable state=1, max level=6
48470.164743 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #9, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48470.164785 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48470.164797 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=4, all solvers attained stable state=1, max level=6
48470.312895 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=5, all solvers attained stable state=1, max level=6
48470.312921 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #10, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48470.312960 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48470.312974 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=6, all solvers attained stable state=1, max level=6
48470.460639 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=1, max level=6
48470.460664 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #11, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48470.460704 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48470.460716 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=1, all solvers attained stable state=1, max level=6
48470.610736 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48470.610762 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #12, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48470.610801 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48470.610814 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48470.761530 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48470.761557 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #13, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48470.761597 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48470.761609 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48470.911284 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=1, all solvers attained stable state=1, max level=6
48470.911310 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #14, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48470.911350 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48470.911363 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=2, all solvers attained stable state=1, max level=6
48471.061626 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48471.061652 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #15, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48471.061692 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48471.061705 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48471.211935 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48471.211961 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #16, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48471.212001 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48471.212014 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48471.361122 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=1, all solvers attained stable state=1, max level=6
48471.361147 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #17, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48471.361187 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48471.361206 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=2, all solvers attained stable state=1, max level=6
48471.510989 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #18, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=0
48471.511041 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48471.511055 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(Repository) finished grid setup after 18 iterations
48471.511068 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::updateMeshAndSubdomains(...) finalise mesh refinement (if applicable)
48471.511079 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::updateMeshAndSubdomains(...) reinitialise cells and send data to neigbours (if applicable)
48471.623254 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::updateMeshAndSubdomains(...) recompute solution locally (if applicable) and compute new time step size
48471.812402 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::printTimeStepInfo(...) step 15684 t_min =0.298657
48471.812430 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::printTimeStepInfo(...) dt_min =0.000111607
48471.812446 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::printTimeStepInfo(...) inner cells/inner unrefined cells=48460/25257
48471.812463 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::printTimeStepInfo(...) inner max/min mesh width=[0.16,0.16]/[0.0177778,0.0177778]
48471.812476 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::printTimeStepInfo(...) max level=6
48471.812490 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::printTimeStepInfo(...) outer cells/outer unrefined cells=590/456
48471.812551 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::runAsMaster(...) memoryUsage =4693 MB
48472.101873 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::runTimeStepsWithFusedAlgorithmicSteps(...) mesh update requested by at least one solver
48472.150552 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::updateMeshAndSubdomains(...) pre-spreading of limiter status
48472.559120 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::updateMeshAndSubdomains(...) perform mesh refinement
48472.559160 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48472.703099 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48472.703128 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #1, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48472.703174 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48472.703186 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48472.847218 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48472.847247 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #2, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48472.847293 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48472.847307 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48472.996567 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48472.996596 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #3, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
```https://gitlab.lrz.de/exahype/ExaHyPE-Engine/-/issues/288Separate Variables from Parameters2019-07-23T10:40:15+02:00Jean-Matthieu GallardSeparate Variables from ParametersProblem: Currently parameters are stored right after the variables in luh, Q and its related arrays (lQi, lQhi, lQhbnd). This make it difficult to provide vectorized PDE options and make some operations where the parameter have to be ski...Problem: Currently parameters are stored right after the variables in luh, Q and its related arrays (lQi, lQhi, lQhbnd). This make it difficult to provide vectorized PDE options and make some operations where the parameter have to be skipped less intuitive and slower with SIMD
Solution: Introduce a new array like luh to store the parameters. This array is to be passed to the user functions using parameters (nullptr if no parameters) like luh or Q is. The linear space time predictor with split_ck already do this locally.
Issue: Will change the signatures of some user functions and formulation if they are indeed using parameters.
@ga96nuvhttps://gitlab.lrz.de/exahype/ExaHyPE-Engine/-/issues/289Luh padding and alternative layout2019-07-23T10:59:21+02:00Jean-Matthieu GallardLuh padding and alternative layoutCurrently the optimized kernels do not change luh. This was done for historical reasons (the non temp arrays had a set size independently of the kernels, now changed) and to ensure that the plotter, limiter and AMR would work no matter t...Currently the optimized kernels do not change luh. This was done for historical reasons (the non temp arrays had a set size independently of the kernels, now changed) and to ensure that the plotter, limiter and AMR would work no matter the kernels.
However being able to work with a padded luh or even further an SoS-layout luh (x,n,y,z coordinates instead of the current n,x,y,z) could provide a speedup. Currently the linear vectorized split_ck implementation does the back and forth transpositions to SoS layout and the cost of these is non negligible (even if more than compensated by the vectorization speedup).
The Limiter projections+tests and AMR can now be done using optimized kernels too so the compatibility issue here could easily be solved by generating the right kernels.
Regarding the plotters a preprocessing step to translate back luh locally could be added in case luh is non standard.
Is there a good way to do this?
Open questions: would this impact other domain of the code
@domcha @leo.rannabauer
Occurrences of luh:
-------------------
Search Term: ``getSolution()``
**exahype plotters**
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/plotters/Carpet/ADERDG2Carpet.cpp
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/plotters/Carpet/FiniteVolume2Carpet.cpp
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/plotters/CSV/ADERDG2LegendreCSV.cpp
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/plotters/CSV/Patch2CSV.cpp
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/plotters/FlashHDF5/ADERDG2FlashHDF5.cpp
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/plotters/PeanoFileFormat/ADERDG2CartesianPeanoPatchFileFormat.cpp
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/plotters/PeanoFileFormat/ADERDG2LegendrePeanoPatchFileFormat.cpp
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/plotters/PeanoFileFormat/FiniteVolumes2PeanoPatchFileFormat.cpp
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/plotters/Tecplot/ExaHyPE2Tecplot.cpp
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/plotters/VTK/ADERDG2CartesianVTK.cpp
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/plotters/VTK/ADERDG2LegendreDivergenceVTK.cpp
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/plotters/VTK/ADERDG2LegendreVTK.cpp
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/plotters/VTK/ADERDG2LobattoVTK.cpp
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/plotters/VTK/FiniteVolumes2VTK.cpp
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/plotters/VTK/LimitingADERDG2CartesianVTK.cpp
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/plotters/VTK/LimitingADERDGSubcells2CartesianVTK.cpp
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/plotters/VTK/Patch2VTK.cpp
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/plotters/ADERDG2ProbeAscii.cpp
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/plotters/ADERDG2UserDefined.cpp
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/plotters/FiniteVolumes2ProbeAscii.cpp
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/plotters/FiniteVolumes2UserDefined.cpp
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/plotters/LimitingADERDG2UserDefined.cpp
**exhaype/solvers**
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/solvers/ADERDGSolver_FusedTimeStepJob.cpp
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/solvers/ADERDGSolver_PredictionJob.cpp
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/solvers/ADERDGSolver_UpdateJob.cpp
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/solvers/ADERDGSolver.cpp
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/solvers/FiniteVolumesSolver_UpdateJob.cpp
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/solvers/FiniteVolumesSolver.cpp
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/solvers/LimitingADERDGSolver_LocalRecomputationJob.cpp
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/solvers/LimitingADERDGSolver_UpdateJob.cpp
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/solvers/LimitingADERDGSolver.cppJean-Matthieu GallardJean-Matthieu Gallardhttps://gitlab.lrz.de/exahype/ExaHyPE-Engine/-/issues/290Allow periodic boundary conditions for single-node runs2019-07-23T16:34:47+02:00Ghost UserAllow periodic boundary conditions for single-node runsThis allows to simply realise periodic boundary conditions via a lookup table.
Step 0: Initial data is known, i.e. solution at boundary is known, too. Impose this data.
Start building up the lookup table.
Step 1: Have the looku...This allows to simply realise periodic boundary conditions via a lookup table.
Step 0: Initial data is known, i.e. solution at boundary is known, too. Impose this data.
Start building up the lookup table.
Step 1: Have the lookup table. Use it.https://gitlab.lrz.de/exahype/ExaHyPE-Engine/-/issues/293Nans for gll nodes2019-08-14T15:37:26+02:00Leonhard RannabauerNans for gll nodesWe observe nans for the recently implemented gll nodes as soon as we work with amr on supermucng.
We start with a series of tests:
| Basis | Mesh | AMR | Arch | Opt | MPI | Works |
| ------ | ------ | ------ | ------ | ------ | ------ ...We observe nans for the recently implemented gll nodes as soon as we work with amr on supermucng.
We start with a series of tests:
| Basis | Mesh | AMR | Arch | Opt | MPI | Works |
| ------ | ------ | ------ | ------ | ------ | ------ | ------ |
| GLL | 25 | 1 | hsw| vect | No | yes |
| GLL | 7 | 2 | hsw| vect | No | yes |
| GL | 25 | 1 | skx| vect | Yes |yes |
| GLL | 25 | 1 | skx| vect | Yes |yes |
| GL | 25 | 2 | skx| vect | Yes | **nans** |
| GLL | 25 | 2 | skx| vect | Yes | **nans** |
| GL | 25 | 2 | skx| gen | Yes | **nans** |
| GLL | 25 | 2 | skx| gen | Yes | **nans** |
| GLL | 79 | 1 | skx| gen | Yes | yes |
| GLL | 79 | 1 | skx| gen | Yes | yes |
| GLL | 239 | 1 | skx| gen | Yes | yes |
As GL as well as GLL nodes seem to fail repeat the GL 2 AMR level test on the master branch:
| Basis | Mesh | AMR | Arch | Opt | MPI | ExaSeis | Works |
| ------ | ------ | ------ | ------ | ------ | ------ | ------ | ------ |
| GL | 25 | 2 | skx| gen | Yes | master | **nans** |
Which shows the same behaviour for default old cases.Leonhard RannabauerLeonhard Rannabauerhttps://gitlab.lrz.de/exahype/ExaHyPE-Engine/-/issues/295Local Time Stepping Plan2019-09-06T14:51:45+02:00Ghost UserLocal Time Stepping PlanWe could rather quickly implement a local time steppging version a la SeisSol
where we store the full space-time face data only for faces of coarse grid cells
along mesh resolution transitions.
Steps (in German):
* [ ] Aufbrechen des ...We could rather quickly implement a local time steppging version a la SeisSol
where we store the full space-time face data only for faces of coarse grid cells
along mesh resolution transitions.
Steps (in German):
* [ ] Aufbrechen des Extrapolations-Operators (Cell Boundary -> Single Face)
* [ ] Aufbrechen der Face Data Felder. We need one pointer/index per face.
* [ ] Mithilfe meiner Marker fuer gewisse Faces space-time Face Data speichern
* [ ] Den space Prolongationsoperator mit einem space-time Operator ersetzen (Face Prolongation -> "Volume" Prolongation (vorhanden))
* [ ] Counter im State einfuehren und dann entsprechend des Wertes nur bestimmte Levels an* [ ] und ausschalten, ginge
mit Hilfe Deiner level Information in den MappingSpecifications
* [ ] Nur am Anfang eines Batches die alte Loesung sichern (implementiert)
* [ ] Batchgroesse entsprechend des aktuellen tiefsten Verfeinerungslevels berechnen
* [ ] Rollback zu Anfang des Batches, falls das Gitter nicht gepasst hat.
Some implementational aspects
-----------------------------
Some preparational work has already been done.
* No changes to the current faceIntegral procedure need to be performed
as we already skip the integral where a Leaf cell shares an interface with a Refined ("Parent") cell.
```
const int dofsPerFace = getBndFluxSize();
for (int direction=0; direction<DIMENSIONS; direction++) {
for (int orientation=0; orientation<2; orientation++) {
const int faceIndex=2*direction+orientation;
if ( cellDescription.getFacewiseAugmentationStatus(faceIndex)<MaximumAugmentationStatus ) { // ignore Ancestors
double* const lFhbnd = static_cast<double*>(cellDescription.getFluctuation()) + dofsPerFace * faceIndex;
faceIntegral(output,lFhbnd,direction,orientation,0/*implicit conversion*/,0,cellDescription.getSize(),
cellDescription.getTimeStepSize(),addToUpdate);
}
}
}
```
https://gitlab.lrz.de/exahype/ExaHyPE-Engine/-/issues/296GradQ format2019-09-21T15:09:46+02:00Jean-Matthieu GallardGradQ formatThe format of gradQ (used by NCP and ViscousFlux) is not consistent
* Linear => like F for the flux PDE so gradQ[nDim][nVar]
* Nonlinear => all in one dimension gradQ[nDim\*nVar]
* FV => all in one dimension but with param gradQ[nDim\*...The format of gradQ (used by NCP and ViscousFlux) is not consistent
* Linear => like F for the flux PDE so gradQ[nDim][nVar]
* Nonlinear => all in one dimension gradQ[nDim\*nVar]
* FV => all in one dimension but with param gradQ[nDim\*nData]
Changing this will change the user API and break some application, however a simple adapter could allow them to run until a more in depth correction is done.
Do we need the parameter in FV?
This would also be a good time to maybe change BgradQ similarly if possible (I don't know it it would make sense) so that linear and nonlinear have the same API, even if it introduce a slight inefficiency in nonlinear/FV
@reinarz @domcha @ga24dib @leo.rannabauerJean-Matthieu GallardJean-Matthieu Gallardhttps://gitlab.lrz.de/exahype/ExaHyPE-Engine/-/issues/300Job failed with nodes=82019-09-20T15:30:57+02:00Duo Lid.li@lmu.deJob failed with nodes=8The same job works with nodes=2 on NG but failed with more nodes e.g. nodes=8.
OMP=8 and --ntasks-per-node=6
60.199790 [i01r01c04s06.sng.lrz.de],rank:40, core:16, tid:6 error exahype::solvers::ADERDGSolver::surfaceIntegral(......The same job works with nodes=2 on NG but failed with more nodes e.g. nodes=8.
OMP=8 and --ntasks-per-node=6
60.199790 [i01r01c04s06.sng.lrz.de],rank:40, core:16, tid:6 error exahype::solvers::ADERDGSolver::surfaceIntegral(...) Riemann solve was not performed on all faces of cell= (solverNumber:0,neighbourMergePerformed:[^A,^A,^A,^A,^@,^A],parentIndex:-1,type:Leaf,parentType:undefined,level:4,offset:[4,14,14],size:[1,1,1],previousTimeStamp:0,previousTimeStepSize:0.002805,timeStepSize:0.002805,timeStamp:0.002805,solutionIndex:288,solutionAveragesIndex:291,solutionCompressedIndex:-1,solution:0x7f2c50061600,solutionAverages:0x7f2c500d0e00,solutionCompressed:0,previousSolutionIndex:289,previousSolutionAveragesIndex:290,previousSolutionCompressedIndex:-1,previousSolution:0x7f2c50060100,previousSolutionAverages:0x7f2c500d0f00,previousSolutionCompressed:0,updateIndex:292,updateAveragesIndex:293,updateCompressedIndex:-1,update:0x7f2c50066080,updateAverages:0x7f2c500d7380,updateCompressed:0,extrapolatedPredictorIndex:294,extrapolatedPredictorAveragesIndex:295,extrapolatedPredictorCompressedIndex:-1,extrapolatedPredictor:0x7f2c4f9b7300,extrapolatedPredictorAverages:0x7f2c5008d800,extrapolatedPredictorCompressed:0,extrapolatedPredictorGradientIndex:-1,extrapolatedPredictorGradient:0,fluctuationIndex:296,fluctuationAveragesIndex:297,fluctuationCompressedIndex:-1,fluctuation:0x7f2c4f9bbb00,fluctuationAverages:0x7f2c5006b400,fluctuationCompressed:0,solutionMinIndex:298,solutionMaxIndex:299,solutionMin:0x7f2c50081c00,solutionMax:0x7f2c50081a00,facewiseAugmentationStatus:[2,2,2,1,3,1],augmentationStatus:2,facewiseCommunicationStatus:[2,2,2,2,1,2],communicationStatus:2,facewiseRefinementStatus:[0,0,0,0,0,0],refinementStatus:0,previousRefinementStatus:0,refinementFlag:0,compressionState:Uncompressed,bytesPerDoFInPreviousSolution:-1,bytesPerDoFInSolution:-1,bytesPerDoFInUpdate:-1,bytesPerDoFInExtrapolatedPredictor:-1,bytesPerDoFInFluctuation:-1,creation:UniformRefinement) (file:/hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/exahype/solvers/ADERDGSolver.cpp,line:1188)https://gitlab.lrz.de/exahype/ExaHyPE-Engine/-/issues/302error when use dynamic AMR in LimitedADERDG2020-11-20T15:10:48+01:00Duo Lid.li@lmu.deerror when use dynamic AMR in LimitedADERDGparameter tarch::parallel::Node::getInstance().getRank(): 17
parameter "if the neighbour data buffer is empty, you have perhaps forgotten to call releaseMessages() on the heap in the traversal before": if the neighbour data buffer is emp...parameter tarch::parallel::Node::getInstance().getRank(): 17
parameter "if the neighbour data buffer is empty, you have perhaps forgotten to call releaseMessages() on the heap in the traversal before": if the neighbour data buffer is empty, you have perhaps forgotten to call releaseMessages() on the heap in the traversal before
ExaHyPE-Diffuse: /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./Peano/peano/../peano/heap/BoundaryDataExchanger.cpph:282: void peano::heap::BoundaryDataExchanger<Data, SendReceiveTaskType, VectorContainer>::freeAllMessagesInDeployBuffer() [with Data = char, SendReceiveTaskType = peano::heap::SendReceiveTask<char>, VectorContainer = std::vector<char, std::allocator<char>>]: Assertion `false' failed.https://gitlab.lrz.de/exahype/ExaHyPE-Engine/-/issues/304Merge with Latest Peano to resolve debug logging errors2020-01-15T11:36:58+01:00Samuel TootleMerge with Latest Peano to resolve debug logging errorsWhen compiling with MODE=Debug, various errors arise related to Peano logging. I checked the Peano master repo and discovered that this issue has been resolved, however, this version has not yet been synched with Exahype sub-modules. T...When compiling with MODE=Debug, various errors arise related to Peano logging. I checked the Peano master repo and discovered that this issue has been resolved, however, this version has not yet been synched with Exahype sub-modules. This was tested using updateSubmodules.sh which results in reverting to the old git hash even after manually pulling Peano/master.