ExaHyPE-Engine issueshttps://gitlab.lrz.de/exahype/ExaHyPE-Engine/-/issues2020-01-15T11:36:58+01:00https://gitlab.lrz.de/exahype/ExaHyPE-Engine/-/issues/304Merge with Latest Peano to resolve debug logging errors2020-01-15T11:36:58+01:00Samuel TootleMerge with Latest Peano to resolve debug logging errorsWhen compiling with MODE=Debug, various errors arise related to Peano logging. I checked the Peano master repo and discovered that this issue has been resolved, however, this version has not yet been synched with Exahype sub-modules. T...When compiling with MODE=Debug, various errors arise related to Peano logging. I checked the Peano master repo and discovered that this issue has been resolved, however, this version has not yet been synched with Exahype sub-modules. This was tested using updateSubmodules.sh which results in reverting to the old git hash even after manually pulling Peano/master.https://gitlab.lrz.de/exahype/ExaHyPE-Engine/-/issues/303error in compilation2019-10-15T09:38:50+02:00Duo Lid.li@lmu.deerror in compilationwhen compiling master Exahype, i have a bunch of errors with GaussLobattoBasis.hsnippet:
In file included from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/kernels/GaussLobattoBasis.h(20),
from ...when compiling master Exahype, i have a bunch of errors with GaussLobattoBasis.hsnippet:
In file included from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/kernels/GaussLobattoBasis.h(20),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/kernels/aderdg/generic/Kernels.h(28),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/include/Context/../Curvilinear/CurvilinearTransformation.h(6),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/include/Context/ContextCurvilinear.h(11),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/SlipWeakeningSolver.h(28),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/SlipWeakeningSolver.cpp(9):
/hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/kernels/generated/GaussLobattoBasis.hsnippet(1): error: expected a declaration
namespace kernels {
^
In file included from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/kernels/GaussLobattoBasis.h(20),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/kernels/aderdg/generic/Kernels.h(28),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/include/Context/../Curvilinear/CurvilinearTransformation.h(6),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/include/Context/ContextCurvilinear.h(11),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/SlipWeakeningSolver.h(28),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/SlipWeakeningSolver.cpp(9):
/hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/kernels/generated/GaussLobattoBasis.hsnippet(22): warning #12: parsing restarts here after previous syntax error
extern double nodes_1[1+1];
^
In file included from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/kernels/GaussLobattoBasis.h(20),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/kernels/aderdg/generic/Kernels.h(28),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/include/Context/../Curvilinear/CurvilinearTransformation.h(6),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/include/Context/ContextCurvilinear.h(11),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/SlipWeakeningSolver.h(28),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/SlipWeakeningSolver.cpp(9):
/hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/kernels/generated/GaussLobattoBasis.hsnippet(23): error: invalid storage class for a class member
extern double nodes_2[2+1];
^
In file included from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/kernels/GaussLobattoBasis.h(20),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/kernels/aderdg/generic/Kernels.h(28),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/include/Context/../Curvilinear/CurvilinearTransformation.h(6),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/include/Context/ContextCurvilinear.h(11),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/SlipWeakeningSolver.h(28),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/SlipWeakeningSolver.cpp(9):
/hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/kernels/generated/GaussLobattoBasis.hsnippet(24): error: invalid storage class for a class member
extern double nodes_3[3+1];
^
In file included from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/kernels/GaussLobattoBasis.h(20),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/kernels/aderdg/generic/Kernels.h(28),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/include/Context/../Curvilinear/CurvilinearTransformation.h(6),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/include/Context/ContextCurvilinear.h(11),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/SlipWeakeningSolver.h(28),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/SlipWeakeningSolver.cpp(9):
/hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/kernels/generated/GaussLobattoBasis.hsnippet(25): error: invalid storage class for a class member
extern double nodes_4[4+1];
^
In file included from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/kernels/GaussLobattoBasis.h(20),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/kernels/aderdg/generic/Kernels.h(28),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/include/Context/../Curvilinear/CurvilinearTransformation.h(6),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/include/Context/ContextCurvilinear.h(11),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/SlipWeakeningSolver.h(28),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/SlipWeakeningSolver.cpp(9):
/hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/kernels/generated/GaussLobattoBasis.hsnippet(26): error: invalid storage class for a class member
extern double nodes_5[5+1];
^
In file included from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/kernels/GaussLobattoBasis.h(20),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/kernels/aderdg/generic/Kernels.h(28),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/include/Context/../Curvilinear/CurvilinearTransformation.h(6),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/include/Context/ContextCurvilinear.h(11),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/SlipWeakeningSolver.h(28),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/SlipWeakeningSolver.cpp(9):
/hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/kernels/generated/GaussLobattoBasis.hsnippet(27): error: invalid storage class for a class member
extern double nodes_6[6+1];
^
In file included from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/kernels/GaussLobattoBasis.h(20),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/kernels/aderdg/generic/Kernels.h(28),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/include/Context/../Curvilinear/CurvilinearTransformation.h(6),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/include/Context/ContextCurvilinear.h(11),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/SlipWeakeningSolver.h(28),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/SlipWeakeningSolver.cpp(9):
/hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/kernels/generated/GaussLobattoBasis.hsnippet(28): error: invalid storage class for a class member
extern double nodes_7[7+1];
^
In file included from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/kernels/GaussLobattoBasis.h(20),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/kernels/aderdg/generic/Kernels.h(28),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/include/Context/../Curvilinear/CurvilinearTransformation.h(6),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/include/Context/ContextCurvilinear.h(11),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/SlipWeakeningSolver.h(28),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/SlipWeakeningSolver.cpp(9):
/hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/kernels/generated/GaussLobattoBasis.hsnippet(29): error: invalid storage class for a class member
extern double nodes_8[8+1];
^
In file included from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/kernels/GaussLobattoBasis.h(20),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/kernels/aderdg/generic/Kernels.h(28),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/include/Context/../Curvilinear/CurvilinearTransformation.h(6),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/include/Context/ContextCurvilinear.h(11),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/SlipWeakeningSolver.h(28),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/SlipWeakeningSolver.cpp(9):
/hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/kernels/generated/GaussLobattoBasis.hsnippet(30): error: invalid storage class for a class member
extern double nodes_9[9+1];
^
In file included from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/kernels/GaussLobattoBasis.h(20),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/kernels/aderdg/generic/Kernels.h(28),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/include/Context/../Curvilinear/CurvilinearTransformation.h(6),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/include/Context/ContextCurvilinear.h(11),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/SlipWeakeningSolver.h(28),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/SlipWeakeningSolver.cpp(9):
/hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/kernels/generated/GaussLobattoBasis.hsnippet(31): error: invalid storage class for a class member
extern double nodes_10[10+1];
^
In file included from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/kernels/GaussLobattoBasis.h(20),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/kernels/aderdg/generic/Kernels.h(28),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/include/Context/../Curvilinear/CurvilinearTransformation.h(6),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/include/Context/ContextCurvilinear.h(11),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/SlipWeakeningSolver.h(28),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/SlipWeakeningSolver.cpp(9):
/hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/kernels/generated/GaussLobattoBasis.hsnippet(32): error: invalid storage class for a class member
extern double nodes_11[11+1];
^
In file included from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/kernels/GaussLobattoBasis.h(20),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/kernels/aderdg/generic/Kernels.h(28),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/include/Context/../Curvilinear/CurvilinearTransformation.h(6),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/include/Context/ContextCurvilinear.h(11),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/SlipWeakeningSolver.h(28),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/SlipWeakeningSolver.cpp(9):
/hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/kernels/generated/GaussLobattoBasis.hsnippet(33): error: invalid storage class for a class member
extern double nodes_12[12+1];
^
In file included from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/kernels/GaussLobattoBasis.h(20),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/kernels/aderdg/generic/Kernels.h(28),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/include/Context/../Curvilinear/CurvilinearTransformation.h(6),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/include/Context/ContextCurvilinear.h(11),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/SlipWeakeningSolver.h(28),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/SlipWeakeningSolver.cpp(9):
/hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/kernels/generated/GaussLobattoBasis.hsnippet(34): error: invalid storage class for a class member
extern double nodes_13[13+1];
^
In file included from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/kernels/GaussLobattoBasis.h(20),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/kernels/aderdg/generic/Kernels.h(28),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/include/Context/../Curvilinear/CurvilinearTransformation.h(6),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/include/Context/ContextCurvilinear.h(11),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/SlipWeakeningSolver.h(28),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/SlipWeakeningSolver.cpp(9):
/hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/kernels/generated/GaussLobattoBasis.hsnippet(35): error: invalid storage class for a class member
extern double nodes_14[14+1];
^
In file included from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/kernels/GaussLobattoBasis.h(20),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/kernels/aderdg/generic/Kernels.h(28),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/include/Context/../Curvilinear/CurvilinearTransformation.h(6),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/include/Context/ContextCurvilinear.h(11),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/SlipWeakeningSolver.h(28),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/SlipWeakeningSolver.cpp(9):
/hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/kernels/generated/GaussLobattoBasis.hsnippet(36): error: invalid storage class for a class member
extern double nodes_15[15+1];
^
In file included from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/kernels/GaussLobattoBasis.h(20),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/kernels/aderdg/generic/Kernels.h(28),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/include/Context/../Curvilinear/CurvilinearTransformation.h(6),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/include/Context/ContextCurvilinear.h(11),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/SlipWeakeningSolver.h(28),
from /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ApplicationExamples/ExaSeis/DynamicRupture/TPV29/SlipWeakeningSolver.cpp(9):
/hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/kernels/generated/GaussLobattoBasis.hsnippet(37): error: invalid storage class for a class member
extern double* nodes[15+1];
does any one have any idea?https://gitlab.lrz.de/exahype/ExaHyPE-Engine/-/issues/302error when use dynamic AMR in LimitedADERDG2020-11-20T15:10:48+01:00Duo Lid.li@lmu.deerror when use dynamic AMR in LimitedADERDGparameter tarch::parallel::Node::getInstance().getRank(): 17
parameter "if the neighbour data buffer is empty, you have perhaps forgotten to call releaseMessages() on the heap in the traversal before": if the neighbour data buffer is emp...parameter tarch::parallel::Node::getInstance().getRank(): 17
parameter "if the neighbour data buffer is empty, you have perhaps forgotten to call releaseMessages() on the heap in the traversal before": if the neighbour data buffer is empty, you have perhaps forgotten to call releaseMessages() on the heap in the traversal before
ExaHyPE-Diffuse: /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./Peano/peano/../peano/heap/BoundaryDataExchanger.cpph:282: void peano::heap::BoundaryDataExchanger<Data, SendReceiveTaskType, VectorContainer>::freeAllMessagesInDeployBuffer() [with Data = char, SendReceiveTaskType = peano::heap::SendReceiveTask<char>, VectorContainer = std::vector<char, std::allocator<char>>]: Assertion `false' failed.https://gitlab.lrz.de/exahype/ExaHyPE-Engine/-/issues/300Job failed with nodes=82019-09-20T15:30:57+02:00Duo Lid.li@lmu.deJob failed with nodes=8The same job works with nodes=2 on NG but failed with more nodes e.g. nodes=8.
OMP=8 and --ntasks-per-node=6
60.199790 [i01r01c04s06.sng.lrz.de],rank:40, core:16, tid:6 error exahype::solvers::ADERDGSolver::surfaceIntegral(......The same job works with nodes=2 on NG but failed with more nodes e.g. nodes=8.
OMP=8 and --ntasks-per-node=6
60.199790 [i01r01c04s06.sng.lrz.de],rank:40, core:16, tid:6 error exahype::solvers::ADERDGSolver::surfaceIntegral(...) Riemann solve was not performed on all faces of cell= (solverNumber:0,neighbourMergePerformed:[^A,^A,^A,^A,^@,^A],parentIndex:-1,type:Leaf,parentType:undefined,level:4,offset:[4,14,14],size:[1,1,1],previousTimeStamp:0,previousTimeStepSize:0.002805,timeStepSize:0.002805,timeStamp:0.002805,solutionIndex:288,solutionAveragesIndex:291,solutionCompressedIndex:-1,solution:0x7f2c50061600,solutionAverages:0x7f2c500d0e00,solutionCompressed:0,previousSolutionIndex:289,previousSolutionAveragesIndex:290,previousSolutionCompressedIndex:-1,previousSolution:0x7f2c50060100,previousSolutionAverages:0x7f2c500d0f00,previousSolutionCompressed:0,updateIndex:292,updateAveragesIndex:293,updateCompressedIndex:-1,update:0x7f2c50066080,updateAverages:0x7f2c500d7380,updateCompressed:0,extrapolatedPredictorIndex:294,extrapolatedPredictorAveragesIndex:295,extrapolatedPredictorCompressedIndex:-1,extrapolatedPredictor:0x7f2c4f9b7300,extrapolatedPredictorAverages:0x7f2c5008d800,extrapolatedPredictorCompressed:0,extrapolatedPredictorGradientIndex:-1,extrapolatedPredictorGradient:0,fluctuationIndex:296,fluctuationAveragesIndex:297,fluctuationCompressedIndex:-1,fluctuation:0x7f2c4f9bbb00,fluctuationAverages:0x7f2c5006b400,fluctuationCompressed:0,solutionMinIndex:298,solutionMaxIndex:299,solutionMin:0x7f2c50081c00,solutionMax:0x7f2c50081a00,facewiseAugmentationStatus:[2,2,2,1,3,1],augmentationStatus:2,facewiseCommunicationStatus:[2,2,2,2,1,2],communicationStatus:2,facewiseRefinementStatus:[0,0,0,0,0,0],refinementStatus:0,previousRefinementStatus:0,refinementFlag:0,compressionState:Uncompressed,bytesPerDoFInPreviousSolution:-1,bytesPerDoFInSolution:-1,bytesPerDoFInUpdate:-1,bytesPerDoFInExtrapolatedPredictor:-1,bytesPerDoFInFluctuation:-1,creation:UniformRefinement) (file:/hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/exahype/solvers/ADERDGSolver.cpp,line:1188)https://gitlab.lrz.de/exahype/ExaHyPE-Engine/-/issues/299Compilation error2019-10-16T10:05:11+02:00Duo Lid.li@lmu.deCompilation errorI compiled with mpi.intel/2017 and tbb/2017, after update Exahype and submodules.
Here attached the errors:
/import/deadlock-data/dli/ExaHyPE/ExaHyPE-Engine/./ExaHyPE/exahype/solvers/ADERDGSolver_ProlongationJob.cpp(42): error: argument...I compiled with mpi.intel/2017 and tbb/2017, after update Exahype and submodules.
Here attached the errors:
/import/deadlock-data/dli/ExaHyPE/ExaHyPE-Engine/./ExaHyPE/exahype/solvers/ADERDGSolver_ProlongationJob.cpp(42): error: argument of type "double *" is incompatible with parameter of type "const char *"
_mm_prefetch(lQhbnd, _MM_HINT_NTA);
^
/import/deadlock-data/dli/ExaHyPE/ExaHyPE-Engine/./ExaHyPE/exahype/solvers/ADERDGSolver_ProlongationJob.cpp(43): error: argument of type "double *" is incompatible with parameter of type "const char *"
_mm_prefetch(lFhbnd, _MM_HINT_NTA);
^
compilation aborted for /import/deadlock-data/dli/ExaHyPE/ExaHyPE-Engine/./ExaHyPE/exahype/solvers/ADERDGSolver_ProlongationJob.cpp (code 2)
/import/deadlock-data/dli/ExaHyPE/ExaHyPE-Engine/./ExaHyPE/Makefile:626: recipe for target '/import/deadlock-data/dli/ExaHyPE/ExaHyPE-Engine/./ExaHyPE/exahype/solvers/ADERDGSolver_ProlongationJob.o’ failedhttps://gitlab.lrz.de/exahype/ExaHyPE-Engine/-/issues/298Compilation error in peano::heap2019-09-17T12:34:46+02:00Duo Lid.li@lmu.deCompilation error in peano::heap/exahype/mappings/PredictionOrLocalRecomputation.o
/hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/exahype/mappings/DropNeighbourMessages.cpp(228): error: class "peano::heap::AbstractHeap" has no member "allHeapsDro.../exahype/mappings/PredictionOrLocalRecomputation.o
/hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/exahype/mappings/DropNeighbourMessages.cpp(228): error: class "peano::heap::AbstractHeap" has no member "allHeapsDropReceivedBoundaryData"
peano::heap::AbstractHeap::allHeapsDropReceivedBoundaryData();
^
compilation aborted for /hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/exahype/mappings/DropNeighbourMessages.cpp (code 2)
/hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/Makefile:626: recipe for target '/hppfs/work/pr63qo/di52lak2/ExaHyPE_deadlock/ExaHyPE-Engine/./ExaHyPE/exahype/mappings/DropNeighbourMessages.o' failedhttps://gitlab.lrz.de/exahype/ExaHyPE-Engine/-/issues/297FiniteVolumeSolver error about time step2020-11-20T17:30:31+01:00Duo Lid.li@lmu.deFiniteVolumeSolver error about time stepWhen running FV, there is this error. I use CFL=0.7. How to fix the warning or how does it matter to the code.
```cpp
if ( !tarch::la::equals(cellDescription.getTimeStepSize(), 0.0) && tarch::la::smaller(admissibleTimeStepSize,cellDesc...When running FV, there is this error. I use CFL=0.7. How to fix the warning or how does it matter to the code.
```cpp
if ( !tarch::la::equals(cellDescription.getTimeStepSize(), 0.0) && tarch::la::smaller(admissibleTimeStepSize,cellDescription.getTimeStepSize()) ) {
logWarning("updateSolution(...)","Finite volumes solver time step size harmed CFL condition. dt="<<
cellDescription.getTimeStepSize()<<", dt_adm=" << admissibleTimeStepSize << ". cell=" <<cellDescription.toString());
}
```https://gitlab.lrz.de/exahype/ExaHyPE-Engine/-/issues/296GradQ format2019-09-21T15:09:46+02:00Jean-Matthieu GallardGradQ formatThe format of gradQ (used by NCP and ViscousFlux) is not consistent
* Linear => like F for the flux PDE so gradQ[nDim][nVar]
* Nonlinear => all in one dimension gradQ[nDim\*nVar]
* FV => all in one dimension but with param gradQ[nDim\*...The format of gradQ (used by NCP and ViscousFlux) is not consistent
* Linear => like F for the flux PDE so gradQ[nDim][nVar]
* Nonlinear => all in one dimension gradQ[nDim\*nVar]
* FV => all in one dimension but with param gradQ[nDim\*nData]
Changing this will change the user API and break some application, however a simple adapter could allow them to run until a more in depth correction is done.
Do we need the parameter in FV?
This would also be a good time to maybe change BgradQ similarly if possible (I don't know it it would make sense) so that linear and nonlinear have the same API, even if it introduce a slight inefficiency in nonlinear/FV
@reinarz @domcha @ga24dib @leo.rannabauerJean-Matthieu GallardJean-Matthieu Gallardhttps://gitlab.lrz.de/exahype/ExaHyPE-Engine/-/issues/295Local Time Stepping Plan2019-09-06T14:51:45+02:00Ghost UserLocal Time Stepping PlanWe could rather quickly implement a local time steppging version a la SeisSol
where we store the full space-time face data only for faces of coarse grid cells
along mesh resolution transitions.
Steps (in German):
* [ ] Aufbrechen des ...We could rather quickly implement a local time steppging version a la SeisSol
where we store the full space-time face data only for faces of coarse grid cells
along mesh resolution transitions.
Steps (in German):
* [ ] Aufbrechen des Extrapolations-Operators (Cell Boundary -> Single Face)
* [ ] Aufbrechen der Face Data Felder. We need one pointer/index per face.
* [ ] Mithilfe meiner Marker fuer gewisse Faces space-time Face Data speichern
* [ ] Den space Prolongationsoperator mit einem space-time Operator ersetzen (Face Prolongation -> "Volume" Prolongation (vorhanden))
* [ ] Counter im State einfuehren und dann entsprechend des Wertes nur bestimmte Levels an* [ ] und ausschalten, ginge
mit Hilfe Deiner level Information in den MappingSpecifications
* [ ] Nur am Anfang eines Batches die alte Loesung sichern (implementiert)
* [ ] Batchgroesse entsprechend des aktuellen tiefsten Verfeinerungslevels berechnen
* [ ] Rollback zu Anfang des Batches, falls das Gitter nicht gepasst hat.
Some implementational aspects
-----------------------------
Some preparational work has already been done.
* No changes to the current faceIntegral procedure need to be performed
as we already skip the integral where a Leaf cell shares an interface with a Refined ("Parent") cell.
```
const int dofsPerFace = getBndFluxSize();
for (int direction=0; direction<DIMENSIONS; direction++) {
for (int orientation=0; orientation<2; orientation++) {
const int faceIndex=2*direction+orientation;
if ( cellDescription.getFacewiseAugmentationStatus(faceIndex)<MaximumAugmentationStatus ) { // ignore Ancestors
double* const lFhbnd = static_cast<double*>(cellDescription.getFluctuation()) + dofsPerFace * faceIndex;
faceIntegral(output,lFhbnd,direction,orientation,0/*implicit conversion*/,0,cellDescription.getSize(),
cellDescription.getTimeStepSize(),addToUpdate);
}
}
}
```
https://gitlab.lrz.de/exahype/ExaHyPE-Engine/-/issues/294Halo Refinement Threshold2019-09-05T17:49:25+02:00Ghost UserHalo Refinement ThresholdAim:
Prevent that the mesh refinement iterations are triggered to often.
Background:
During the mesh refinement iterations, we refine the Leaf cell parents of those Virtual cells
that carry a refinement status greater than zero.
Cur...Aim:
Prevent that the mesh refinement iterations are triggered to often.
Background:
During the mesh refinement iterations, we refine the Leaf cell parents of those Virtual cells
that carry a refinement status greater than zero.
Currently, the time stepping iterations trigger refinement
as soon as a Virtual cell carries positive refinement status.
Especially with low order ADER-DG plus Limiter, mesh refinement is triggered quite often,
which seems to be related to the CFL time step size: "Shock does not stay "long" in the same cell".
Approach:
During the time stepping iterations, allow Virtual cells to carry
a refinement status smaller some positive threshold value.
Only if this threshold value is reached, trigger that
the mesh is adapted.
Additional, we could think about allowing erasing only every $k$ mesh adaptions (=set of mesh refinement iterations).https://gitlab.lrz.de/exahype/ExaHyPE-Engine/-/issues/293Nans for gll nodes2019-08-14T15:37:26+02:00Leonhard RannabauerNans for gll nodesWe observe nans for the recently implemented gll nodes as soon as we work with amr on supermucng.
We start with a series of tests:
| Basis | Mesh | AMR | Arch | Opt | MPI | Works |
| ------ | ------ | ------ | ------ | ------ | ------ ...We observe nans for the recently implemented gll nodes as soon as we work with amr on supermucng.
We start with a series of tests:
| Basis | Mesh | AMR | Arch | Opt | MPI | Works |
| ------ | ------ | ------ | ------ | ------ | ------ | ------ |
| GLL | 25 | 1 | hsw| vect | No | yes |
| GLL | 7 | 2 | hsw| vect | No | yes |
| GL | 25 | 1 | skx| vect | Yes |yes |
| GLL | 25 | 1 | skx| vect | Yes |yes |
| GL | 25 | 2 | skx| vect | Yes | **nans** |
| GLL | 25 | 2 | skx| vect | Yes | **nans** |
| GL | 25 | 2 | skx| gen | Yes | **nans** |
| GLL | 25 | 2 | skx| gen | Yes | **nans** |
| GLL | 79 | 1 | skx| gen | Yes | yes |
| GLL | 79 | 1 | skx| gen | Yes | yes |
| GLL | 239 | 1 | skx| gen | Yes | yes |
As GL as well as GLL nodes seem to fail repeat the GL 2 AMR level test on the master branch:
| Basis | Mesh | AMR | Arch | Opt | MPI | ExaSeis | Works |
| ------ | ------ | ------ | ------ | ------ | ------ | ------ | ------ |
| GL | 25 | 2 | skx| gen | Yes | master | **nans** |
Which shows the same behaviour for default old cases.Leonhard RannabauerLeonhard Rannabauerhttps://gitlab.lrz.de/exahype/ExaHyPE-Engine/-/issues/290Allow periodic boundary conditions for single-node runs2019-07-23T16:34:47+02:00Ghost UserAllow periodic boundary conditions for single-node runsThis allows to simply realise periodic boundary conditions via a lookup table.
Step 0: Initial data is known, i.e. solution at boundary is known, too. Impose this data.
Start building up the lookup table.
Step 1: Have the looku...This allows to simply realise periodic boundary conditions via a lookup table.
Step 0: Initial data is known, i.e. solution at boundary is known, too. Impose this data.
Start building up the lookup table.
Step 1: Have the lookup table. Use it.https://gitlab.lrz.de/exahype/ExaHyPE-Engine/-/issues/289Luh padding and alternative layout2019-07-23T10:59:21+02:00Jean-Matthieu GallardLuh padding and alternative layoutCurrently the optimized kernels do not change luh. This was done for historical reasons (the non temp arrays had a set size independently of the kernels, now changed) and to ensure that the plotter, limiter and AMR would work no matter t...Currently the optimized kernels do not change luh. This was done for historical reasons (the non temp arrays had a set size independently of the kernels, now changed) and to ensure that the plotter, limiter and AMR would work no matter the kernels.
However being able to work with a padded luh or even further an SoS-layout luh (x,n,y,z coordinates instead of the current n,x,y,z) could provide a speedup. Currently the linear vectorized split_ck implementation does the back and forth transpositions to SoS layout and the cost of these is non negligible (even if more than compensated by the vectorization speedup).
The Limiter projections+tests and AMR can now be done using optimized kernels too so the compatibility issue here could easily be solved by generating the right kernels.
Regarding the plotters a preprocessing step to translate back luh locally could be added in case luh is non standard.
Is there a good way to do this?
Open questions: would this impact other domain of the code
@domcha @leo.rannabauer
Occurrences of luh:
-------------------
Search Term: ``getSolution()``
**exahype plotters**
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/plotters/Carpet/ADERDG2Carpet.cpp
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/plotters/Carpet/FiniteVolume2Carpet.cpp
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/plotters/CSV/ADERDG2LegendreCSV.cpp
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/plotters/CSV/Patch2CSV.cpp
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/plotters/FlashHDF5/ADERDG2FlashHDF5.cpp
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/plotters/PeanoFileFormat/ADERDG2CartesianPeanoPatchFileFormat.cpp
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/plotters/PeanoFileFormat/ADERDG2LegendrePeanoPatchFileFormat.cpp
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/plotters/PeanoFileFormat/FiniteVolumes2PeanoPatchFileFormat.cpp
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/plotters/Tecplot/ExaHyPE2Tecplot.cpp
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/plotters/VTK/ADERDG2CartesianVTK.cpp
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/plotters/VTK/ADERDG2LegendreDivergenceVTK.cpp
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/plotters/VTK/ADERDG2LegendreVTK.cpp
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/plotters/VTK/ADERDG2LobattoVTK.cpp
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/plotters/VTK/FiniteVolumes2VTK.cpp
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/plotters/VTK/LimitingADERDG2CartesianVTK.cpp
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/plotters/VTK/LimitingADERDGSubcells2CartesianVTK.cpp
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/plotters/VTK/Patch2VTK.cpp
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/plotters/ADERDG2ProbeAscii.cpp
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/plotters/ADERDG2UserDefined.cpp
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/plotters/FiniteVolumes2ProbeAscii.cpp
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/plotters/FiniteVolumes2UserDefined.cpp
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/plotters/LimitingADERDG2UserDefined.cpp
**exhaype/solvers**
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/solvers/ADERDGSolver_FusedTimeStepJob.cpp
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/solvers/ADERDGSolver_PredictionJob.cpp
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/solvers/ADERDGSolver_UpdateJob.cpp
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/solvers/ADERDGSolver.cpp
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/solvers/FiniteVolumesSolver_UpdateJob.cpp
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/solvers/FiniteVolumesSolver.cpp
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/solvers/LimitingADERDGSolver_LocalRecomputationJob.cpp
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/solvers/LimitingADERDGSolver_UpdateJob.cpp
/ExaHyPE-Engine_upstream/ExaHyPE/exahype/solvers/LimitingADERDGSolver.cppJean-Matthieu GallardJean-Matthieu Gallardhttps://gitlab.lrz.de/exahype/ExaHyPE-Engine/-/issues/288Separate Variables from Parameters2019-07-23T10:40:15+02:00Jean-Matthieu GallardSeparate Variables from ParametersProblem: Currently parameters are stored right after the variables in luh, Q and its related arrays (lQi, lQhi, lQhbnd). This make it difficult to provide vectorized PDE options and make some operations where the parameter have to be ski...Problem: Currently parameters are stored right after the variables in luh, Q and its related arrays (lQi, lQhi, lQhbnd). This make it difficult to provide vectorized PDE options and make some operations where the parameter have to be skipped less intuitive and slower with SIMD
Solution: Introduce a new array like luh to store the parameters. This array is to be passed to the user functions using parameters (nullptr if no parameters) like luh or Q is. The linear space time predictor with split_ck already do this locally.
Issue: Will change the signatures of some user functions and formulation if they are indeed using parameters.
@ga96nuvhttps://gitlab.lrz.de/exahype/ExaHyPE-Engine/-/issues/287Add Limiter Recomputation Background Jobs2019-07-24T15:23:13+02:00Ghost UserAdd Limiter Recomputation Background JobsIn simulations where there are many FV recomputations,
the respective phases can become a bottleneck.In simulations where there are many FV recomputations,
the respective phases can become a bottleneck.https://gitlab.lrz.de/exahype/ExaHyPE-Engine/-/issues/286Observed issues using AMR with erase2019-08-02T16:52:06+02:00Ghost UserObserved issues using AMR with eraseI have observe a couple of issue that can be reproduced with the current version of application SFDI:
1. Only one refine level and erase lead to the error reported below. This happen with applications:
SFDI, parfile, after step 121, ti...I have observe a couple of issue that can be reproduced with the current version of application SFDI:
1. Only one refine level and erase lead to the error reported below. This happen with applications:
SFDI, parfile, after step 121, time=0.0100127:
[SFDI_2D_1refissue.exahype](/uploads/1bc47bc22d0e688354210422775a3eae/SFDI_2D_1refissue.exahype)
GPRDR, parfile:
[GPRDR_2D.exahype](/uploads/d1bce4d670a633a4b76abe519ceb102a/GPRDR_2D.exahype)
101.299009 [hilbert],rank:0, core:30, tid:13 error exahype::solvers::ADERDGSolver::surfaceIntegral(...) Riemann solve was not performed on all faces of cell= (solverNumber:0,neighbourMergePerformed:[,,,],hasCompletedLastStep:0,parentIndex:3492,hasVirtualChildren:0,type:Cell,refinementEvent:None,level:6,offset:[1.07173,0.244726],size:[0.0168776,0.0168776],previousTimeStamp:inf,previousTimeStepSize:inf,timeStepSize:0.000121198,timeStamp:0.0100127,solutionIndex:91946,solutionAveragesIndex:91949,solutionCompressedIndex:-...
2. After a certain time it continue to run but the time does not increase, see the log below. The same issue appears also with a coarsest mesh ("maximum_mesh_size": 1.0) but later:
parfile:
[SFDI_2D_issue1.exahype](/uploads/c31d7ac41db8ae6e36dac320299a233a/SFDI_2D_issue1.exahype)
```
48460.082966 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48460.082980 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(Repository) finished grid setup after 20 iterations
48460.082992 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::updateMeshAndSubdomains(...) finalise mesh refinement (if applicable)
48460.083004 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::updateMeshAndSubdomains(...) reinitialise cells and send data to neigbours (if applicable)
48460.194436 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::updateMeshAndSubdomains(...) recompute solution locally (if applicable) and compute new time step size
48460.385842 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::printTimeStepInfo(...) step 15681 t_min =0.298657
48460.385869 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::printTimeStepInfo(...) dt_min =0.000111607
48460.385885 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::printTimeStepInfo(...) inner cells/inner unrefined cells=48460/25257
48460.385902 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::printTimeStepInfo(...) inner max/min mesh width=[0.16,0.16]/[0.0177778,0.0177778]
48460.385915 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::printTimeStepInfo(...) max level=6
48460.385929 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::printTimeStepInfo(...) outer cells/outer unrefined cells=590/456
48460.385976 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::runAsMaster(...) memoryUsage =4693 MB
48460.664413 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::runTimeStepsWithFusedAlgorithmicSteps(...) local recomputation requested by at least one solver
48460.711840 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::updateMeshAndSubdomains(...) pre-spreading of limiter status
48461.121757 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::updateMeshAndSubdomains(...) perform mesh refinement
48461.121796 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48461.265934 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48461.265964 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #1, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48461.266009 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48461.266022 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48461.413310 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48461.413336 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #2, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48461.413380 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48461.413393 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48461.560601 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48461.560629 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #3, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48461.560671 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48461.560684 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48461.707636 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48461.707664 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #4, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48461.707708 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48461.707722 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48461.853066 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48461.853091 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #5, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48461.853132 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48461.853144 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48461.999806 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48461.999834 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #6, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48461.999879 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48461.999924 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48462.147141 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48462.147168 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #7, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48462.147211 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48462.147224 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48462.293720 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=1, all solvers attained stable state=1, max level=6
48462.293745 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #8, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48462.293787 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48462.293800 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=2, all solvers attained stable state=1, max level=6
48462.440954 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=3, all solvers attained stable state=1, max level=6
48462.440980 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #9, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48462.441020 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48462.441032 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=4, all solvers attained stable state=1, max level=6
48462.588360 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=5, all solvers attained stable state=1, max level=6
48462.588385 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #10, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48462.588425 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48462.588438 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=6, all solvers attained stable state=1, max level=6
48462.735102 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=1, max level=6
48462.735127 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #11, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48462.735167 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48462.735179 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=1, all solvers attained stable state=1, max level=6
48462.884632 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48462.884659 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #12, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48462.884701 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48462.884715 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48463.035295 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48463.035321 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #13, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48463.035361 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48463.035374 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48463.184642 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=1, all solvers attained stable state=1, max level=6
48463.184669 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #14, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48463.184711 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48463.184724 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=2, all solvers attained stable state=1, max level=6
48463.334715 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48463.334742 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #15, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48463.334783 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48463.334797 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48463.484046 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48463.484072 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #16, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48463.484112 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48463.484125 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48463.632638 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=1, all solvers attained stable state=1, max level=6
48463.632665 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #17, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48463.632705 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48463.632718 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=2, all solvers attained stable state=1, max level=6
48463.781876 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #18, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=0
48463.781928 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48463.781941 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(Repository) finished grid setup after 18 iterations
48463.781953 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::updateMeshAndSubdomains(...) finalise mesh refinement (if applicable)
48463.781964 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::updateMeshAndSubdomains(...) reinitialise cells and send data to neigbours (if applicable)
48463.894936 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::updateMeshAndSubdomains(...) recompute solution locally (if applicable) and compute new time step size
48464.081949 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::printTimeStepInfo(...) step 15682 t_min =0.298657
48464.081988 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::printTimeStepInfo(...) dt_min =0.000111607
48464.082004 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::printTimeStepInfo(...) inner cells/inner unrefined cells=48460/25257
48464.082021 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::printTimeStepInfo(...) inner max/min mesh width=[0.16,0.16]/[0.0177778,0.0177778]
48464.082034 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::printTimeStepInfo(...) max level=6
48464.082046 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::printTimeStepInfo(...) outer cells/outer unrefined cells=590/456
48464.082093 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::runAsMaster(...) memoryUsage =4693 MB
48464.369570 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::runTimeStepsWithFusedAlgorithmicSteps(...) mesh update requested by at least one solver
48464.418752 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::updateMeshAndSubdomains(...) pre-spreading of limiter status
48464.827970 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::updateMeshAndSubdomains(...) perform mesh refinement
48464.828009 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48464.974119 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48464.974148 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #1, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48464.974190 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48464.974202 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48465.122067 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48465.122095 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #2, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48465.122138 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48465.122153 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48465.269962 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48465.269989 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #3, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48465.270062 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48465.270076 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48465.417461 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48465.417487 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #4, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48465.417526 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48465.417537 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48465.564058 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48465.564084 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #5, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48465.564126 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48465.564139 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48465.711640 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48465.711667 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #6, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48465.711708 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48465.711720 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48465.859318 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48465.859344 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #7, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48465.859385 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48465.859398 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48466.007531 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48466.007558 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #8, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48466.007601 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48466.007614 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48466.155125 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48466.155152 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #9, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48466.155194 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48466.155207 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48466.301976 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=1, all solvers attained stable state=1, max level=6
48466.302002 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #10, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48466.302044 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48466.302056 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=2, all solvers attained stable state=1, max level=6
48466.449749 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=3, all solvers attained stable state=1, max level=6
48466.449774 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #11, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48466.449810 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48466.449823 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=4, all solvers attained stable state=1, max level=6
48466.598445 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=5, all solvers attained stable state=1, max level=6
48466.598474 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #12, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48466.598521 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48466.598533 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=6, all solvers attained stable state=1, max level=6
48466.749009 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=1, max level=6
48466.749042 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #13, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48466.749093 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48466.749106 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=1, all solvers attained stable state=1, max level=6
48466.902091 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48466.902119 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #14, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48466.902161 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48466.902173 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48467.053397 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48467.053424 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #15, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48467.053463 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48467.053475 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48467.204646 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=1, all solvers attained stable state=1, max level=6
48467.204672 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #16, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48467.204710 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48467.204723 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=2, all solvers attained stable state=1, max level=6
48467.354426 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48467.354451 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #17, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48467.354489 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48467.354502 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48467.503538 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48467.503563 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #18, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48467.503600 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48467.503613 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48467.653651 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=1, all solvers attained stable state=1, max level=6
48467.653677 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #19, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48467.653716 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48467.653729 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=2, all solvers attained stable state=1, max level=6
48467.803491 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #20, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=0
48467.803575 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48467.803589 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(Repository) finished grid setup after 20 iterations
48467.803602 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::updateMeshAndSubdomains(...) finalise mesh refinement (if applicable)
48467.803614 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::updateMeshAndSubdomains(...) reinitialise cells and send data to neigbours (if applicable)
48467.915869 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::updateMeshAndSubdomains(...) recompute solution locally (if applicable) and compute new time step size
48468.101707 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::printTimeStepInfo(...) step 15683 t_min =0.298657
48468.101733 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::printTimeStepInfo(...) dt_min =0.000111607
48468.101750 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::printTimeStepInfo(...) inner cells/inner unrefined cells=48460/25257
48468.101766 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::printTimeStepInfo(...) inner max/min mesh width=[0.16,0.16]/[0.0177778,0.0177778]
48468.101779 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::printTimeStepInfo(...) max level=6
48468.101801 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::printTimeStepInfo(...) outer cells/outer unrefined cells=590/456
48468.101850 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::runAsMaster(...) memoryUsage =4693 MB
48468.378415 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::runTimeStepsWithFusedAlgorithmicSteps(...) local recomputation requested by at least one solver
48468.427412 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::updateMeshAndSubdomains(...) pre-spreading of limiter status
48468.837452 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::updateMeshAndSubdomains(...) perform mesh refinement
48468.837492 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48468.982716 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48468.982745 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #1, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48468.982791 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48468.982803 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48469.129704 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48469.129732 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #2, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48469.129777 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48469.129790 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48469.278224 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48469.278251 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #3, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48469.278294 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48469.278307 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48469.426106 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48469.426132 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #4, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48469.426172 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48469.426184 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48469.572144 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48469.572172 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #5, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48469.572212 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48469.572226 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48469.720586 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48469.720612 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #6, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48469.720654 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48469.720697 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48469.868148 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48469.868175 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #7, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48469.868215 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48469.868227 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48470.016876 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=1, all solvers attained stable state=1, max level=6
48470.016902 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #8, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48470.016943 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48470.016955 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=2, all solvers attained stable state=1, max level=6
48470.164718 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=3, all solvers attained stable state=1, max level=6
48470.164743 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #9, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48470.164785 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48470.164797 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=4, all solvers attained stable state=1, max level=6
48470.312895 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=5, all solvers attained stable state=1, max level=6
48470.312921 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #10, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48470.312960 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48470.312974 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=6, all solvers attained stable state=1, max level=6
48470.460639 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=1, max level=6
48470.460664 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #11, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48470.460704 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48470.460716 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=1, all solvers attained stable state=1, max level=6
48470.610736 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48470.610762 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #12, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48470.610801 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48470.610814 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48470.761530 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48470.761557 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #13, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48470.761597 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48470.761609 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48470.911284 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=1, all solvers attained stable state=1, max level=6
48470.911310 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #14, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48470.911350 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48470.911363 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=2, all solvers attained stable state=1, max level=6
48471.061626 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48471.061652 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #15, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48471.061692 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48471.061705 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48471.211935 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48471.211961 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #16, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48471.212001 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48471.212014 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48471.361122 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=1, all solvers attained stable state=1, max level=6
48471.361147 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #17, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48471.361187 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48471.361206 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=0, initial refinement=0, stable iterations in a row=2, all solvers attained stable state=1, max level=6
48471.510989 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #18, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=0
48471.511041 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48471.511055 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(Repository) finished grid setup after 18 iterations
48471.511068 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::updateMeshAndSubdomains(...) finalise mesh refinement (if applicable)
48471.511079 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::updateMeshAndSubdomains(...) reinitialise cells and send data to neigbours (if applicable)
48471.623254 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::updateMeshAndSubdomains(...) recompute solution locally (if applicable) and compute new time step size
48471.812402 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::printTimeStepInfo(...) step 15684 t_min =0.298657
48471.812430 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::printTimeStepInfo(...) dt_min =0.000111607
48471.812446 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::printTimeStepInfo(...) inner cells/inner unrefined cells=48460/25257
48471.812463 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::printTimeStepInfo(...) inner max/min mesh width=[0.16,0.16]/[0.0177778,0.0177778]
48471.812476 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::printTimeStepInfo(...) max level=6
48471.812490 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::printTimeStepInfo(...) outer cells/outer unrefined cells=590/456
48471.812551 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::runAsMaster(...) memoryUsage =4693 MB
48472.101873 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::runTimeStepsWithFusedAlgorithmicSteps(...) mesh update requested by at least one solver
48472.150552 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::updateMeshAndSubdomains(...) pre-spreading of limiter status
48472.559120 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::updateMeshAndSubdomains(...) perform mesh refinement
48472.559160 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48472.703099 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48472.703128 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #1, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48472.703174 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48472.703186 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48472.847218 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48472.847247 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #2, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
48472.847293 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid(...) memoryUsage =4693 MB
48472.847307 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48472.996567 [hilbert],rank:0, core:4, tid:0 info exahype::State::continueToConstructGrid(...) grid construction not yet finished. grid balanced=1, grid stationary=1, still in refining mode=1, initial refinement=0, stable iterations in a row=0, all solvers attained stable state=0, max level=6
48472.996596 [hilbert],rank:0, core:4, tid:0 info exahype::runners::Runner::createGrid() grid setup iteration #3, max-level=6, idle-nodes=0, vertical solver communication=0, continue to construct grid=1
```https://gitlab.lrz.de/exahype/ExaHyPE-Engine/-/issues/283Use ADER CFL Correction Factors When Determining FV Patch Resolution2019-07-09T15:18:48+02:00Ghost UserUse ADER CFL Correction Factors When Determining FV Patch ResolutionThe ADER-DG time step size does not only depend on the DG CFL number that
scales with ``1/(2*N+1)`` but by an additional order-dependent correction factor ``C_ADER(N)``.
For order 5, e.g., this factor is roughly 0.5.
We currently use 2*...The ADER-DG time step size does not only depend on the DG CFL number that
scales with ``1/(2*N+1)`` but by an additional order-dependent correction factor ``C_ADER(N)``.
For order 5, e.g., this factor is roughly 0.5.
We currently use 2*N+1 FV cells per FV patch in our implementation of the a posteriori
limiting ADER-DG method. The motivation is to match the time step size
of the coupled ADER-DG and the FV scheme.
This does not take the correction factor into account, i.e. we add unneccessary
numerical dissipation as we use unnecessary small time step sizes in the FV cells.
Using the same ADER-DG time step size, we can increase the FV cell sizes by
a factor ``1/C_ADER(N)``. For order 5, e.g., we can double the size of the FV patches.
The following table corrects the patch sizes. I round down to not go below the ADER-DG time step size with
the FV time step sizes.
| Order N | 0 | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 |
|-------------------------------------|---------|--------|--------|--------|--------|---------|---------|---------|---------|---------|
| C_ADER | 100.0 % | 99.0 % | 85.0 % | 70.0 % | 62.1 % | 49.5 % | 49.4 % | 45.0 % | 34.0 % | 28.5 % |
| Patch Scaling | 1.00 | 1.01 | 1.18 | 1.43 | 1.61 | 2.02 | 2.02 | 2.22 | 2.94 | 3.51 |
| Corr. Patch Size (Orig. Patch Size) | 1 | 3 | 5 | 10 (7) | 14 (9) | 22 (11) | 26 (13) | 33 (15) | 50 (17) | 66 (19) |
Tasks
-----
Proposed switch "Limiting-ADER-DG" solver specification:
``"patch_size" : ("original" | "max" | number)``
- ``max`` would look up the corrected patch size in a lookup table.
- ``original`` would use the original 2*order+1.
- ``number`` would use a user prescribed number. Control code must
check if the FV time step size is smaller or equal to the ADER-DG time step size.
Otherwise, an error must be printed out **OR** the ADER-DG method's CFL condition must be adjusted.
If a number is specified, then the ADER-DG to FV projectors have to be constructed manually.
For "max" and "original", they can be precomputed once.
* [x] Decide if a generic implementation of the patch size feasible or if the corrected patch sizes should be hardcoded?.
**A:** *Eventually both but first the hardcoded versions.*
* [x] Modify toolkit's solver controllers and templates:
* [x] ``exahype-specfile.schema.json``: Extend ``patch_size`` option in spec file schema
* [x] ``exahype/toolkit/solverController.py``: Take ``patch_size`` parameter into account.
Found issue: Defaults are not set.
* [x] Generic kernels:
* [x] Check that the CFL factor is picked up properly in the ADER-DG stableTimeStepSize kernel
* [x] ``GenericLimiterSolver(Header|Implementation).template``:
* [x] Update arguments passed to limiter kernels
* [x] Allocate Limiter projection matrices
* Dimensions:
* ``uh2lim[n] = new double[basisSize*basisSizeLim]();``
* ``uh2lob[n] = new double[basisSize*basisSize]();``
* ``lim2uh[n] = new double[basisSizeLim*basisSize]();``
* [x] Look up the FV to DG least-squares projection
* Main reference: M. Dumbser et al., *A posteriori subcell limiting of the discontinuous Galerkin finite element method for hyperbolic conservation laws*, Journal of Computational Physics, vol. 278, pp. 47–75, Dec. 2014.
* Least-squares reference: M. Dumbser and M. Käser, *Arbitrary high order non-oscillatory finite volume schemes on unstructured meshes for linear hyperbolic systems*, Journal of Computational Physics, vol. 221, no. 2, pp. 693–723, Feb. 2007.
* Objective function is
```math
\min_{u_h} \| u_h(x) - v_h(x) \|_{L^2(K)} = ([A] \{u\} - \{v\}) \cdot ([A] \{u\} - \{v\})
```
s.t. mass conservation constraint. $`[A]`$ is the DG to FV projection matrix. The objective function evaluates the DG solution $`u_h`$ at the FV cell centers $`v_h`$.
* Mass conservation constraint:
```math
\int_K u_h(x) dx = \int_K v_h(x)\,\text{d}x
```
```math
\sum_i u_i \int_{\bar K} \bar\phi_i (\bar x) \text{d}\bar x =
\sum_j v_j \cdot \frac{\bar V}{\bar K}
```
```math
\sum_i u_i w_i =
\sum_j v_j \cdot \frac{1}{\text{volumes per patch}}
```
```math
[C] \{u\} = [R] \{v\}
```
Above steps exploited properties of DG basis functions (Gauss-Legendre support points).
* Constraint coupled via Lagrange multiplier. Updated objective function:
```math
f = ([A] \{u\} - \{v\}) \cdot ([A] \{u\} - \{v\}) + \lambda \cdot ([C] \{u\} - [R] \{v\})
```
*
* Optimality condition (degrees of freedom/parameters: $`\{u\}`$ and $`\lambda`$):
```math
\begin{pmatrix}
2 [A] [A] & -[C]\\
[C] & 0
\end{pmatrix}
\cdot
\begin{pmatrix}
\{u\}\\
\lambda
\end{pmatrix}
=
\begin{pmatrix}
2\,[A]\,\{v\}\\
[R]\,\{v\}
\end{pmatrix}
```
To obtain solution $`\{u\}`$ and Lagrange multipliers $`\lambda`$, the
equations must be inverted. $`C`$ is sparse due to the tensor product structure.
$`[A]`$ is dense. As each nodal DG DOF is associated with a basis functions,
the above procedure yields a FV to DG projector.
* I can reuse JM's existing code. Essential is that I replace $`[A]`$, which I do anyway.
Convenient.
* [x] ``kernels/limiter/generic/Limiter.(h|cpp)``: Update signatures to take limiter patch size into account
* [x] ``LimiterProjectionMatrices.(h|cpp)``: Do not use original functions anymore
* [x] Optimised kernels:
* [x] Check if changes are necessary in ``OptimisedLimiterSolver(Header|Implementation).template``
* [x] Make sure ``dg2fv``, ``fv2dg`` and ``nDofLim``, ``nDofLimPad``, ``getBasisSizeLimiter()`,
and ``getBasisSizeLimiterPadded()`` are defined and used correctly:
* [x] Usage:
* [x] CodeGenerator/codegenerator/templates/configurationParameters_cpph.template (20 matches)
* [x] CodeGenerator/codegenerator/templates/limiter_cpp.template (51 matches)
* [x] CodeGenerator/codegenerator/templates/Quadrature_cpp.template (2 matches)
* [x] Definition:
* [x] CodeGenerator/codegenerator/templates/controller.py (5 matches)
* [x] CodeGenerator/codegenerator/models/limiterModel.py (29 matches)
* [x] CodeGenerator/codegenerator/models/quadratureModel.py (4 matches)https://gitlab.lrz.de/exahype/ExaHyPE-Engine/-/issues/282Multi-level Inheritance in Sweep2019-05-16T00:08:36+02:00Ghost UserMulti-level Inheritance in SweepCurrently, a config file can only inherit from one other file.
Just have to write a recursive function for this. Shouldn't be too hard.Currently, a config file can only inherit from one other file.
Just have to write a recursive function for this. Shouldn't be too hard.https://gitlab.lrz.de/exahype/ExaHyPE-Engine/-/issues/280Pass coordinates to nonConservativeProduct2019-05-02T17:55:34+02:00Ghost UserPass coordinates to nonConservativeProduct~~Currently, it is the only PDE function where we do not pass the coordinates in.~~
We actually do not pass the coordinates to the flux and the eigenvalues kernels, too.
18 kernel files need to be changed.
Workaround
----------
Specif...~~Currently, it is the only PDE function where we do not pass the coordinates in.~~
We actually do not pass the coordinates to the flux and the eigenvalues kernels, too.
18 kernel files need to be changed.
Workaround
----------
Specify the coordinates or a coefficient depending on the coordinates as material parameter.https://gitlab.lrz.de/exahype/ExaHyPE-Engine/-/issues/279Plot NaNs2019-04-24T23:40:18+02:00Ghost UserPlot NaNsVTK is able to visualise NaNs.
Currently, the plotters omit NaNs. This is not necessary.VTK is able to visualise NaNs.
Currently, the plotters omit NaNs. This is not necessary.