This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
software:specfem [2018/03/05 14:47] wphase |
software:specfem [2018/03/05 15:00] wphase |
||
---|---|---|---|
Line 1: | Line 1: | ||
====== SPECFEM3D_GLOBE ====== | ====== SPECFEM3D_GLOBE ====== | ||
+ | |||
==== Running SPECFEM3D_GLOBE on the Strasbourg HPC cluster with gnu 4.8 and cuda 7.5 ==== | ==== Running SPECFEM3D_GLOBE on the Strasbourg HPC cluster with gnu 4.8 and cuda 7.5 ==== | ||
Line 21: | Line 22: | ||
=== Compilation === | === Compilation === | ||
- | Before compilation, you must log in hpc-n523 (the frontal node is not yet migrated on the new OS): | + | Before compilation, make sure that required modules are loaded and CUDA_LIB, CUDA_INC environment variables are declared (see previous section). Create a run directory including directories ''DATABASE_MPI'', ''OUTPUT_FILES'', ''bin'' and ''DATA''. |
- | <code> | + | |
- | ssh hpc-n523 | + | |
- | </code> | + | |
- | + | ||
- | First make sure that required modules are loaded and CUDA_LIB, CUDA_INC environment variables are declared (see previous section). Create a run directory including directories ''DATABASE_MPI'', ''OUTPUT_FILES'', ''bin'' and ''DATA''. | + | |
In the directory ''DATA'', create ''CMTSOLUTION'', ''Par_file'' and ''STATIONS'' file (cf., SPECFEM3D_GLOBE documentation). | In the directory ''DATA'', create ''CMTSOLUTION'', ''Par_file'' and ''STATIONS'' file (cf., SPECFEM3D_GLOBE documentation). | ||
Line 285: | Line 281: | ||
echo CPUtime : $(squeue -j $SLURM_JOBID -o "%M" -h) # HH:MM:SS | echo CPUtime : $(squeue -j $SLURM_JOBID -o "%M" -h) # HH:MM:SS | ||
</code> | </code> | ||
+ | |||
+ | |||
+ | |||
+ | ==== Parallel SPECFEM3D_GLOBE RUNS ==== | ||
+ | |||
+ | To launch batch of SEM runs: | ||
+ | |||
+ | First, create an event list "Events.txt" with 3 collumns: | ||
+ | - 1st column: event_id (will also be the name of the run directory) | ||
+ | - 2nd column: path to ''CMTSOLUTION'' file for this event | ||
+ | - 3nd column: path to ''STATION'' file for this event (can be the same for all events) | ||
+ | |||
+ | Then you must setup a ''Par_file'' as described above (be careful to use a version of ''Par_file'' that is compatible with your SEM version) | ||
+ | |||
+ | The SPECFEM runs will be handled using 3 scripts: | ||
+ | - ''parallelSEM.sh'': is the main script | ||
+ | - ''run_gpu_nodelist.sh'' is the script used to run the mesher and solver | ||
+ | - ''sleep.slurm'' is a script to reserve the GPU nodes | ||
+ | |||
+ | Before running it, make sure the input parameters in ''parallelSEM.sh'' are consistent with the input parameters stated above (see ''INPUT PARAMS'' in the main script). Then run: | ||
+ | <code> | ||
+ | ./parallelSEM.sh | ||
+ | </code> | ||
+ | |||
+ |