- 浏览: 134695 次
- 性别:
- 来自: 北京
文章分类
最新评论
-
fascism219:
哇!您这篇博客写的太好了,看了以后感觉很受用!我最近正在做CE ...
移植CESM1.2和运行CLM4.5问题汇总 -
deepfuture:
不错,用栈来实现递归,速度和效率较高,建议部分栈操作这块用内联 ...
数据结构:栈应用_求解汉诺塔(Hanoi)1
This article comes from the URL: http://websrv.cs.umt.edu/isis/index.php/CESM_exercise_I:_checkout,_build,_and_run_model
_____________________________________________________________________________________
CESM exercise I: checkout, build, and run model
From Interactive System for Ice sheet Simulation
Contents[hide ] |
Back to Thursday, March 24th
Lab exercise: Running CCSM
In this exercise you will get a copy of the Community Earth System Model, create a case, and then modify, build and run the code. CESM is very user-friendly in the sense that once you have it installed on your local computer, you need to execute only a few commands in order to run the model. These commands can be summarized as follows:
- Create a case (choose which model components to run on which grids)
- Configure the model
- Build the model
- Run the model
Here you will learn how each command works. Then you will use CESM to compute the surface mass balance of the Greenland ice sheet.
Get a copy of CESM
CESM has already been installed on a BNU supercomputer. So you just need to log in and copy the code to your home directory.
First, open a terminal window and log onto the machine.
> ssh -X -l login_name 210.31.66.230
Then enter your password.
You should now be in your home directory, /home/login_name . To see the directory contents:
> ls
Now copy a CESM tarball to your home directory:
> cp /home/jidy/cesm1_0_2.tar.gz .
Unzip and untar the file:
> tar -xzvf cesm1_0_2.tar.gz
A long list of files will scroll down the screen. Look again at the contents of your home directory:
> ls
You should now have a directory called cesm1_0_2, containing a recent release of CESM version 1.0. Go to this directory:
> cd cesm1_0_2
Take a quick look at the code:
> ls
You will see directories called models and scripts . As we will see, the scripts directory contains useful scripts for creating new cases and tests. Let's first look in the models directory:
> cd models > ls
The models directory contains several subdirectories:
- atm = atmosphere
- ocn = ocean
- lnd = land
- ice = sea ice
- glc = ice sheet (CISM)
- drv = driver (includes coupler modules)
- csm_share = shared code
- utils = utilities
NOTE: In CESM, ice refers to the sea ice model. The ice-sheet model is not in the ice directory, but in the glc directory. Let's take a quick tour of glc :
> cd glc > ls
The active ice sheet model is in the cism (Community Ice Sheet Model) directory. The directories sglc and xglc contain the stub and dead components.
Go to the CISM directory:
> cd cism > ls
The source code resides in several subdirectories:
- source_glimmer-cism = Glimmer-CISM code
- source_slap = code that is part of the SLAP solver library
- source_glc = code needed to link Glimmer-CISM to the CESM coupler
- drivers = more code associated with the coupler
The other CESM models (atm , lnd , ocn , and ice ) are structured in a similar way.
Create a case
There are many ways to configure and run CESM. For example, you can run various combinations of active, data, and stub components at different grid resolutions. A particular combination of components and grids is called a case .
You will now create a case that consists of an active land component (CLM, the Community Land Model), an active ice-sheet component (CISM, the Community Ice Sheet Model), a data atmosphere component, and stub ocean and sea ice components. The data atmosphere component is from an NCEP reanalysis at T62 (~1.5 deg) resolution. The land model will (among many other things) compute a surface mass balance that is used to force the ice sheet model.
To create a case, go to the scripts directory.
> cd ~/your-home-dir /cesm1_0_2/scripts > ls
We will run a script called create_newcase . A simple way of creating a new case (if running on an NCAR machine called bluefire ) might look as follows:
> ./create_newcase -case casename -mach bluefire -res 1.9x2.5_gx1v6 -compset IG
where
- casename is the name of the case, which you make up yourself
- mach = the name or type of computer where you are running the model
-
res
= resolution
- 1.9x2.5 = 1.9 x 2.5 degree grid for the atmosphere and land models
- 0.9x1.25 = 0.9 x 1.25 degree grid for the atmosphere and land models
- T31 = spectral T31 grid (relatively coarse) for the atmosphere and land models
- gx1v6 = 1 degree grid, version 6 for the ocean and sea ice models
- gx3v7 = 3 degree grid, version 7 for the ocean and sea ice models
-
compset
= set of active physical components, for example:
- A: all data models; no active physical components
- I: active land
- IG: active land and ice sheet
- F: active land and atmosphere
- FG: active land, atmosphere, and ice sheet
- B: active land, atmosphere, ocean, and sea ice
- BG: active land, atmosphere, ocean, sea ice, and ice sheet
Many other compsets are allowed. For examples, please see the CESM User's Guide: http://www.cesm.ucar.edu/models/cesm1.0/cesm/
Here is the command you would use on the BNU machine to create an IG case called (naturally enough) IGcase:
> ./create_newcase -case IGcase -mach generic_linux_intel -compset IG -res f19_g16 -scratchroot ~/your-home-dir /swgfs -din_loc_root_csmdata /mnt/swgfs/pub/CCSM4/inputdata -max_tasks_per_node 8
where
- f19_g16 means the same thing as 1.9x2.5_gx1v6 .
- The directory /mnt/swgfs/pub/CCSM4/inputdata contains input data that is used for various CESM compsets.
- The case name and scratchroot determine where the model will be built and executed--in this case, ~/your-home-dir/swgfs/IGcase .
NOTE: The different parts of the command are shown in separate lines to make them easier to read. But you should type them like this:
> ./create_newcase -case IGcase -mach generic_linux_intel -compset IG -res f19_g16 -scratchroot ~/your-home-dir /swgfs -din_loc_root_csmdata /mnt/swgfs/pub/CCSM4/inputdata -max_tasks_per_node 8
Now create a case using the command above. If successful, you will see on your screen a message like this:
> Successfully created the case for generic_linux_intel
Configure and build the model
Next, you will configure and build CESM for your IG case. Go to your new case directory:
> cd IGcase > ls
There are several files with the suffix xml . These files are used to set various model options and parameters.
Look at env_conf.xml :
> less env_conf.xml
For ice-sheet modeling, a setting of interest is $GLC_GRID. The default value is gland20, which refers to the 20-km Greenland grid. If you wanted to run with a finer grid, you would change this to gland10 or gland5. But for this exercise, the 20-km grid works fine.
Next, look at env_mach_pes.xml :
> less env_mach_pes.xml
This file determines how many processors are assigned to each model component. For our case the processors will be assigned to each component sequentially during each time step. In other words, all the processors available will be used first to run the atmosphere model, then to run the land model, and so on until the end of the time step.
The default number of processors is 64. Since we have a limited number of processors available, we will change env_mach_pes.xml to assign 16 processors sequentially to each model.
Although xml files can be edited manually, it is safer to use the xmlchange command. Type the following to make changes in env_mach_pes.xml :
> xmlchange -file env_mach_pes.xml -id NTASKS_ATM -val 16 > xmlchange -file env_mach_pes.xml -id NTASKS_LND -val 16 > xmlchange -file env_mach_pes.xml -id NTASKS_ICE -val 16 > xmlchange -file env_mach_pes.xml -id NTASKS_OCN -val 16 > xmlchange -file env_mach_pes.xml -id NTASKS_CPL -val 16
These changes must be made before you configure the code. Currently, the glc component runs on only one processor, so you should not change the value of NTASKS_GLC.
Now configure the code by typing this:
> ./configure -case
Look again in the case directory:
> ls
If the configure is successful, you will have several new scripts:
- IGcase.generic_linux_intel.build
- IGcase.generic_linux_intel.clean_build
- IGcase.generic_linux_intel.run
- IGcase.generic_linux_intel.submit
Now the code is ready to build. But before we build it, let's make things more interesting by making a small change. Your IG case is configured to run with atmospheric data for the year 2003 from an NCEP reanalysis. What if the surface air temperature were higher or lower than the values in the reanalysis?
To find out, you can change a single line of code in CLM. The safest way to change a file is to make a copy of the file in one of your SourceMods directories and change it there, leaving the original version unchanged. In this way you can easily keep track of your code changes.
The file you will modify is called DriverInitMod.F90, and it is part of the CLM source code. Type the following to copy it to the CLM SourceMods directory:
> cp ~/your-home-dir /cesm1_0_2/models/lnd/clm/src/biogeophys/clm_driverInitMod.F90 SourceMods/src.clm/
Now go to the CLM SourceMods directory:
> cd SourceMods/src.clm > ls
There will be a single file, clm_driverInitMod.F90 . When the code is built, any files that are in this directory will automatically replace files of the same name in the CLM source code directory (in this case, ~/ your-home-dir/cesm1_0_2/models/lnd/clm/src/biogeophys/clm_driverInitMod.F90 ).
You will edit the version of clm_driverInitMod.F90 in the CLM SourceMods directory. Find this line of code:
> tbot_c = tbot_g-lapse_glcmec*(hsurf_c-hsurf_g) ! sfc temp for column
This part of the code sets the surface air temperature, tbot_c , for glacier columns. Recall that in each grid cell containing glacial ice, the glaciated area is divided into several columns, each with a different elevation. The surface air temperature at the mean gridcell elevation is tbot_g . For each column, tbot_g is adjusted by adding a term proportional to the elevation difference between the mean gridcell elevation hsurf_g and the local column elevation hsurf_c .
You will change this line to something like this:
> tbot_c = tbot_g-lapse_glcmec*(hsurf_c-hsurf_g) + 1.0 ! sfc temp for column, plus one degree
When you are ready to make this change, please tell one of the instructors. We will make sure that each group chooses a different value for the temperature change.
In this way you will have a crude version of a global warming (or cooling) simulation. Later we will see how this temperature change affects the surface mass balance of the Greenland ice sheet.
Once you've made your code changes in SourceMods/src.clm, go back to the case directory (that is, go back to the ~/ your-home-dir/cesm1_0_2/scripts/IGcase/ directory) and build the model:
> cd ../.. > ls > nohup IGcase.generic_linux_intel.build &
Recall that the nohup command will force the build to occur in the background and the & symbol will give you your original shell back (thus, if your putty session fails, your build will still take place and you can log back in later and come back to it).
If the build fails, you will get an error message pointing you to a log file in another directory. If you look at the bottom of that log file, you will usually see what went wrong. Because we put the job in the background using nohup , you will not see any updates on the build printed to your screen. In order to check on the status of your build you can type
> less nohup.out
If you are not sure what to do, please ask for assistance from an instructor.
The build will take about 20 minutes, so we'll take a break now. If you rebuild later after making minor changes, the build should not take as long.
If the code builds successfully, you will see on your screen a message like this:
> CCSM BUILDEXE SCRIPT HAS FINISHED SUCCESSFULLY
Run the model
Now you are ready to run CESM. Go to your case directory if you are not there already:
> cd ~/your-home-dir /cesm1_0_2/scripts/IGcase
First look at the file env_run.xml :
> less env_run.xml
This file contains a number of options that you may want to change after you build the code, but before you submit a run.
For now, the most important options are STOP_N and STOP_OPTION, which determine the length of the model run. The default values are STOP_OPTION = ndays and STOPN = 5. This means the code will run for 5 days--just long enough to make sure nothing is seriously broken. It is a good idea to try a 5-day run before attempting a longer run.
Go ahead and submit the batch job:
> IGcase.generic_linux_intel.submit
If all is well, you will get a message like this:
> check_case OK > sbatch: Submitted batch job 18242
To check the job status, type this:
> squeue
You should see on your screen a message like this:
> JOBID PARTITION NAME USER ST TIME NODES NODELIST(REASON) > 18242 XPART IGcase william R 0:30 2 cn[126-127]
where
- JOBID = job identification number
- NAME = the name of your case
- USER = your user name
- ST = job status (R means that the job is running)
- TIME = clock time elapsed since your job began running
- NODES = number of nodes on which your job is running (note that there are 8 processors per node)
- NODELIST = a list of the nodes on which your job is running
If no job is listed under your user name, then your job is done.
If all goes well, the job will start and finish within one or two minutes. To see if the job completed, look at the output file in your case directory:
> less batch-jobid .out
If the job finished successfully, you will see some lines like this near the end:
> CCSM PRESTAGE SCRIPT HAS FINISHED SUCCESSFULLY > Tue Mar 22 15:33:56 CST 2011 -- CSM EXECUTION BEGINS HERE > Tue Mar 22 15:34:25 CST 2011 -- CSM EXECUTION HAS FINISHED > (seq_mct_drv): =============== SUCCESSFUL TERMINATION OF CPL7-CCSM ===============
Some log files will have been written to your logs directory. Let's look at them:
> cd logs > ls
These files have a suffix .gz, which means they have been compressed. Uncompress the glc log file and take a look:
> gunzip glc.log.110322-153330.gz > less glc.log.110322-153330
NOTE: The 12-digit number is a date stamp of the form yymmdd-hhmmss. This date stamp is for a run that began on 22 March 2011 at 1533 hr, 30 sec. Your file name will have a different date stamp.
Scroll through the log file. You will see information about the Glimmer-CISM input parameters, followed by some model diagnostics that are written out during the run. If the run finished successfully, you will see this near the end:
> Successful completion of glc model
There are similar log files for the coupler, land, and atmosphere components (cpl , lnd , and atm ). The logfile with the ccsm prefix combines diagnostics from each component.
Now return to your case directory:
> cd ..
Once you have finished a 5-day run, you are ready to try a longer run. We will run the model for 6 years. In the file env_run.xml , change the values of STOP_OPTION and STOP_N:
> xmlchange -file env_run.xml -id STOP_OPTION -val nyears > xmlchange -file env_run.xml -id STOP_N -val 6
Then submit the batch job as before:
> IGcase.generic_linux_intel.submit
Again, you should see a message like this:
> check_case OK > sbatch: Submitted batch job 18243
After a minute or so, check the job status:
> squeue
When everyone's job is running, we will take a break.
A 6-year run will take about 2 hours to complete. We will look at some results after lunch.
发表评论
-
Running CCSM4
2014-10-13 11:40 1585Reprinted from http://wiki.sc ... -
移植CESM1.2和运行CLM4.5问题汇总
2013-08-29 16:02 5517The Community Land Model (CLM ... -
LSM、CLM和SIB[转载]
2012-01-16 17:30 6673文章来源 http://blog.sina.com.cn/s ... -
Introduction to CESM [Reprint]
2011-11-02 17:20 1188This article comes from : http: ... -
CPL7用户指南(中文版)_第二章 CPL7 用户指南
2011-10-11 11:24 19712.1 综述(General Over ... -
CPL7用户指南(中文版)_第一章 CPL7介绍
2011-10-09 19:38 15241.1 摘要 这篇文档探 ...
相关推荐
CESM构建 Scinet的Niagara上CESM的源代码和使用说明。...移至刚刚下载的cesm_sandbox文件夹,然后运行checkout externals命令以获取特定于组件的源代码(陆地,大气层,海冰,海洋等)。 确保在签出之前已加载Subver
CESM(Community Earth System Model)是一款开放源代码的地球系统模型,由美国国家大气研究中心(NCAR)开发和维护。这个模型旨在模拟地球系统的复杂动态,包括大气、海洋、冰川、陆地表面以及生物地球化学过程。源...
在这个名为"cesm_SourceMods"的项目中,我们聚焦于CESM1的一个关键组件——CAM5(Climate Model version 5)的源代码修改。 CAM5是CESM1中的大气成分模块,它模拟了大气动力学、辐射、云物理、水循环等多个过程。源...
请参阅CESM网站以获取文档和信息: 《 CESM快速入门指南》可从以下网站获得: 该存储库提供了用于管理组成CESM标签的外部组件的工具-alpha,beta和发行版。 CESM标签创建应通过NCAR的CSEG进行协调。 此存储库还...
例如,要运行安装在本地的“ cesm”目录(/ Users / me / cesm)的交互式bash shell,请执行以下操作: docker运行-it -v / Users / me / cesm:/ home / user escomp / cesm-2.1 注意:对于具有许多内核的系统,您...
CESM2_bash_scripts 这些文件的目的是自动...run_build_cesm:设置批处理提交脚本,指示用户在指示的分区上请求的cpus,内存和时间分配。 这将根据用户需求而变化。 该脚本在每次提交时清除“构建”。 2.清理旧版本:
CESM_postprocessing 基于CESM python的后处理代码的项目存储库,通过Wiki的文档,以及问题跟踪。 此代码所需的输入数据集与此存储库分开。 访问这些数据集的说明即将发布。 对于NCAR用户,数据集已经加载到林间空地...
【标题】"CESM_CPL7andDataComps:cpl7数据模型"涉及的是一个用于气候模拟的高级软件系统——地球系统模型(Community Earth System Model, 简称CESM)。这里的"CPL7"指的是该模型的一个特定版本,即耦合器版本7...
cesm_cloud_locking CESM中云锁定的源代码修改。 该存储库提供了代码修改和有关云锁定的说明。 用户负责将代码应用于自己的CESM版本。 入门 获取代码的本地副本; 只需将存储库克隆到适当的位置。 先决条件 用户将...
标题中的“CESM和WRF数据,转成nc文件”涉及到的是两个主要的气候和环境模拟模型:Community Earth System Model (CESM) 和 Weather Research and Forecasting (WRF) 模型,以及如何将它们产生的数据转换为netCDF ...
- **CLM CESM**:这部分指明了CLM(Community Land Model)和CESM(Community Earth System Model)之间的关系。CESM是一个集成地球系统模型,由多个组件构成,其中CLM就是其组成部分之一。CLM专注于陆地表面过程,...
CLM4.5(Community Land Model version 4.5)是CESM1.2.0(Community Earth System Model version 1.2.0)中的一个关键组成部分,主要用于模拟陆地表面的气候过程。它在前一版本的基础上进行了多项改进和更新,旨在...
AWS上的CESM LENS 使用xarray和dask在Amazon S3(us-west-2区域)上公开提供的分析示例。 使用Pangeo Binder重新创建笔记本 在Pangeo Binder上尝试使用这些笔记本。 请注意,该会话是短暂的。 您的主目录不会持久...
9. **Run Directory (Build/Run Directory)**:运行时产生的数据存储位置。 10. **Exe Root**:存放可执行文件的位置。 实践部分涉及了几个关键步骤来改变模型设置: 1. **Component Sets**:选择不同的组件集,...
matlab循环读图的代码Lets_play_with_CESM 当我学习如何使用CESM,从中导出运输矩阵以及优化某些生物地球化学参数时,该存储库将为我服务,并为其他人服务。 目录 介绍 社区地球系统模型(CESM 1)由位于美国...
通用地球系统模式 CESM 1.2.2.1版本 源码包 cesm1_2_2_1-r91831.tgz 通用地球系统模式(CESM)是美国国家大气研究中心最新推出的地球系统耦合模式,对解决气候(地球)系统建模中所涉及的新挑战和新问题具有很大的帮助。
CMIP6温度数据
在这个"2019 Community Terrestrial Systems Model Tutorial_01"中,我们将深入探讨如何使用CESM(社区地球系统模型)中的CLM5.0进行气候模拟及基本分析。Danica Lombardozzi在NCAR(美国国家大气研究中心)的支持下...
CESM烟尘烟气在线监测系统是一种用于实时监控工业排放烟气中污染物浓度的高科技设备,特别适用于监测SO2、NOx和烟尘等有害物质。该系统采用了紫外差分吸收光谱技术,该技术被国家环保总局和美国环境保护组织(USEPA...
CESM合奏海洋 用于CESM大中型乐团中海冰分析的代码 版本更新:0:K. Barnhart在6月下旬/ 7月初上载的代码的初始版本。 此代码中的某些输入/输出不适合在Yellowstone / Glade上运行。 Barnhart当前正在修改代码,以便...