2.1. Use AWS Management Console to Create Single VM and run CMAQv5.3.3 (software pre-installed)

Creating an EC2 instance from the AWS Management Console is easy to do. In this tutorial we will give examples on how to create and run using ec2 instances that vary in size depending on the size of the CMAQ benchmarks.

Launch an EC2 Instance using the AWS Manaement Console SPOT Pricing

Benchmark Name	Grid Domain	EC2 Instance	vCPU	Cores	Memory	Network Performance	Storage (EBS Only)	On Demand Hourly Cost	Spot Hourly Cost
2016_12SE1	(100x80x35)	c6a.2xlarge	8	4	16 GiB	Up to 12500 Megabit	gp3	0.306	0.2879

Data in table above is from the following: Sizing and Price Calculator from AWS

Run CMAQv5.3.3 on a single Virtual Machine (VM) using an ami with software pre-loaded to run on either a c6a.2xlarge instance with gp3 filesystem.

• 2.1.1. Learn how to Use the AWS Management Console to launch EC2 instance using Public AMI
  • Public AMI contains the software and data to run 2016_12SE3 using CMAQv5.3.3
    • Login to the AWs Consol and select EC2
    • Click on the orange “Launch Instance” button
    • Enter the ami name: ami-019eb54acc4924d3f in the Search box and return or enter.
    • Note this AMI was built for the following architecture, and can be used by the c6a - hpc6a family of instances
    • Search for c6a.2xlarge Instance Type and select
    • Select key pair name or create a new key pair
    • Use the default Network Settings
    • Configure Storage
    • Select the Pull-down options for Advanced details
    • In the Summary Menu, select Launch Instance
    • Click on the link to the instance once it is successfully launched
    • Wait until the Status check has been completed and the Instance State is running
    • Click on the instance link and copy the Public IP address to your clipboard
    • Use the ssh command to login to the c6a.2xlarge instance
• 2.1.2. Run CMAQv5.3.3 on c6a.2xlarge
  • Login to the ec2 instance
  • Login to the ec2 instance again, so that you have two windows logged into the machine.
• 2.1.3. Load the environment modules
• 2.1.4. Update the pcluster-cmaq repo using git
  • Verify that the input data is available
• 2.1.5. Run CMAQv5.3.3 for 2016_12SE1 1 Day benchmark Case on 4 pe
  • Use command line to submit the job. This single virtual machine does not have a job scheduler such as slurm installed.
  • Use HTOP to view performance.
  • Successful output using the gp3 volume with hyperthreading on (8vcpus)
  • Use lscpu to confirm that there are 4 cores on the c6a.2xlarge ec2 instance that was created with hyperthreading turned off (1 thread per core).
• 2.1.6. Save output data and run script logs
• 2.1.7. Save the full input data, run scripts, output data and logs to an AMI that is owned by your account.
  • Go to the EC2 Dashboard
  • Click on Instances Running
  • Select Actions Pulldown menu and select Images and templates and Create Image.
  • Fill out the name of the image
  • Click Save Image
  • Click on AMI under the left menu, and then search for the image name and confirm that the status has a green checkmark and available
• 2.1.8. Stop Instance
  • Go to the EC2 Dashboard
  • Click on Instances Running
  • Select Instance State Pulldown menu and select stop instance
  • Select Instance State Pulldown menu and select terminate instance.
  • When the pop-up menu asks if you are sure you want to terminate the instance, click on the orange Terminate button.