HPC Environment Advanced Setup

The Advanced Configuration setup option provides many different options for types and quantity of storage and compute nodes, complexity of compute group and scheduler configurations.

Procedure

Follow the steps below to create an Advanced Configuration Environment:

  1. On the Environment Overview main screen, click the “+” button at the top left to create a new environment.
  2. Use the pulldown menu to select options for Environment Region, Instance SSH Key, Environment Availability Zone and CloudyCluster Version. The newest version of CloudyCluster is always recommended.
  3. Enter a Name for your Environment.
  4. Select the Advanced Configuration link at the bottom of the screen.
  5. If you want to specify a fixed number of compute group instances, select the Fixed Compute Group check box and enter a compute group name.
  6. Select the compute instance type from the pulldown menu and enter the number of dedicated compute instances.
  7. Enter a scheduler name and select scheduler type and instance type from the pulldown menus.
  8. Select a Compute Volume Type.
  9. If you want to set up a Dynamic Job-Scaling compute group instead of a fixed size compute group, select the Job-Scaling Scheduler and Compute Group with CCQ check box.
  10. If you want to use OrangeFS, select the Parallel Storage check box and select your Storage Instance Type from the pulldown menu. You may opt to use Amazon’s EFS file system if it is available in your selected region.
  11. Enter the number of working storage instances and the number of failover instances.
  12. Select the Working Volume Type. The default file system is OrangeFS.
  13. Enter the total storage size in gigabytes. This storage amount will be divided among the storage instances.
  14. Select the check box if you want to enable EBS Encryption. For more information, see Amazon EBS Encryption.
  15. Select the number of volumes per instance.
  16. Select the Login Instance check box. Enter an Instance Name, select your Login Instance Type, and select your Login Volume Type. This is required for WebDAV, and it functions as the “head-node” of the environment, providing a way to submit jobs and access internal nodes from the Internet without having to access the scheduler and other internal instances via the Control Node terminal window.
  17. Select your NAT Instance Type, or accept the default.
  18. If you want to use EFS as your file system, select the Amazon EFS check box and enter an EFS name.
  19. If using Amazon EFS, you may enable Shared Home Directories and Shared Software Installation Mount. For Shared Software Installation Mount, you must assign a SSW name.
  20. If you want to add an Amazon S3 bucket for storage, select the Amazon S3 Buckets check box and enter a name for the S3 bucket to be created. You may also opt to enforce S3 object encryption.
  21. Click the Next arrow to proceed.
  22. You will be presented with a Final Review which summarizes the environment components you have chosen and the total running cost for this environment, apart from network egress.
  23. Enter a network CIDR representing an IP address range that is permitted to access your environment.
  24. After you have carefully reviewed your environment configuration, click the Create Environment button to start spinning up your cluster.