Target Audience: Oracle SuperCluster Customers

On a high-level, osc-setcoremem is a SuperCluster tool that assists in making changes to the CPU and memory configurations of one or more dedicated domains running on a SuperCluster compute node. osc-setcoremem helps in removing (park) resources from dedicated domains for licensing purposes. Also using osc-setcoremem, some of the CPU and memory resources can be removed from one dedicated domain and added to remaining dedicated domains. Root domains are ignored by default.

Any user with no prior knowledge of Oracle VM Server for SPARC (also known as Logical Domains) administration, and how the operating system organizes CPU and memory resources into different locality groups (lgroups) can easily reconfigure the dedicated domains to achieve desired (or in some cases close to the desired) CPU, memory configurations. Only those users with root privileges can run the tool.

osc-setcoremem is currently supported on all SuperCluster platforms -- T4-4, T5-8, M6-32 and M7. User can change the CPU, memory configurations at Socket or Core granularity. For the complete list of supported functionality along with known limitations, please review the Configuring CPU and Memory Resources section in Oracle SuperCluster M7 Series Administration Guide.

Here is a sample interactive osc-setcoremem session that changes the CPU, memory configuration of couple of dedicated domains on a SuperCluster M6-32 compute node.

# /opt/oracle.supercluster/bin/osc-setcoremem

                              osc-setcoremem
                    v2.3  built on Jan 30 2017 11:48:13

 Current Configuration: SuperCluster Fully-Populated M6-32 Base

 +----------------------------------+-------+--------+-----------+--- MINIMUM ----+
 | DOMAIN                           | CORES | MEM GB |   TYPE    | CORES | MEM GB |
 +----------------------------------+-------+--------+-----------+-------+--------+
 | primary                          |    24 |   2048 | Dedicated |     2 |     32 |
 | ssccn1-dom1                      |    24 |   2048 | Dedicated |     2 |     32 |
 | ssccn1-dom2                      |    24 |   2048 | Dedicated |     2 |     32 |
 | ssccn1-dom3                      |     2 |     32 |   Root    |     2 |     32 |
 +----------------------------------+-------+--------+-----------+-------+--------+
 | Parked Resources (Approx)        |    22 |   2016 |    --     |    -- |   --   |
 | Memory in Use by _sys_ Pool      |    -- |   1.25 |    --     |    -- |   --   |
 +----------------------------------+-------+--------+-----------+-------+--------+

 [ INFO ] following domains will be ignored in this session.

 Root Domains
 ------------
 ssccn1-dom3

 CPU Granularity Preference:

        1. Socket
        2. Core

 In case of Socket granularity, proportional memory capacity is
  automatically selected for you.

 Choose Socket or Core [S or C] C

 Step 1 of 2: Core Count

 primary      : specify number of cores [min: 2, max: 68. default: 24] : 30
                you chose [30] cores for primary domain

 ssccn1-dom1  : specify number of cores [min: 2, max: 40. default: 24] :
                you chose [24] cores for ssccn1-dom1 domain

 ssccn1-dom2  : specify number of cores [min: 2, max: 18. default: 18] : 12
                you chose [12] cores for ssccn1-dom2 domain


 Configuration In Progress After Core Count Selection:

 +----------------------------------+-------+--------+-----------+--- MINIMUM ----+
 | DOMAIN                           | CORES | MEM GB |   TYPE    | CORES | MEM GB |
 +----------------------------------+-------+--------+-----------+-------+--------+
 | primary                          |    30 |   2048 | Dedicated |     2 |    128 |
 | ssccn1-dom1                      |    24 |   2048 | Dedicated |     2 |     96 |
 | ssccn1-dom2                      |    12 |   2048 | Dedicated |     2 |     64 |
 | *ssccn1-dom3                     |     2 |     32 |   Root    |     2 |     32 |
 +----------------------------------+-------+--------+-----------+-------+--------+
 | Parked Resources (Approx)        |    28 |   2016 |    --     |    -- |   --   |
 | Memory in Use by _sys_ Pool      |    -- |   1.25 |    --     |    -- |   --   |
 +----------------------------------+-------+--------+-----------+-------+--------+


 Step 2 of 2: Memory Capacity
        (must be 16 GB aligned)

 primary      : specify memory capacity in GB [min: 128, max: 4032. default: 2048] : 2816
                you chose [2816 GB] memory for primary domain

 ssccn1-dom1  : specify memory capacity in GB [min: 96, max: 2048. default: 2048] :
                you chose [2048 GB] memory for ssccn1-dom1 domain

 ssccn1-dom2  : specify memory capacity in GB [min: 64, max: 1280. default: 1280] : 512
                you chose [512 GB] memory for ssccn1-dom2 domain


 Configuration In Progress After Memory Capacity Selection:

 +----------------------------------+-------+--------+-----------+--- MINIMUM ----+
 | DOMAIN                           | CORES | MEM GB |   TYPE    | CORES | MEM GB |
 +----------------------------------+-------+--------+-----------+-------+--------+
 | primary                          |    30 |   2816 | Dedicated |     2 |    128 |
 | ssccn1-dom1                      |    24 |   2048 | Dedicated |     2 |     96 |
 | ssccn1-dom2                      |    12 |    512 | Dedicated |     2 |     64 |
 | *ssccn1-dom3                     |     2 |     32 |   Root    |     2 |     32 |
 +----------------------------------+-------+--------+-----------+-------+--------+
 | Parked Resources (Approx)        |    28 |   2784 |    --     |    -- |   --   |
 | Memory in Use by _sys_ Pool      |    -- |   1.25 |    --     |    -- |   --   |
 +----------------------------------+-------+--------+-----------+-------+--------+


 [ INFO ] Equivalent non-interactive input string for the record:
         /opt/oracle.supercluster/bin/osc-setcoremem -type core -res 30/2816:24/2048:12/512

 Following domains will be restarted:

        ssccn1-dom2

 This configuration change requires rebooting the Control Domain.
 Do you want to proceed? Y/N : y

 IMPORTANT NOTE:

 |  After the reboot, osc-setcoremem attempts to complete CPU, Memory reconfiguration.
 |  Please check syslog and the state of all domains before using the system.
 |  eg.,  dmesg | grep osc-setcoremem ; ldm list | grep -v active ; date

 Please wait while osc-setcoremem is setting up the new CPU, memory configuration.
 It may take a while. Be patient and do not interrupt.


 Executing ldm commands ..

0%    10    20    30    40    50    60    70    80    90   100%
|-----|-----|-----|-----|-----|-----|-----|-----|-----|-----|
*=====*=====*=====*=====*=====*=====*=====*=====*=====*=====*

Broadcast Message from root (pts/1) on sschost02 Fri Mar 31 16:03:13...
THE SYSTEM sschost02 IS BEING SHUT DOWN NOW ! ! !
Log off now or risk your files being damaged

        Task complete with no errors.

SEE ALSO:

• Oracle VM Server for SPARC 3.4 Administration Guide
• Oracle Solaris Tools for Locality Observability

Labels: oracle virtualization osc-setcoremem logical+domains sparc locality+group supercluster solaris

Posted by: Giri Mandalika.    # 11:42 PM Tweet