Skip to content

img0

EC Storage Policy

Enable EC3+2

Cloudian Support a number of different Erasure Coding Policies for storage protection. These are based on best practice and offer known good By default, EC3+2 Storage Policy is disabled. In circumstances where this policy is desired (small clusters / performance requirements), it can be enabled by agreement with your SE or support through hsctl commands. Once enabled we can investigate a Hybrid Policy

Warning

You should never create or use a Storage Policy that is unsupported by Cloudian. Doing so may invalidate support and can cause significant performance issues. When in doubt, discuss options with your SE or your Professional Services representative.

In our case, we have 5 nodes which will allow us to use EC3+2 policy.

Instructions

  1. SSH into your Config Controller Node (node1) as sa_admin and start a new session or sessionless shell

  2. Issue the following command to modify the default Erasure Coding setting to include EC 3+2 

    hsctl config set hyperstore.storagePolicy.EC.singleDC=3:2,4:2,6:2,8:2,9:3,12:4

  3. Next we need to apply the new setting. 

    hsctl config apply hyperstore

  4. Finally we restart the s3 service to commit the new setting. 

    hsctl service restart s3 --nodes=ALL

Note

We do not need to restart the CMC service as the setting will dynamically be applied in the relavent field

Warning

Remember to exit the ssh session on completion

Create EC Storage Policy

Instructions

  1. Login as Admin User
  2. Select Cluster Tab
  3. Select Storage Policies Sub-Tab
  4. Click + Create Storage Policy
  5. Type “ec32hybrid” as Policy Name
  6. Type “Erasure Coding 3+2 Hybrid” under description
  7. Leave Number of Datacenters as 1
  8. Ensure EC Within Single Datacenter is selected
  9. Check or Change Erasure Coding K + M Value to 3+2

Instructions

  1. Select a Hybrid Policy Threshold of 32KiB
  2. Leave all other settings to default and click Save

Instructions

  1. Confirm the new Storage Policy is correctly defined
    Note the number of replicas in the policy - can you explain why each policy has the shown number of replicas?

Create EC bucket

Instructions

  1. Login as User Account or use View User Data as admin user.
  2. Click +Add New Bucket
  3. Type “myhybridbucket” in Bucket Name
  4. Select ec32hybrid Storage Policy
  5. Click Create

Upload Data to bucket

Note

We are now going to upload 2 files, one below and one above the hybrid threshold

Instructions

  1. Click Objects Tab
  2. Select “myhybridbucket”
  3. Click Upload File
  4. Upload the 5k and 50k File
  5. Click Start Upload
  6. Ensure Upload completes successfully

Locate EC Object

Instructions

  1. Login as Admin User
  2. Select Analytics Tab
  3. Select Object Locator Sub-Tab
  4. Type “myhybridbucket” in Bucket Name
  5. Type 50k in Object Name
  6. Click Find
  7. Validate Type as “EC”
  8. Validate that there are 5 Separate Fragments (3 + 2)

Instructions

  1. Login as Admin User
  2. Select Analytics Tab
  3. Select Object Locator Sub-Tab
  4. Type “myhybridbucket” in Bucket Name
  5. Type 5k in Object Name
  6. Click Find
  7. Validate Type as “Replica”
  8. Validate that there are 3 Replicas (2m-1)