Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

When using Spot instances, you get Access to unused Cloud resources at major discounts. However, this generally comes at the cost of limited availability and stability. Incredibuild tries to enable you to use these resources seamlessly without any major drawbacks.

How does it work?

Once you toggle the spot option in Incredibuild, workloads will be broken up to tasks to be processed in parallel. Each task will be executed as follows: 

  1. Request - Incredibuild requests one or more spot instances at the market price. You can specify which machine types and availability zones to use.

  2. Spot Interruption Recovery – Because Spot machines can be taken back by the provider at any time, Incredibuild ensures that the tasks that machine was working on are seamlessly transferred to a new Spot machine.

  3.  Completion – Once the job has completed, the Spot instances are automatically terminated or stopped.

Step 1 - Add Role Permission

This step is only required for AWS customers, low-permission customers. This step assumes that you have already created a role.

Add the following role permission definition to the role you created in the AWS IAM service.

{

    "Version": "2012-10-17",

    "Statement": [

        {

            "Action": [

                "ec2:*",

                "servicequotas:GetServiceQuota",

                "servicequotas:ListServices",

                "servicequotas:ListServiceQuotas"

            ],

            "Effect": "Allow",

            "Resource": "*"

        },

        {

            "Effect": "Allow",

            "Action": "iam:CreateServiceLinkedRole",

            "Resource": [

               "arn:aws:iam::*:role/aws-service-role/spot.amazonaws.com/*",

                "arn:aws:iam::*:role/aws-service-role/spotfleet.amazonaws.com/*"

            ]

        },

        {

            "Effect": "Allow",

            "Action": [

                "iam:AttachRolePolicy",

                "iam:PutRolePolicy"

            ],

            "Resource": [

                "arn:aws:iam::*:role/aws-service-role/spot.amazonaws.com/*",

                "arn:aws:iam::*:role/aws-service-role/spotfleet.amazonaws.com/*"

            ]

        }

    ]

}

 It can also be added using the console as demonstrated below:

  1. Go to your AWS Portal > IAM service

  2. Select the Roles category

  3. Select the role they created for Incredibuild Cloud Solution

  4. Go to the tab ‘permissions’ – select your policy, view json and click “edit policy” 

  5. Paste the attached file content – and save

...

Step 2: Enable Spot

In the Coordinator Settings, under the VM’s section, enable the Spot toggle. Select the machine types and availability zones. Note that if you are using a private cloud, you must define subnets for every availability zone or the connections will be blocked.

...

Track Your Machine Cost when using Spot:

To track and view the discounts and your Cloud machine cost , you should enable our “Tags” option, see:

https://incredibuild.atlassian.net/wiki/pages/createpage.action?spaceKey=~269698585&title=Understanding%20the%20Settings%20of%20IncrediBuild%20Cloud%20Solution&linkCreation=true&fromPageId=2478211113

AWS Customer:
  • To find Your Machine cost by using the Tags, you must enable the "cost allocation tags" on your AWS account

  • Then navigate to the “Cost Explorer”, see:

https://docs.aws.amazon.com/awsaccountbilling/latest/aboutv2/cost-alloc-tags.html

You can find more information about viewing the actual machine cost here and here.
Azure Customers:
You can find the information about viewing the actual machine cost here.

 

 

...