Budgeting

Blog 10: Budgeting

Ok, Now were at the end of the budgeting assignment we can see the final costs of the system and See if the costs are in fact going to escalate as the projected cost Assumed.

 

Over all.PNG

So here we can see that the overall costs are said to be at 0.00, but as well drop some of these down we can get an in-depth look into this.

This slideshow requires JavaScript.

After looking into the expenses in-depth, I have come to the conclusion that this is my only expense. The key management service is not that costly at coming in under 0.50 cents. This is for the month so far, so 9 days in and it has only cost me 0.50 cents which are excellent.

Buject; 2.PNG

Here we can see my budget is coming along nicely, This has not spent what the forecast assumed, and I am happy as I thought that it would cost a bit.

 

 

Cost Exploer; 1.PNG

As above we can see the actual cost of this month so far is $00.34 and far under what the forecast assumed would be the cost. It still has quite a high forecast, but as I have proved this will not be correct as I am not spending that much.

So this is my final blog post for The assignment, there has been ups and downs. It cost me far more than what I assumed it would cost due to my own fault. But this is what it’s about learning. Here I have had so many weird issues I haven’t quite understood, but I fixed my problems and worked out many things . over all an eye-opening experience.

Advertisements
Budgeting

Blog 9: Budgeting

Ok, now my account is up and running smoothly, I have combed through to see if I have any weird instances in places there shouldn’t be. And success !! nothing strange to report now. Those instances were weird and I’m at a loss as to why they were there, But now we can comb through and see what reportI’mim seeing from what accounts.

When we first go into the Account that was mixed up with mine, we can now see the costs involved with this account. This cost came to an overall cost of $3.26HelloHello86 ;1.PNG

As shown above, this cost were those that came from running the scripts in cloudformer. These costs were the following;; .24 for the Amazon Elastic Compute Cloud natGateway, $2.40 to the Amazon Elastic Compute Cloud for both Windows and Linux. and $.21 to the Elastic AP Addresses.

HelloHello86 ;2.PNG

As we can see from above I have had to pay the tax due to being in New Zealand and having Tax.

HelloHello86 ;3.PNG

As we can see from above, I have been charged the amount of $3.26. This little amount is of no concernqince to me. I have no issues with paying as i was my mistake not to notice.

Here in my second account we can see that as of in the last month I have had to pay 2.18 out of the credits. This is not a huge expense due to my noninstant use of AWS, when i have used it for cloudformer everything created has been deleted off instantly. Thus the small cost. AMber ; 1.PNG

Here we can see what I have had costs in so far, as we can see I have costs in Elastic Compute Cloud for the amount of  $0.18 and key management service for $1.

Alarms ; 2.PNG

Here we can see that there are those alarms that has gone off, but there has been No emails as I had set them up.

Cloud watch; 4.PNG

Ok, So now ill go check out these alarms to see what’s going on, Here as shown below. It thinks I’ve gone over $100 as shown above it’s on alarm 4 and below is my fourth alarm. So its tripped something, but as shown below in my credits I haven’t spent $100 My account has had nothing but weird issues, and I have not received any emails alerting me to the alarms. Alarm 4.PNG

Here we can see the day to day costs below But we can see as I haven’t been getting many as the only thing I have been using is was is stated above. This is good as there aren’t many unexpected costs cropping up.

Day to day cost so far.PNG

Here as shown below we can see the projected cost, it’s assuming were going to be to be amping up the costs again like in the last project as seen in the pattern. This is incorrect because this is the end of the semester and I don’t have any more projects with AWS.

Amber; 5.PNG

As shown below we can see that the report has been running and reflects what is above. I have only spent $0.90 for the last week, and this is right on track as its due to the Key management services.

Buget report.PNG

As you can see below, we still have $11. 54 credits remaining, this is coming to the end of the semester, so I’m assuming ill still have a little left.Credits left'; last snip.PNG

Assignment 1; Analysis & Budgeting Assignment

Case Studies

 

Niantic

This is an American software development company that is best known for developing augmented reality games such as Pokemon Go and Ingress. These games are developed at the for the front of Technology Making the most of the new booming business of Augmented reality.

When the Pokemon Go game was first released, they fist aimed to get 1X traffic, This means that they first assumed that it would get 1 data store transitions per second. I fair feat at that, this case assumption was that at they would roughly get 5X. But due to the sudden popularity, the game surged to 50X the original estimate. This was over ten times the worst case estimate, causing issues.

Due to the enormous amount of unforeseen traffic, issues arose at launch, these issues were with the stability of the game. With Niantic and google’s engineers, they addressed the issues one by one working tirelessly, to create and then release patches. Googles new initiative Google CRE (Google: Customer Reliability Engineering, or CRE) allowed Google to work alongside with the Niantics team. Google put forward their own expert engineers and product managers, to Tirelessly working side by side with Niantic.

Pokemon Go was deployed from containers, This is one of the biggest examples of ” container Based development” that is currently working. Google has its own Container services called Google Container Engine (GCE) that run on the Kubernetes O/s. Niantic chose container deployment because it’s easy deployment in clusters. This allowed The team at Nainatic to easily automatic there system due to clustered containers. These containers acted like a readily made mold of their system ready to be copied and reproduced in a scalable environment as needed. This then allowed the Niantic team to focus on their live development of the highly popular game to keep ratings up.

One of the major issues of using this system was that the implementation team at Niantic & Google. Wanted to update the container system, to a newer improved system. This implementation was to allow 10000 additional Nodes for the container Clusters. In preparation for the release of Pokemon go in more country .  the game’s change over to the newly updated containers was done carefully to not disrupt the original user base.

In the implementation plan, they also updated the network load balancer for the clustered containers, this needed updating due to their incorrect assumptions for the traffic load. They required a more complex load balancer that was more secure, they choose the Https load balancer because it’s more developed for worldwide applications. Aswell as the Https encryption, meaning that the game would be more secure. This also had faster connection rates for users meaning more connections, and furthermore, additional users for the Pokemon go game.

So in reflection Niantic Encountered Issues due to their original assumptions about the traffic flow to their newly released Pokemon Go game. They built their container system around their assumption of 1X traffic, But due to games high traffic rates the game had instance issues on launch that required immediate action. Both companys Google and Niantic came together to work through the issues and develop a better system. The clustered containers were updated to a newer version with more nodes for a more flexible system, as well as updated the load balancer with one that includes encryption and  is designed for worldwide.’

 

 

Yellow Pages

This is a NewZealand organization that has been operating since 1960’s, this was launched back when we all had landlines, and it was a physical book that housed everyone’s numbers. I remember the time where we all had at least two landlines, one that was wired for when we had no power and one that was “fancy” and wasn’t plugged in.

But back in 2015, the times had changed, and it had become the time for a new change. The change was to become cloud based, they had an internet based company, but due to the times, they deiced to put their ingratitude into the cloud.

The yellow pages then proceeded to Look around at the different vendors that supplied cloud-based products but then proceeded to chose Amazon Web services due to the services they offered. Those services are of which that follows; IT structure automation, Self-service features as well as pay as you go pricing models. The yellow pages like these due to the minimal technical, financial and commercial risks.

“It was clear AWS was the right fit for Yellow New Zealand because of its industry experience, flexibility of service, enhanced security, and platform maturity,”- Rob Hayden, cloud infrastructure manager at Yellow New Zealand.

The yellow pages had then fast-tracked the implementation of the AWS infrastructure with the initial help of an AWS cloud solution specialist alongside with local technology partners. This overall took 9 months to implement. This was then followed up by migration of a wide range of applications, and after that cloud services team that still continues to offer help after implementation.

The yellow pages had seen many benefits of the cloud implementation, Some of them include the following; Cloudformation for application deployment with the help of Lambda for code based deployments and the use of EC2 container services to release new automated code into their system. Their traditional views have allowed AWS to integrate new IaaS approach for their infrastructure.

The business now can use the IAM roles to create new easy-to-understand platforms ready to use by their original Operations Staff. Without needing any addition extensive educating, as an addition, the users can easily look up Information that is stored by the Amazon Elasticashe instances.

So in reflection, The yellow pages have managed to create itself all over again, by moving from a physical book into a completely online cloud automated world. This was done by Vetting several different cloud vendors, and finally settling on AWS due to their longevity and low failure rates making them secure, flexible and reliable. That gives the yellow pages a Faster automated system that now can implement new digital products in minutes as opposed to the weeks with the previous method. For this reason, The yellow pages have managed to reduce costs and furthermore improved performance,  allowing The yellow pages to migrate six production Applications over the AWS.

“In migrating Yellow and White Online—our core applications—to AWS, we gained a world-class application-delivery capability built on the latest technologies and best practices,” says Hayden.

 

 

 

 

Assignment 1; Analysis & Budgeting Assignment

IaaS Comparason

 IaaS

What is IaaS? IaaS is more commonly referred to as Infrastructure as a service. IaaS means that you can buy specific Virtual versions of the hardware you need for the running of your system. IaaS is provided to you by a vendor that rents out this item. Then it’s up to you to put the Operating system on and then other applications.   So when we think of this for New Zealand, we need to work out what company’s we will be used within Newzealand. I’m working under the assumption that the Organization is a middle sized business containing about 15 different users.

AWS Amazon web services.

Who is AWS?

AWS is short for Amazon web services. They are an American owned company; they currently host a Secure Cloud Platform that offers cloud-based compute power to anyone, anywhere. AWS is a business that offers scalable services, offering scalable computer resources that grow when they grow.

AWS offer a wide range of could based products for anything you may need whether it is a complicated build or a simple build. They also offer a good learning environment for students so that they can go out into companies having a base understanding of the environment within AWS.

 

What services do they offer to NZ

They offer a wide range of services that organizations big or small could use even in our small country. We’ll explain the services as they provide below this, this will include computing power, data storage, and load balancers.

EC2 instances

Since I have already been playing around in this, I have already seen the different compute power ranges. But let’s just say our organization wants a medium size system for their business. We can see what they could need from the list from below. There is a wide range to select from, But for this instance where going for say medium.

While we are working with Newzealand prices, one would assume that these differ from country to country, and they might even offer some deal.

AWS cost model.PNG

So here we can see what they offer in different instances, but what does this mean?

AWS cost model Explained.PNG

So here we can see the cost per hour, But let’s apply that to the Organization, were going to say it’s a medium sized business so here let’s go with the assumption they will use the t2.medium.

So $0.047 per hour, Let’s say they are running all the time, so let’s do some Calculation.

So with my estimates, there are 168 hours a week times four would be a month which is; 672 hours so

With 672 hrs p/m lets work out the cost. At the cost of 0.047 pHs. =this would be  $31.58 p/m USD so in NZD that would be $44.86 a month for the organization.

Data storage;

Here on Amazon, this is called s3 Buckets; These are objects that you can upload things into and store on a cloud infrastructure. These buckets Are regional and can up put into different regions for backup reasons. With this buckets, we can control who does what in these by applying different permissions to different users.

So prices for these, as you can see from below these are charged by their usage, the more you use, the less the standard hourly fee is. There are three different ways they charge for this as of which that follows. ,

  • Infrastructure  access- this is fro the user that won’t need it that much,
  • Standard-  this is the standard user, one that accesses it regularly,
  • And Glacier- This is for the bigger companies that use this service a lot; this comes with a cheaper service as they will be using it more.

So here we can see below the cost model for this service;

Ohion Classic storage..PNG

So for this medium sized organization, I would assume we would have the starter package and would be about as a guestimate 5tb p/m. So let’s work this out!

0.0125 per gig p/m so that’s $12.5 per lb a month so $12.5 times 5tb = $62.5USD so that would be $88.73 p/m

Load balancer

Load balancers are very useful things; these are for when there are faults in the system. There are times where the instance might go down, but then the load balancer this would continue working correctly because there are two or more instances sitting there ready for when one goes down. How do they work? They work by being made between the instances you have, these two or more instances are connected, and if there is one that goes down the load balancer switches over to the other one to continue the work. This can even be set up outside of the region you are in.

 

So let’s get onto the bit about the prices, this is simply charged by two different things. These are the price per hour and price per data processed as shown below. The region is the US simply for the reason of simplicity.

AWS Load Balncer.PNG

So for this we need to work out how many hours we will be using this for , So .025 p/h times 24 hours in a day which would be .60 a day, times 7 for a week which would be 4.20 for the week and then for the month would be $16.80 USD  for the month and then it would be 23.62 NZD p/m for the Elastic load balancer.

And the Gigs would be at this point be the same and the data storage so 5 TB so this would be $40 USD and then in NZD $56.24.

So overall this would be $73.04 overall

Security

While we think of AWS being highly secure, we need to work out what exactly makes them so secure. So let’s list a few down.

  • Let’s start with the basics, AWS is a highly trusted site, with pretty close to none existent failed
  • They are a multi-region; they have 16 regions they are in and 42 availability So if your system goes down in one region, it will still be up and running in the other region
  • There is a key pair system that doesn’t allow you to access the instances; you can’t get Simple.
  • Users rights, as you make the users for your system, you give them different permissions. So they can get into your system and destroy anything.
  • They have an automated system that Reports your vulnerabilities back to you as well as reporting suspicious activities

Azure

What do they offer?

This is my second choice, this is because they are a massive global company. As well as having a really good reputation that comes manufacturing applications like the Windows and the Office 365. This company has also got a simple system that users rave about, as well as offering encryption options for added security.

Who they are

This is the company that Brought you the Windows Operation system, and not only that the people that brought you the Windows work pack including Word, Excel and other everyday products. They also brought up Nokia, and now they have Spread out to producing mobile phones. So this company has a massive presence even before you think of it as an IaaS vendor. They offer a system like was but with the side bars with simplified options.

 

What services do they offer to NZ

They offer their whole range of services to the Newzealand clients. They offer a wide range or data storage, instances, load balancers, security plus a whole lot more to these clients. This is done in a way to provide small- large companies an easily scalable system that will grow with them as they build out.

 

Av2 Standard Instances;

Azure offers a wide range of the instance, these are not set up like the AWS system. These are put into groups,

  • The first group is A0-4 basic these are for testing and development, idea for small to medium business,
  • Then there is Standard as shown This is the Av2 series that are the latest development that is for bigger workloads such as Build servers and web applications. Etc, these are more for the Average sized business.
  • D2-5 Promo These are only here for a short time, these are for the largely sized business. This can handle any and all applications they also offer Storage disks as an addition to the premium members.

But for this organization is going to do the standard instances

Azure Instances.PNG

 

So from this, we can see how much they will charge Per Month, this is in Usd so now we can work that out. So for this instance, let’s go for A2 v2 which would equate to medium.

So for that, it’s 0.159/hr So let’s do maths !!

So with my estimates, there are 168 hours a week so that a month will be 672 hours

So let’s Times 0.159 with 672, so that is $106.85 USD and in NZD that is 151.69

 

Data Storage

So for Azure’s data storage is called “blobs,” this seems to be much like AWS’s bucket theme, This seems to be a container in which you can put your stuff in. Whether it is for  Streaming, storage of pictures & videos or system backup;s. But the there difference here is that Azure seems to charge you for access rights to this.

The storage prices are of which that follows;

Azure storage prices.PNG

So for this, we need to add in the access prices, so let’s go for the standard of say $.00072 for access rights. And work out what is needed for the month so let’s go for the LRS 49 TB version for $0.026 per gig, so let’s do some maths

$0.026 per gig p/m so that’s $26 per lb a month so $26 times 5tb = $130 in USD so in NZD  that would be $184.55p/m

Load balancer

In Azure, this seems to be free, and they even let you have multiple load balancers for no additional price, I would assume this cost is absorbed into something else.

Security

While we work in Azure, we need to know how secure it is and what safety measures they take these are listed below.

  • They offer data encryption on the Azure blob storage, allowing you to have client side encryption for you to add a safety feature to keep others out.
  • Much like the previous AWS they are multi-region, so if one goes out another one will kick up, and you won’t have any downtime
  • You can give your users access controls, as you as an administrator has set these, there should be any mistakes.
  • Azure suggest security partners that can help you have your system running securely.

 

SoftLayer

http://www.softlayer.com/

Who are they

For my third chose, I have chosen Softlayer an IaaS; This provider is a subsidiary brand to IBM Cloud. IBM has three different categories for its cloud providers. Theyre are put into categories as IaaS, PaaS, and SaaS. Softlayer is a part of there Bluemix strategies and is an IaaS. IBM has over 60 data stores around the world and 35 of them being dedicated data centers around the world.

What services do they offer to NZ

Because they are all around the world, they offer IaaS to New Zealand customers as a cloud service. This is more aimed at larger organisations  but can do medium sized to.

Cloud Servers

Now SoftLayer has a different approach to instances than what AWS and Aure has. They have one that you select what you need, and then SoftLayer will make one from your specifications.

IBM cloud Storage.PNG

And then once you have chosen this you can go on to chose how many servers you want and what region you want it in. This also has other settings as shown below.

IBM server requirements.PNG

They have a lot of additional add-ons like extra disks and Backup options each with their price. Asqell as Databases, firewalls, and Antivirus are all options that can be selected in this, So with all the options selected It comes to $255.80 a month as shown Below.

IBm instance.PNG

So that’s $255.80 a month USD which would be $360.84 NZD

Data Storage

Softlayers storage is an option offered as a “block” much like the standard storage solutions as discussed before this. But pricing is completely dependable on how much you need; they measure this by a performance Calculator. They offer package deals from 10 cents a gig. But because we don’t need the other function of the package deal were just going to go with their performance calculator.

Below we can see that 4tb is $400 p/m and I went on to see how much 8tb was and that was $800 p/m so it would be safe to assume that 5tb is $500 a month.

IBm Data Stoages.PNG

So that is $500 a month in USD, so let’s work out what that is in NZD, so that is 706.02 in NZD

 

 Load balancer

Here in SoftLayer, load balancers are much like the rest; this is three different prices that start at 49.99 for the local load balancer to 1,999 for the high availability load balancer. For this exercise, we are going to go with the standard Load balancer. This distributes traffic between the cloud servers for redundancy, as discussed previously before.

IBM load balncer.PNG

So this is 49.99 USD, and in NZD that’s $70.28

Security

So when we think of security, we need to know what SoftLayer offers, this is because if we use this web service, we need to know that it’s secure

  • They offer physical security in their data centers
  • They offer key management services for security of the instances
  • Offers customizable firewalls within built redundancy
  • They offer data stores in different regions for redundancy
  • Offers SSL which is Secure Socket Layer cert. For encryption between sites/application and end user

Overview

So here we go through and look at the different aspect of the services provided, as well as the main cost of actually running the system.

AWS

When we think of AWS, the whole system is complicated and hard to navigate with so many options available. I believe that although they are overly complicated, I like the fact that they offer a free tire and a credit system for those who are trying them out.

So let’s Add up the cost and work out how much this whole system would be.

  • Intance cost; $44.86
  • Data storage cost; $88.73
  • Load balncer cost; $73.04

Overall cost;  206.63

AZURE

This was a simpler interface which I liked a lot more; I couldn’t get access to my account, so that was a slight issue. I liked the fact that there Load balancer cost was integrated into their overall cost. This was nice as their services were a little simpler than AWS, but overall they cost more than AWS there instance cost more than three times what AWS was. So with that in mind, even Azure wasn’t as cheap as AWS.

  • Instance cost; $151.69
  • Data storage cost; $88.73
  • Load balncer cost; $00.00

Overall cost; $240.42

Softlayer

This was interesting, I liked the feature that allowed you to build an instance, and chose what you need. This would be very good for those out there from a bigger organization. But I believe this was too costly due to the build prices, Making them far to exhibit for our med sized organization

  • Instance cost; $360.84
  • Data storage cost;  $706.02
  • Load balancer cost; $70.28

Overall cost; $1,137.14

Overall OverView

So here with the overall overview, I believe SoftLayer’s build to be out of the price range of the organizations. Due to this is is not my top pick. Then there was the Azure cloud. This again had its downfalls of the instance Bei g over three times the price of AWS. Thus this is my second option. AZURE is much simpler than AWS, but they are also more expensive and don’t offer the training structure AWS does. So over all my recommendation would be to go with AWS as they’re price comes in at $206.63, this alone is the needed insentient that makes the chose.

 

 

Budgeting

Blog;8 Budgeting Account Switch

So I emailed AWS about the account mix up, Turns out it was my own fault, But in coming back into my account I noticed some really weird stuff. I have instances and VPC’s Everywhere. I don’t know how this happened. So many things were amiss, so I’ll start again.

This slideshow requires JavaScript.

As you can see above I have VPcs in Frankfurt and Irland, this wasnt something i had done. I have not touched these Areas and this doesn’t make any sense. So here we’ll go through and make things again, maybe it’s too late to do so. But it will still be there.

Let’s Create a New Report.

Capture.PNG

So this has the same name as my Original one. I think it been deleted off, maybe I have done it in one of my purges, thought I doubt it. My account is really weird.

Budgeting

Blog 7: Budgeting

This week has been interesting I have had a computer breakdown and need the battery, motherboard, and keyboard fixed! Phew, it has been a confusing time.

In this confusion, I managed to switch over accounts to another one,. And because I had so much going on I didn’t think to check if it was the correct account. I just assumed it was, so I managed to rack up a little bit of cost. It wasn’t anything I can’t afford, but it was a costly mistake although not a big one. And a big learning curb, now I know to make sure it’s the correct account.So these screenshots are the Costs for the other account, these are in total a mistake. But still a loss none the less, so these will be on my blog.

Cost forcast.PNG

As shown above you can see how much this has cost me so far. I have gone through and stripped everything out of it. And it has not cost me anything further. It also has the forecast for the month in there.

Cost Other.PNG

This shows that the costs are in the EC2 instances, these were in Sydney. The rest of the cost was no tax that gets added on to the total.

Cost explodedr Other.PNG

As you can see above in the report, there is no cost in there yet.

Now I have currently gone back to my regular account and posted these mistakes. We can see what the costs are to this.
Write Cost forcast.PNG

As you can see here, I’m still going through my credits and therefore there is no cost to me.

In my credits, we can see that I have spent $2.05 in the last week. This is in the Elastic Compute Cloud and the Key management service.

Costs so far..PNG

 

Cost Exploer Day to day.PNG

As you can see here, the cost that has accumulated in the Cost Explorer has come from having no instance type. There should not be much more cost as there doesn’t need to be anything running. As we are deleting as soon as things are made.

Cost Forcast 2.PNG

 

In this forecast, if we were to keep on using the system as we were, we can see the cost will be exponential, between 0.00 – 61.33.

So the Dino Store has been a big blowout for me, but this is what learning is about. We learn from our mistakes. And make better decisions from the previous ones. So as you can see from below we still have $13 in credits remaining. Therefore this account costs me $0.

Cridiets.PNG

 

Up until now, I had previously thought that the Budgeting is what we set ourselves and we were to work out the cost so far. I hadn’t noticed that there was a budgeting tab in the billing management. I have now made a budget for myself. This is set on the items that I have noticed that cost me the most. We can see what it has cost from the Budget report below.

Budjet.PNG

 

Assessment 3: Deploy and Automate AD DS

Deploy & Automate ADDS Build Blog; 3

Now we have the original script premade from the previous assignment we need to modify and refine it. These scripts are saved in an Amazon S3 Bucket as shown below.

 

This slideshow requires JavaScript.

Once we have it in the bucket we can download this and open it in notepad++, I suggest opening it in there. I had opened it in original notepad, and this changed my code ever so slightly. Now we have it in our NotePad ++, we can try to change things.

First of all, I noticed that not all the references to the VPC were correct, As shown below

VPC worng.PNG

Soi needed to comb through the Temple for the different VPCs and change it to the correct one as stated in the top of the template. This was done via the control + F function, this was what I found the be the easiest.

Next issue I had was the Subnets, This was an issue because until I drew it out. I didn’t understand what I was doing wrong. The subnets needed to be either the same or just with a small different and in the same IP range as shown in the diagram below.

18679198_1476480002390552_915891650_n.jpg

The next issue/ step I had was to Figure out what was gooing on with the routes. These weren’t working. The first issue I notices is that I didn’t have ” “DependsOn”: “gw1″” in in the first route, so this was changed. Then I Noticed that the Gateway Id was referencing different gateways, one of which didn’t exist.  As shown below.

Route wrong..PNG

Once this was fixed, we then needed to change the destination cider block. This was something I don’t really understand, But this needed to be changed to the same subnet but different Ip addresses. The Ip addresses I chose for each route is shown above in the drawing I did to get a better definition.

So once this was fixed the next hiccup I had was an  IAM Reference, this s referencing something that was part of the previous script we made ours from. This is shown Below

IAm refernceing.PNG

Once this has been having been Taken out. It should successfully run. So this was run a couple of times without a hiccup. But one should note, as I made this mistake that you need to be in the right region, so the key reference is correct. The results as shown below.

 

Complte and done.PNG