Cloud Computing on the Windows Azure Platform

by Joe Havelick 10. February 2010 10:08

The Windows Azure Platform is Microsoft's cloud computing platform.  The goal of this article is to give a basic familiarity with this platform, what it can be used for, and some of the benifits and risks. In order to explain Windows Azure, one must understand the concept of cloud computing.  Cloud computing is the concept of hosting technology applications and data on the internet, AKA "the cloud".  It is characterized by:

  • Shared resources - Multiple applications and data reside on the same hardware (and often redundantly across multiple pieces of hardware).  They are logically isolated from other customers' data.
  • Scalability - The ability to acquire as many resources of a virtually unlimited size as one might require.  This may be measured in terms of CPU cores, RAM, storage space, or databases.
  • Rapid provisioning - Resources can be added dynamically, often through an API, as additional capacity is needed.  The same is true in reverse, that capacity can be taken offline as demand decreases.
  • Utility Service - Consumers pay for the resources they consume.  Different vendors have different metrics, but you are paying for small units of computing power, rather than the cost of capital to build out a server farm that will never reach 100% efficiency due to peaks and valleys in demand.

Typically, this is achieved through the use of virtualization on commodity hardware.  As a caveat to the concept of internet based computing in the public cloud, there is also the concept of private clouds, which are virtualization farms hosted in a private data center.  These clouds can often interoperate with the public cloud to supplement their own capacity as needed.
There are three primary categories of cloud computing services available:

  • Software as a Service (SAAS) – Software built on a cloud computing platform.  This includes some free services, such as Gmail, and paid services such as Mozy or Adobe Photoshop Express.  Customers are often billed on a subscription or by use basis, rather than a onetime software license cost.
  • Platform as a Service (PAAS) - Software development platforms hosted in the cloud.  This includes Windows Azure, Google App Engine, SalesForce.com, and Engine Yard.  Developers may build applications using and SDK which they can deploy, manage and access natively in a cloud platform.
  • Infrastructure as a Service (IAAS) – A cloud based infrastructure.  In the case that computing power is required, but the PAAS model does not provide the required flexibility.  IAAS is offered by a few vendors, including Amazon AWS and Rackspace.

As we have said, the Windows Azure Platform is a PAAS.  The Windows Azure Platform consists of:

  • Windows Azure – The application runtime environment Windows Azure Storage Services
  • SQL Azure – A cloud based service for hosting MS SQL databases.
  • AppFabric – The management tools for Azure based applications, Service Bus, and Access Control Service
  • VS 2010 SDK – The toolkit for building Azure applications.

(Note: the MS Marketing team seems to be having a field day with the nomenclature.  There used to be entities like ‘.NET Services’, which has now become AppFabric.)
Using the SDK, Windows Azure allows the deployment of 4 types of solutions; ASP.NET Web Role, WCF Service Web Role, Worker Role, and CGI Web Role.  Not all .NET functionality is available, but the feature set is extensive and pretty well documented on MSDN.  When deploying applications, the management interface forces the deployment to a “staging” environment, where you can test your application before swapping to production.  The changeover is almost instantaneous in that it changes the DNS records to point to the new app, and limits based on propagation and caching may apply.
Windows Azure Storage Services is the storage solution.  There are three types of entities that can be stores and retrieved.  The Blob Service handles entities such as binary and text files, much what you would traditionally store on disk.  The Queue Service allows for the use of messaging between services, to enable a persistent connection, even if services become backlogged or shut down.  The Table Service stored named pairs and is not related to SQL tables as one might think.
SQL Azure allows you to host SQL databases on the cloud using most features available in a Standard SQL 2008 license.  You may connect using SQL authentication only, but you will be able to use SQL management studio, ODBC, ADO.NET, etc.  It has a SQL firewall that denies all connection by default, and can be configured to allow as small of a surface area as required. This makes SQL Azure something that might be useful not only for cloud applications, but as a standalone service for hosting SQL databases in the cloud.
The service bus is a toolkit/service for allowing more seamless connectivity between applications and data stores between the cloud and your LAN.  There are all sorts of demons between you and the cloud (firewalls, proxy servers, routers).  The service bus is a way of simplifying those connections (without VPN) and seems especially useful if you’re utilizing storage or SQL in the cloud, when connecting from an application hosted locally.
The Access Control Service (ACS) is a way to provide cross domain authentication of users without a federated identity service.  Mind you, it is not limited to Windows domains.  A pretty quick and dirty video explaining the Service Bus and ACS can be found here.
Analysis

The following are some common uses for Windows Azure:

  • The obvious; Platform for SAAS solutions
  • Running batch processes which require a large amount of resources for a limited duration
  • Hosting commodity processes, which may require a frequently changing number of users or resources based on a changing demand.  For example, a university bookstore “used book website” will see massive spikes in its use just before and during the first week of each semester, and minimal use otherwise.  Alternately, build your own Amazon Mechanical Turk.

There are several advantages to cloud computing with Windows Azure:

  • High Availability (HA) – Without any effort on your behalf, if you provision a SQL database in SQL Azure, it automatically takes advantage of the HA features in SQL.  It is promised that your database is replicated to at least 2 datacenters within a specified region, and will failover automatically if something faults on the primary.  In the meantime, it will begin replicating to another server to become the new failover.
  • Scalability – If you’re building out your own datacenter, you must build for peak demand plus a safety factor.  This can be costly and creating a accurate estimate can be like trying to catch a cat in the dark.  PAAS allows for commissioning and decommissioning of resources in near real time as needed.
  • Pay per use – You only pay for what you use, and since the use is often coupled directly with the number of users or subscribers, you can then much more easily put a “per-head” cost on the application.  This makes calculating and achieving your ROI that much easier.
  • Lower Total Cost of Operations – Beyond the cost of acquiring hardware and software licenses, there are the costs of commissioning, operating, patching, maintaining, upgrading, backing up, replacing, recycling, and securing them.  There are the costs for maintaining the supporting services (network, power, cooling).  There are the indirect costs of benefits for those people that perform this work.  The total cost associated with running a datacenter can be incredible for a small organization.  Using Azure can mitigate those costs.

And there are several risks:

  • Security/Privacy – Some organizations will simply never put their data in another vendor’s data center.  Vendors can be certified under industry standard certifications, but my feeling is that you can never completely preclude a data compromise.  Out of sight is not out of mind in this case.  You’re putting a lot of trust in your vendor and every one of its employees to do no harm.
  • Latency/Throughput – Although there are a number of options available to build fast connections to your datacenter, they come with and additional cost and can never reach the same performance as having your application server right next to your database server on the same LAN as your users.
  • Connectivity – You now rely very heavily on your internet connection.  Although the datacenters will have backups for everything, how reliable is your connection?  Can you deal without your application if the internet is not available?
  • Infrastructure Surface Area – Albeit a minimal change, you are increasing the surface area of your infrastructure, and thereby increasing the potential that it may be a target and a victim of hackers.

Pricing for the service can be found at Pricing.  Note that the compute time is CPU running time, not CPU/proccess time.

Tags:

Discourse | Tech Tips

KBED - KLWM - KBED

by Joe Havelick 15. January 2010 21:13

I've decided to start documenting some of my airborne adventures here.  Hopefully this will be of some enjoyment to you folks.

Oppertunity struck with beatiful weather and a open calendar.  I called up my first choice for co-pilot, Mr. Adam Ribaudo, who also came with his Chief Engineer Kristen.  We tooled around, did some touch and goes at Lawrence (changed seats), then retruned to BED at sunset.  Better than I can describe in words, Mr. Ribaudo documented with video and "beep and blip" music.  Take a look.

 

MA Flyover with Joe Havelick from Adam Ribaudo on Vimeo.

Tags:

Aviation

The Authority on net neutrality

by Joe Havelick 23. October 2009 12:23

"Sen. John McCain, the Arizona Republican, introduced a bill late Thursday that would short-circuit the FCC's ability to enforce its proposed open Internet rules. In a press release, McCain said the new rules will "stifle innovation, in turn slowing our economic turnaround and further depressing an already anemic job market." McCain is particularly opposed to extending net neutrality to the wireless space, and his bill, the Internet Freedom Act of 2009, comes as opponents of net neutrality launched a furious attack on the FCC and the Obama administration."

From: Net neutrality: John McCain says no, Glenn Beck sees a Marxist plot

"I read my e-mails, but I don't write any. I'm a Neanderthal -- I don't even type. I do have the rudimentary capability of calling up some Web sites, like the New York Times online, that sort of stuff. No laptop. No PalmPilot. I prefer my schedule on notecards, which I keep in my jacket pocket.
But my wife has enormous capability. Whenever I want something I ask her to do it. She's just a wizard. She even does my boarding passes -- people can do that now. When we go to the movies, she gets the tickets ahead of time. It's incredible."

From an Interview with John McCain: How I Work

Is this the man we want leading the policy on web innovations?

Tags:

Discourse

Creating a delimited field from a number of rows

by Joe Havelick 24. July 2009 09:55

I found a couple of tricks in solving the problem of generating a single comma separated field from a number of rows. The function looks a little like:

CREATE FUNCTION ReturnAllNAICs

(     @CompanyID int)

RETURNS nvarchar(128)

AS

BEGIN

      DECLARE @NAICS NVARCHAR(128)

 

      SELECT @NAICS = COALESCE(@NAICS + ', ', '') + NAIC

      FROM NAIC_Codes

      WHERE CompanyID=@CompanyID

 

      RETURN @NAICS

END

So how do we generate the list? Simply appending to a string with each row added. But this always gets 10 times more complex because you don’t know whether to add a comma. That’s where my favorite new keyword COALESCE comse into play. You can read the details below, but basically it’s like an IIF statement but it assesses for the value to be null or not null. So, it will add a comma before the next value only if @NAICS is not NULL.

References:
COALESCE (Transact-SQL) - http://msdn.microsoft.com/en-us/library/ms190349.aspx
Using COALESCE to Build Comma-Delimited String - http://www.sqlteam.com/article/using-coalesce-to-build-comma-delimited-string

Tags:

Tech Tips

URL Decoding in SQL

by Joe Havelick 16. July 2009 14:19

CREATE FUNCTION dbo.UrlDecode(@url varchar(3072))
RETURNS varchar(3072)
AS
BEGIN 
    DECLARE @count int, @c char(1), @cenc char(2), @i int, @urlReturn varchar(3072
    SET @count = Len(@url
    SET @i =
    SET @urlReturn = '' 
    WHILE (@i <= @count
     BEGIN 
        SET @c = substring(@url, @i, 1
        IF @c LIKE '[!%]' ESCAPE '!' 
         BEGIN 
            SET @cenc = substring(@url, @i + 1, 2
            SET @c = CHAR(CASE WHEN SUBSTRING(@cenc, 1, 1) LIKE '[0-9]' 
                                THEN CAST(SUBSTRING(@cenc, 1, 1) as int) 
                                ELSE CAST(ASCII(UPPER(SUBSTRING(@cenc, 1, 1)))-55 as int
                            END * 16
                            CASE WHEN SUBSTRING(@cenc, 2, 1) LIKE '[0-9]' 
                                THEN CAST(SUBSTRING(@cenc, 2, 1) as int) 
                                ELSE CAST(ASCII(UPPER(SUBSTRING(@cenc, 2, 1)))-55 as int) 
                            END
            SET @urlReturn = @urlReturn + @c 
            SET @i = @i +
         END 
        ELSE 
         BEGIN 
            SET @urlReturn = @urlReturn + @c 
         END 
        SET @i = @i +
     END 
    RETURN @urlReturn
END
GO

References:

http://sqlblog.com/blogs/peter_debetta/archive/2007/03/09/t-sql-urldecode.aspx

 

Tags:

Tech Tips

Review: Dual XHD7714

by Joe Havelick 15. April 2009 17:31

The Dual XHD7714 is a full featured car stereo head unit at a very cheap price.  It features your standard AM/FM CD/MP3/WMA player, Bluetooth speakerphone/AV input, HD Radio, USB drive, and iPod integration all built into the unit.  Best of all, the price, anywhere from $135 -180 (best price linked above).

It's tempting to say you get what you pay for, but for this unit, I feel like you're getting a whole lot more.  You really can't find a head unit with both Bluetooth and HD radio integrated.  You usually get one, and have to buy a module for the second.  The call quality is comparable to any other speakerphone.  The HD radio is pretty impressive.  A single frequency can actually broadcast multiple channels.  That means much more variety in the same spectrum, and there is a significant quality boost, mostly in the high end.  As compared to satellite radio, it doesn't sound nearly as compressed, when the signal is lost, is seamlessly falls back to analog, and it doesn't cost anything on a regular basis!

I don't use an iPod (yes, I'm the one), so I can't speak for that geature set, but I do use a regular MP3 player via the AUX input, and that's pretty straight forward.  I also put books on tape onto my thumb drive. They've made it simple to navigate through folders and files.  Also, after I remove my thumbdrive, and insert it later, it picks up where I left off.  With books on tape, this it important since some tracks can be 30-60 minutes, and I don't have to fastforward to find my spot.

I listen to everything from downtempo to progressive rock, and the frequency response is as good as you can get from a unit at this price (way better than the upgraded OEM unit that came with my vehicle.)  I recently spent 9 hours driving over the period of Easter weekend and I never ran out of things to listen to/play with. 

Here are the rumors I read about, and my take:

  •   The buttons feel cheap - Well, you can tell they're your standard surface mount PCB buttons.  True, they don't have a tactile feedback sensation that you would brag about, but I'm not concerned about their lifespan.  This is a "you get what you pay for" item.
  •   The Bluetooth speakerphone is quiet/I have to yell - This unit is at par with any other phone based speakerphone or external bluetooth speakerphoneI've used.  I'm actually impressed with the noise cancellation given the level of feedback it recieved form the car speakers, and the road noise in my truck.  The only thing I would complain about is thatoccationally the voices are "sharp" and can be peircing if they all of a sudden start talking louder.  
  •   The LCD is unreadable in daytime - It's definitely dim, but I've been able to read it in all conditions so far.  It might depend on the mounting angle.  My screen is perfectly perpendicular to the floor.  I will say that it is slow to refresh.  And I was also surprised that there was no "dimmer" wire, so the brightness does not adjust with your dimmer setting on your vehicle.  This is also a "you get what you pay for" item.
  •   The HD radio reception is poor - Here in the greater Boston area, I'm getting better HD reception than FM reception.   And the failover from HD to FM is actually pretty unnoticable, other than the fidelity loss.

Pros:

  • Cheap ($135)
  • Good BT Speakerphone
  • Great HD
  • USB Thumbdrive support
  • Aux Input
  • iPod integration
  • Decent sound quality
  • 3 set of pre-amp outputs

Cons:

  • No dimmer support
  • LCD issues (see above)
  • Some bluetooth issues, cannot answer from head unit on one phone.
  • Bluetooth can sound "sharp", needs a compressor.
  • FM reception not great.

Overall, this is the best unit you can buy at this price range today.  Hands down.  That's why I own it.

The official page, with a link to the manual can be found here.
The best price I found at the time is available here.

Tags:

Audio | Reviews

About Me

Joe Havelick is a reasonable facsimile of this photo.


profile for Joe on Stack Exchange, a network of free, community-driven Q&A sites

Recommendations