Server issues resolved, Making Amends and HD3 Launch
Published November 17, 2011 by Richard Uren
Earlier this week Handset Detection experienced intermittent outages, delayed service and high network latency (for the non technical people out there thats basically all bad).
The actual problem was a 3 fold combination of a traffic surge (which we would usually have ample capacity to handle) combined with a caching bug and the accidental removal of a default device profile by one of our handset maintainers. The system, when looking for this default profile, would rebuild the device cache and save it. However the bug caused caches to be rebuilt 5 times per second (placing an extremly high load on our servers), rather than once every 8 to 10 hours. Combined with the traffic increase it was enough to have a serious effect on our service.
At the time I was sure the problem was traffic based and so ordered lots more servers. Thats what operations guys like me do, I see servers struggling and think, ‘Well, there’s been no software updates, and traffic is up, therefore ‘Get More Servers, That’ll fix it’ – And it did. Then we fixed the real problem and all those shiny new super fast servers went virtually idle .. .. .. So, rather than begging for a refund with our hosting suppliers (good luck) we figured a better use would be to give something back to our community, by way of an apology, or an amends.
So, From Monday November 21 until December 26th Handset Detection will be uncapped ! Thats right unlimited detections from November 21 right up until Christmas (well Boxing Day technically) for everyone. Hooray ! and sorry for the hassle. (Note : You’ll still get quota email notices but you can safely ignore them).
One last thing from me today. Whenever issues like this crop up folks always ask about a stand alone detection service, to run on their own servers. Early in the new year we’ll be releasing our HD3 in memory detection engine and device database for stand alone use. Its wicked fast and now has the caching bug fixed :) To get on the launch list please drop your details into the HD3 Launch Notification form.
Image Credit : Chantal W. http://www.flickr.com/photos/nanjenchan/
Posted In Support | 0 Comments
