At Forward we have been using Hive for a while and started out with the default table type (uncompressed text) and wanted to see if we could save some space and not lose too much performance. The wiki page HiveCompressedStorage lists the possibilities »
I was curious about our Hive tables total usage on HDFS and what the average filesize was with the current partitioning scheme so wrote this ruby script to calculate it. current = '' file_count = 0 total_size = 0 output = File.open('output.csv','w' »
I gave a talk recently at the Forward Tech away day entitled We Are All DevOps and it went down quite well. Forward is an unusual environment, the devs are trusted to do lots of the typical sysadmin role and the boundary between Dev and Ops is very blurred »
Well, day 400 of my 101 goals in was Feb 5th and I was in the midst of moving house so delayed doing this. Completed - 16 1, Teetotalitarianism for 3 months 2, Cheeseless for 3 months 9, Read [GEB](http://en.wikipedia.org/wiki/G%C3%B6del,Escher,Bach »
Yesterday we had an issue with the different behaviour of “kill ” and “kill -9 ” and in the process I had to refresh my knowledge of Unix signals, learn how you handle them in Ruby and properly learn Rubys exception hierarchy. To -9 or not to -9? The »
While moving our VM deployment site written in Sinatra to a Windows machine with the VMware PowerCLI toolkit installed the only snag was where we forked a process to do the preparation of the machines. Both Kernel.fork and Process.detach seemed to have »