Isilon Customers

Isilon has many cool customers doing awesome things with our products, but most of them we can’t talk about. There are some we can talk about though and I wanted to share a few that were announced in press releases:

  • Sony Imageworks – makers of Alice in Wonderland and Spider-Man (via)
  • NAVTEQ – makers of map data used in things like GPS systems (via)
  • Mr. X Inc. – they did the post-production of TRON: Legacy (via)
  • Prologue – they did the post-production of Iron Man 2 and Sherlock Holmes (via)

Note that just because the company uses Isilon products doesn’t mean that they used them when making the above films, but you get the idea.

The Isilon press release page has the full listing, these are just some that I thought most folks could relate to.

Why I left IBM

Three months ago I left IBM for greener pastures. My departure from IBM surprised most all of my coworkers (except for one person who said both “I’m surprised it took this long” and “take me with you”). One person in IBM requested that I let them know why it was leaving so “we can learn from [it]” and this is what I wrote up and sent to them.

I guess it came as a shock to most people because I was not disgruntled — I didn’t sat around bitching to coworkers about some imaginary wrong done to me by IBM. They were probably also a bit surprised because I was on a rather fast-paced track upwards and getting good visibility. I don’t expect anyone to be surprised at why I left however.

First, lets remove any doubt as to the non-reasons why I left. That is, these things played no part in my choosing to leave

  • The workload. I love to stay busy. Sometimes between juggling customer issues, testing products, doing exploratory testing, and documenting findings I’d end up working long days or weeks. During one customer critsit I recall never leaving my desk for 4 days over a weekend until we got the issue resolved. For that same customer I worked on-site 4th of July weekend. But my direct manager and management team were always on top of me to take compensation time or be flexible about my normal schedule.
  • The team. Far from being a reason to leave, this was a big reason to stay. Everyone on both my immediate and extended team were complete professionals and have been nothing but a pleasure to work with. That doesn’t mean that there were no disagreements or heated discussions, but those rare instances were examples of how passionate folks cared about their work – not disrespect for their peers. (And trust me when I say that I’m sure I came across as an ass when advocating for my defects in bug scrubs!)
  • My direct management team. My direct management team was the best. Every first-line manager I had at IBM was phenomenal and raised the bar for their successor. Woody, my last first-line, is no exception and left some very big shoes to fill. He and the rest of my team gave me the flexibility to define my own job and the right level of running interference when I needed a buffer.

So lets cut to the chase and talk about the reasons I left:

  • The global development model. IBM is a global company and has development teams all over the world. That makes sense. What doesn’t make sense is to have a single team spread all over the world. What makes even less sense is to have a single agile team spread across the world. Scrum meetings over conference calls aren’t scrum meetings. In order to make cohesive teams it’s important for folks to get some face time yet IBM has no provisions for ever making this possible.
  • The lack of team support. Money to do anything team-related is nonexistent. For several years managers have been taking their teams out to lunch and other small team-building exercises with their own money. This is true of at least Tivoli and Information Management as I have manager friends in both areas.
  • The compensation. Let me preface this section by saying that I didn’t leave IBM because I thought I didn’t got paid enough. In fact, I took a pay cut moving to Isilon — and that’s not even accounting for the higher cost of living in Seattle. Instead this is about recognizing those who IBM purports to be “top contributors”. In 2010 I got a 1 — in a long string of 1s really except for years after I got a promotion. After 10 years, that’s not bad. My total raise in 2010: 4%. I got the feeling that this was a pretty high percentage compared to the rest of the organization. Except I didn’t get one at all in 2009 after being a new band 9. So that 4% over two years is more like 2% a year. And that’s for top contributors!? Compare this to the report that this year Google is giving a 10% pay increase across the board to their employees — not just their top contributors. At this rate I don’t see how IBM can stay competitive.
  • The spending constraints. I almost titled this section “The stupid”. It’s no surprise that IBM has been encouraging people to do more with less. Part of that mantra resulted in the order that there was to be no travel of any kind that wasn’t customer related without an exception. Getting an exception requires an Act of God yet sometimes people must still travel (see aforementioned item about the importance of team building) so management wastes time hunting around for any customer that they can place the traveling employee with for 30 minutes so they can check a box to get the expense approved. During my last 2-week trip to RTP, whose entire purpose was to engage with the team developing a new product, I paid for the entire trip. I saved money by staying with a good friend and paid for my own airfare. The only thing I asked IBM to do was to pony up money for a rental car for the two weeks. Total estimated cost: $500. Management wasted 3 or more weeks trying to find some customer for me to see while I was there to get reimbursed for it. How much employee time was wasted just to find some customer so I could get reimbursed $500. That’s just stupid. (They didn’t find me a customer by the time I left Denver so I canceled the rental car and borrowed my friend’s car for the 2 weeks. After I was there they found a customer for me to, literally, meet in a hotel lobby for 30 minutes talking about what tools we use in our lab to claim that I “met with a customer”. When the bean counters have forced managers to come up with such farce, and outright lies, to get travel compensation, it’s time to go elsewhere. I never did file that expense report. While I appreciate the effort my management team went through to get there, it was a little too late. More importantly, I couldn’t in good conscious be a part of such an outright lie.)
  • The recognition. Early in 2010 IBM got rid of their Thanks! awards in an attempt to further reduce expenses. This piddly little program was replaced with crappy eCards and a promise that a different compensation program was forthcoming. The new program was suppose to be more team-based and yet months after having been introduced I never heard of any team getting it. The Thanks! award program isn’t the problem, it’s just a symptom of how IBM is no longer recognizing the effort of their employees.
  • The remote allowances. Initially IBM provided internet access and phone service via VOIP to their work-from-home employees. Then they nuked the internet access. Then they changed the VOIP to a $40/month max compensation for some other phone service. Now they’ve reduced the phone cap to $25/month. Given how much money IBM must save when an employee works from home compared to in an IBM facility (electricity? furniture? lease on office space?) this is, again, crazy. Soon I expect IBM employees to pay for the privilege of working from home.

In short: IBM is reducing the quality of their employees’ working environment and compensation to increase the stock price. As a shareholder I like it. As an employee it was intolerable any longer.

gridengine qmon font problems

Even after you get gridengine installed, you’ll have some lovely font problems when using qmon. After trying a few things, the easiest is just to follow the advice at this web page and set the fonts to fixed. Note that copying $SGE_ROOT/qmon/Qmon to $HOME is an important part — updating the file directly won’t work. This should be done on the system with the qmon binary (should be obvious, but you never know).

If you decide to try and fix the fonts themselves, remember that the fonts need to exist on the Xserver rendering the qmon dialog, not necessarily the one on the system where qmon is being run from. In other words, if you’re doing X11 forwarding from a remote host to your desktop, it’s your desktop’s X11 server that needs the fonts, not the fonts on the remote host. Thanks to this post clarifying that pesky detail.

And finally, if you decide to poke around and get non-fixed fonts working, you’ll probably need these RHEL packages (via):

  • xorg-x11-font-utils
  • xorg-x11-fonts-100dpi
  • xorg-x11-fonts-75dpi
  • xorg-x11-fonts-misc

and possibly futzing with xfs and fc-cache. I tried this approach and fixed the initial error messages from the X server (yay!) but resulted in boxes instead of glyphs (boo) and failed back to fixed fonts.

gridengine RPM for RHEL5 (and CentOS 5) is broken…

…and here’s how you fix it.

After installing gridengine, before running install_sge (or install_qmaster / install_execd):

  1. edit /usr/share/gridengine/util/install_modules/install_common.sh
  2. find the CreateGSEStartUpScripts() function and nuke the entire contents of the “if [ $create = true]; then” up until (but not including) the “if [ $euid = 0 …]” line.
  3. save and exit the file
  4. edit /usr/share/gridengine/util/install_modules/install_qmaster.sh
  5. find the StartQmaster() function and change the ‘$SGE_STARTUP_FILE -qmaster’ line to read ‘/etc/init.d/sgemaster’ and remove the remaining contents of the function up until (but not including) the ‘$INFOTEXT …’ line
  6. save and exit the file

Now you can run the appropriate installation program.

The problem is that the RHEL5 packaging tries to remove the gridengine startup scripts and replaces them with its own startup scripts. Sadly the job wasn’t well done (and obviously wasn’t tested). I’ve notified the package maintainers but this will get you going until the package has been fixed (given that the package has existed in this form since 2008, I’m guessing it isn’t that popular of a package as-is).