Adventures in systems land

Yep, it’s a mouthful. I’ve just been booking some events and presentations for later in the year, and this one, which I had initially hoped to attend clashes with one, so now I can’t.

However, in case the snappy new title passed you buy, it is still the excellent IBM Technical conference it used to be when it was the IBM System p, AIX and Linux Technical University. It runs 4.5 days from 8 - 12 September in Chicago and offers an agenda that includes more than 150 knowledge-packed sessions and hands-on training delivered by top IBM developers and Power Systems experts.

Since the “IBM i” conference is running alongside, you can choose to attend sessions in either event. Sadly I couldn’t find a link for the conference abstracts, but there is more detail online here.

I’ve been working on slides this afternoon for a couple of projects, and wondering why producing slides hasn’t really gotten any easier in 20-years since Freelance under DOS? Why is it I’ve got a 22 flatscreen monitor as an extended desktop, and I’m using a trackpoint and mouse to move things around, and waiting for Windows to move pixel by pixel…

Anyway, I clicked on the LIBSyn link for the RedMonk IT Management Podcast #10 from back in April for some background noise. In the first 20-mins or so, Cote and John get into some interesting discussion about Power Systems, especially in relation to some projects Johns’ working on. As they joke and laugh their way through an easy discussion, they get a bit confused about naming and training.

First, the servers are called IBM Power Systems, or Power. The servers span from blades to high-end scalable monster servers. They all use the Power PC architecture, instruction set RISC chip. Formally there had been two versions of the same servers, System p and System i.

Three operating systems can run natively on Power Systems, AIX, IBM i (formally i5/OS and OS/400) and Linux. You can run these concurrently in any combination using the native virtualization, PowerVM. Amongst the features of PowerVM is the ability to create Logical Partitions. These are a hardware implementation and hardware protected Type-1 Hypervisor. So, it’s like VMware but not at all. You can get more on this in this white paper. For a longer read, see the IBM Systems Software Information Center.

John then discussed the need for training and the complexity of setting up a Power System. Sure, if you want to run a highly flexible, dynamically configurable, highly virtualized server, then you need to do training. Look at the massive market for Microsoft Windows, VMware and Cisco Networking certifications. Is there any question that running complex systems would require similar skills and training?

Of course, John would say that though, as someone who makes a living doing training and consulting, and obviously has a great deal of experience monitoring and managing systems.

However, many of our customers don’t have such a need, they do trust the tools and will configure and run systems without 4-6 months of training. Our autonomic computing may not have achieved everything we envisaged, but it has made a significant difference. You can use the System Config tool at order time, either alone, with your business partner or IBMer, and do the definition for the system, have it installed and provisioned and up and running within half a day.

When I first started in Power Systems, I didn’t take any classes, was not proficient in AIX or anything else Power related. I was able to get a server up and running from scratch and get WebSphere running business applications having read a couple of redbooks. Monitoring and debugging would have taken more time, another book. Clearly becoming an expert always takes longer, see the wikipedia definition of expert.

ps. John, if you drop out of the sky from 25k ft, it doesn’t matter if the flight was a mile or a thousand miles… you’ll hit the ground at the same speed

pps. Cote I assume your exciting editing session on episode 11, wasn’t so exiciting…

ppps. 15-minutes on travel on Episode #11, time for RedmOnk Travel Podcast

I’ve had a few emails asking me if I was going to write a log entry on this month announcements, and to be honest I wasn’t. They are an impressive list of products, branding and customer announcements. I wasn’t anything to do with them, given I’m no longer asked to do marketing/sales types presentations, I picked that time to go do the Machupichhu/Inca trail trip in Peru.

The April announcements though were a credit to the teamwork across the even more global IBM. Core Processor and server development teams in Austin and Rochester, worked with domain specialists in Poughkeepsie and Boeblingen. On top of this were the software development and test teams in India, China and and ever increasing number of places.

The new UNIX enterprise server, the Power™ 595 is an impressive beast if the charts are anything to go by. I’m hoping to get Nancy to take me across the building to the test bring-up to have an up close and personal look sometime this week. The new POWER6 “Hydro-Cluster” supercomputer, the Power 575, is very impessive using a new super-dense system, with a unique, in-rack, water-cooling system and with 448 processor cores per rack. Apprently it offers users nearly five times the performance and more than three times the energy efficiency of its predecessor, IBM’s POWER5+™ processor running upto a industry busting clock cycle of up to 5 GHz.

These Super-dense systems are starting to become a really interesting value prop. On Friday I got a link to the IBM.COM public website that included a video on our iDATAPLEX offering. It was there Saturday and has gone today, but it was there as this search in the current google index shows. The video doesn’t show any technical details but does give an interesting insight into this x86 based super-dense, Internet scale, behemoth of a server. I was hoping there was other public comment or blog entries I could leach off for discussion points, but the only search results return job postings

Anyone go to the iDATAPLEX session at IMPACT 2008 and want to comment ??

Feb. 12th Datamation announced their product of the year awards, the IBM Power Systems p570 server won enterprise server of the year, up against the IBM System x 3950 M2 Server, the HP MediaSmart Server, and the Dell PowerEdge 2970.

Details on all the award winners are here.

A couple of things from the “Monkmaster” this morning peaked my interest and deserved a post rather than a comment. First up was James post on “your Sons IBM“. James discusses a recent theme of his around stackless stacks, and simplicity. Next-up came a tweet link on cohesiveFT and their elastic server on demand.

These are very timely, I’ve been working on a effort here in Power Systems for the past couple of months with my ATSM, Meghna Paruthi, on our appliance strategy. These are, as always with me, one layer lower than the stuff James blogs on, I deal with plumbing. It’s a theme and topic I’ll return to a few times in the coming weeks as I’m just about to wrap up the effort. We are currently looking for some Independent Software Vendors( ISVs) who already package their offerings in VMWare or Microsoft virtual appliance formats and either would like to do something similar for Power Systems, or alternatively have tried it and don’t think it would work for Power Systems.

Simple, easy to use software appliances which can be quickly and easily deployed into PowerVM Logical Partitions have a lot of promise. I’d like to have a market place of stackless, semi-or-total black box systems that can be deployed easily and quickly into a partition and use existing capacity or dynamic capacity upgrade on demand to get the equivalent of cloud computing within a Power System. Given we can already run circa 200-logical partitions on a single machine, and are planing something in the region of 4x that for the p7 based servers with PowerVM, we need to do something about the infrastructure for creating, packaging, servicing, updating and managing them.

We’ve currently got six-sorta-appliance projects in flight, one related to future datacenters, one with WebSphere XD, one with DB2, a couple around security and some ideas on entry level soft appliances.

So far it looks like OVF wrappers around the Network Installation Manager aka NIM, look like the way to go for AIX based appliances, with similar processes for i5/OS and Linux on Power appliances. However, there are a number of related issues about packaging, licensing and inter and intra appliance communication that I’m looking for some input on. So, if you are an ISV, or a startup, or even in independent contractor who is looking at how to package software for Power Systems, please feel free to post here, or email, I’d love to engage.

In September and October 2007, the IBM Software Group Competitive Project office put on a short series of roadshows in North America and India to show some of the best aspects of IBM Middleware running on Power Systems. It’s not an out and out marketing event, but one designed and presented by some solid technical folks.

They’ve announced the first set of dates for 2008, and the events start next week. Strangely the workshop is listed on the Software/Linux web page but definitely covers AIX and Linux implementations. Here are the dates and locations, hope some of you new to Power or interested in IBM Middleware exploitation on Power can make it along.

Thanks to James Governor at Redmonk or @monkchips on twitter, for the pointer. In this pretty direct interview, Linus Torvalds says something I got into trouble for about 7-years ago. Linus says “An OS should never have been something that people really care about… it should be completely invisible”.

I gave the keynote presentation at the OS/390 Expo and Performance Conference, I think in either 2000 or 2001, during the presentation I made exactly the same point, only about Linux. Yes, Linux was great, yes, we were going to do some pretty innovative things with it, but if in 5-years time we are still wrrying about scalability, driver compatibility etc. then we’d missed the point, we shouldn’t really have to care about the OS.

Unfortunately in the audience was the IBM Account Executive for a large multi-national company, and the CEO from that company. Rather than come and ask questions afterwards, they took one point from a 75-minute presentation and complained about me to my then VP, Carol Stafford. Carol “invited” me into her office, I had to explain the remark, and context, Carol understood and took care of things.

So it’s with a wry smile I read the Torvalds article, and then sat up and wondered, do we still care about the OS, or has the stack become more important?

Yesterday saw the announcement of a re-packaging, re-branding and new technology drive for POWER™ Virtualization now PowerVM™. You can see the full announcement here. It is good to be back working on VM, sorta.

Over on virtualiztion.info, Alessandro Perilli, says we are “missing the market in any case because its platform is unable to virtualize Windows operating systems”. I say not.

POWER isn’t Windows, it’s not x86 hardware. We scale much, much higher, perform much better and generally offer high availability features and function as standard or an add-on, way ahead of Windows. Running Windows on PowerVM and Power hardware would pick-up some of the reliability features of the hardware transparently, and the workload consolodation potential would be very attractive. What it comes down to though, is what it would take to virtualize Windows on PowerVM?

We could do it. We could add either hardware simulation or emulation or more likely translation that would allow the x86 architecture or Windows itself to be supported on PowerVM. There would be ongoing issues with the wide variety of h/w drivers and related issues, but lets put those aside for now.

We could have gone down a similar route to the old Bristol Technologies WIND/U WIN32 licensing and technology route, porting and running a subset of WIN32 or even via mono or .net. We might even call it PowerVM Wx86. Just reverse engineering MS technology is neither the right idea from a technology or business perspective.

So technically it could be done one way or another. The real question though is the same as the discussion about supporting Solaris on Power. Yes, it would be great to have the mother of all binary or source compatibility virtualization platforms. However, as always the real issue is not if it could be done, but how would you support your applications? After all isn’t it about “applications, applications, applications“?

And there’s the rub. If you wanted to run middleware and x86 binary applications on POWER hardware, then you’d need support for the binaries. For middleware, most of the industries leading middleware is already available on either of AIX, i5/OS or Linux on Power, some is available on all three. What would software vendors prefer to do in this case? Would they be asked to support an existing binary stack on Windows on PowerVM, or would they prefer to just continue to support the native middleware stacks that benefit directly from the Power features?

Most would rather go with the native software and not incur the complexities and additional support costs of running in an emulated or simulated environment. The same is true of most customer applications, especially those for which the customer doesn’t have easy or ready access to the source code for Windows applications.

In the x86 market, the same isn’t true, there’s less risk supporting virtualization such as Xen or VMware

The same isn’t true with PowerVM Lx86 applications. First because of the close affinity between Linux and Linux on POWER. There are already existing Linux on Power distributions, the source code is available, and most system calls are transparent and can be easily mapped into Linux on POWER. Second, drivers, device support etc. is handled natively within either the POWER hardware, PowerVM or within the Linux operating system, running in the PowerVM partition. Thirdly, IBM has worked with SuSe and RedHat to make the x86 runtime libraries available on Linux on POWER. Finally, many middleware packages already run on Linux on POWER, or it is available as open source and can be compiled to run on Linux on POWER.

All of which makes it a very different value proposition. Using NAS or SAN storage, it is perfectly possible to run the same binaries currently or as needed on x86 and PowerVM. The compilcations of doing this, the software stack required, as well as the legal conditions for running Windows binaries just don’t make it worth the effort.

Although not identical, many of the same issues arise running Solaris, either Solaris x86, or OpenSolaris PowerPC port. So, thats a wrap for now, still many interesting things going on here in Austin, I really well get back to the topic of Amazon, EC2 and loud computing, memo to self.

I initially wrote the following a version of this as a comment to John Meyers blog entry over on sun.com - Somewhere between starting the comment on his blog and finishing it, comments were closed and it didn’t get accepted.

A number of people over the past few weeks having been egging me on to respond to John’s blog entries comparing SUN and POWER offerings. It’s great being an evangelist, being the ultimate believer in a product, technology, cleaning equipment or life saving gadget, you can’t fail, the world is your oyster, your vision is world domination and your business allows you to do it, better still, they encourage you. I’m certainly not going to do a line by line analysis and deconstruction of his writings, it’s just unproductive. He has an opinion, and he is entitled to it.

Over the next few weeks though I will post some thoughts on the general assertions. Here though, is the response I originally wrote to this blog post.

John, it’s been fun reading your POWER and virtualization analysis, you are obviously passionate about your position and the technology at SUN. SUN have clearly done a good job at filling some gaps in their product portfolio over the past few years, some in response to competitive pressure from IBM and others, and some as industry leadership.

There is no doubt that SUN have done some things that have meant IBM has had to respond. However, what you seem to have glossed over, in direct comparison to POWER Systems, rather than IBM Virtualization in general, is the real need for some of the features, and their real usability, rather than just the technical implementation. Hey, but thats life through “rose-tinted spectacles”. Oh yes, this isn’t “hubris”, I didn’t create logical partitioning, but I did contribute to it as well as a number of other important virtualization technologies.

Matais, I assume you mean CTSS which was developed at MIT to run on an IBM 709 computer between 1959-1961.

One of the programmers on that project, Bob Creasey, went on to become the project lead for CP40 the first ever IBM Virtualization implementation. CTSS was really more of a time sharing system, rather than “virtualization.”

Gene Amdahl, then Chief Architect for the S/360 product line at IBM, visited MIT a number of times and had meetings with the Professor and the CTSS team with a view to making enhancements to the hardware architecture. It is reported that they didn’t see eye-to-eye over a number of things.

There is a written history and more of this than you’d ever want to know at: http://www.princeton.edu/~melinda/25paper.pdf

The concept of “domains” and logical partitions isn’t included in the above. It would not be correct though to state that Amdahl created LPARS. He actually lead a company that created a firmware/hardware implementation of multiple domains. IBM’s implementation of logical partitions differed significantly although used a similar basic premiss. Further discussion with revisions, corrections and updates probably belongs elsewhere, where it can be maintained, and not a reply to a blog post where it cannot.

There are number of companion documents that show the roll of other important users and customers which helped IBM improve its’ virtualization offerings.

Regards.

For the record I also wrote comments on the Solaris/Linux/AIX conspiracy theory here

While sitting around this evening listening to the zdnet, David Berlind and Redmonk webcast, Monkcast #12: IBM HW group OEMs Solaris to chagrin of SW group & a fly in VMware’s ointment and both on the show and a web article, a few things came up that were worth commenting on, if for no other reason than to save history from being rewritten:

Continue reading ‘Predict the future, rewrite history’