Wednesday, April 18, 2007

Palm logo
Sorry to be so slow to post about all the interesting Palm news. I notice that traffic here spiked heavily last week after Palm's Analyst Day, when they finally announced the home-grown Linux-powered version of the Palm OS that I've been predicting for a little over a year. Lots of other exciting stuff going on here at Pikesoft, so I haven't even had time to gloat. I'll try to make up for it now ;-) And I'll make another prediction that is far more speculative and will probably be wrong.

To even my surprise, Palm confirmed not just one, but all three important predictions that I made in this PalmInfocenter article published last May:

  • Palm is creating their own next-generation Palm OS by combining the old OS with a Linux kernel. This is not an announcement that they are adopting the ACCESS Linux Platform, rather this is an operating system that Ed Colligan says they have been working on for "a number of years"—by one now-credible report even longer than PalmSource themselves have been working with Linux.
  • They are turning to the server side with a new focus on web services and web applications. Innovations in the web experience, web services and "simple web applications" were mentioned over and over during the presentation, which followed closely on an Opera agreement to deliver a Palm OS port of Opera 9 for future Palm products.
  • Palm is adding the capability of updating both software and system firmware over the air. In the industry parlance this is called FOTA (Firmware updates Over The Air) and Palm sounds like they might be a fairly early adopter.

Details were very sketchy on all three points, but if you listened closely and know a little about Palm's history, I think you can fill in some gaps here and there. By the way, there's no transcript for Analyst Day, and it seems like the audio and slides have been taken down from Palm's site audio and slides only (registration required), so I'm sorry that I can't provide links to the statements made during the presentation. Later I'll speculate more about Palm's new OS and FOTA plans, but today I'm going to focus on all their talk about web experience, where I think they are in a better position to innovate than many folks give them credit.

The first area Ed Colligan identified as a "primary focus" for Palm is delivering "the fastest, most compelling web experience... with connected web applications." He said that Palm believes there is "enormous innovation to be done" in this area and said that toward this end they are building a "connected application environment." Normally the "connected application environment" for the web is called a browser. But for all the talk about "simple web-connected applications" the speakers seemed to be avoiding discussion of the browser, except when discussing Palm's past leadership in this area. While I believe that Palm wants to continue to improve the browsing experience (and Opera 9 will be great for that) something tells me this is not the whole story.

Another clue: when you hear someone from Palm talk about an experience being "fast" they usually mean it. Responsiveness has always been a hallmark of the Palm experience and I believe that an important part of the company's bold decision to tough it out and develop their own successor to the Palm OS was the sense that Palm had not been able to deliver the kind of snap that users expect as they tried to innovate on the old platform. Now, browser based applications running on high-latency wireless networks—even simple apps—are not typically what you would call fast. Certainly not by Palm's standards. Nor is there probably a whole lot that Palm can do to make HTML pages download and render faster in the browser, short of using AJAX and DHTML, which smartphones simply do not have the resources to do at this time.

So where am I going with this? Well, some Palm developers may remember an interesting technology that Palm (then Palm Computing) introduced with their first wireless PDA, the Palm VII, back in 1999. This device (and it's successor the i705) ran on the fairly large but horribly slow (19.2kbps) Mobitex pager network on which Palm built a network service called Palm.Net. The slow network wasn't the only barrier to a reasonable web experience: Palm devices at that time ran on 16MHz processors with 8MB of RAM, making the parsing and rendering of HTML pages slow enough to be out of the question for all but the most patient (or desperate) mobile user. Palm's solution to these severe constraints was called "Web Clipping." Bear with me a moment as I explain why I think this technology—or a successor to it—could very well be the centerpiece of the web services product strategy that Palm talked about so much during Analysts Day.

Web Clipping was a web technology, so from a developer standpoint it involved no native C code; rather there was a tool for "compiling" HTML forms into a Palm Query Application (PQA) that was installed directly on the device like any other Palm app. On the device a PQA was almost indistinguishable from a regular Palm app: it had its own application icon in the launcher and it displayed a form instantaneously upon launch with widgets that looked identical to those you saw in a native Palm application (even though the form was designed in pure HTML). But when you entered some data you wanted to retrieve (say a highway for which you wanted traffic information) and tapped a button it would submit the request to a server (going through the Palm.Net proxy) very much like a browser. The response was displayed in a simple browser designed to receive compressed, possibly transcoded content from the proxy.

This technology had several advantages over a regular web application and I think most of them apply as much today as they did in 1999. First, a Web Clipping Application (WCA) is a single-purposed app so there is no URL for the user to enter: it's compiled into the PQA. Second, the form for entering your query to the web doesn't have to be fetched from the server: again, it's already on the device so it comes up instantly. Third, the PQA didn't use HTTP to make the request, which involves lots of time-wasting "how do you do, how are you, fine and you?" over the network before it gets down to the business of giving you your data. Instead it uses connectionless UDP which dispenses with the formalities and just grunts "gimme this." It's up to the proxy to translate this rude but efficient request into polite HTTP and send it along to the appropriate web service. Result: your request gets to the web much faster than when you click a button or link in a browser. Finally, the Palm.Net proxy compressed the response it got back from the web service before sending it back to the device, again, speeding up response time. Everything was designed to be fast, which was the word we heard used at least three times during the presentation last week while describing the experience Palm users will have on the web.

Palm.Net was shut down in the summer of 2004. I can surmise a couple of reasons for this. First, the cellular data networks were so much faster and bigger than Mobitex by that time that the Palm.Net infrastructure had been completely outdated. Second, for better or for worse, the new smartphones were all coming out with full web browsers, as everyone thought you needed to approximate the desktop browsing experience as closely as possible to make the web interesting to users. People are only now starting to see that this is wrong. Ironically, if Web Clipping were being introduced in 2007, it would be referred to as a "widget platform" and considered to be cutting edge "Mobile Web 2.0" stuff like what Nokia just announced. Which is to say that Palm was ahead of their time. A modernized Web Clipping platform could use an awful lot of IP (including patents, I expect) that Palm already owns and give credibility to the claim that they were going to deliver web experiences that are "unique to Palm." Obviously there is more to the web than just querying for information, but I do think that's the lion's share of of the mobile web experience that people want today. And they want it fast. Fast search, faster access to RSS, faster startup of streaming media, faster access to location-based services, all integrated into the system—aren't these "simple web experiences" what you look for most often on your mobile, as opposed to web surfing?

More analysis of Palm's Analyst Day statements before the weekend. For now, I'm pressing my luck and predicting that Palm's idea of a unique, fast, simple web experience will be a next-generation version of a technology they abandoned in 2004. Back to the future, baby!

Comments

David,

My partner and I were doing web clipping back in 1998. In those days there was a public domain initiative called GLOMOP and something called the Pythia server. Of course all this has now disappeared from the Internet.

As for optimizing content we modified mod_gzip (we're the authors) so it could do web clipping in real time along with gzip compression. We also built our own image optimization technology.

If you want to have a look at something much more sophisticated check out our web site http://www.5o9inc.com

We have a new technology called mod_lbs - it has the capability to do web clipping and more. We've also introduced an industry first - dynamic menus based on Who, What and Where you are. As the web site recognizes you we can dynamically alter the browser menu and personalize for you. As you can see from the screen shots it can do just about anything. When you navigate away from the site the menus switch back to the standard PIE browser menus.

What's really cool is that this scales to any browser on any platform. It's totally client server with updated compression and encryption capabilities for even faster delivery with more security for the consumer.

BTW the GPS enable local search option is live and working. We use the HTTP protocol to deliver the GPS signal from the device to the server. Unlike stand alone apps we integrated it into the browser.

All the best,

Peter

Posted by Peter at Wednesday, April 18, 2007 22:04:33

It will be especially interesting if Palm publishes a combined Palm OS/Web API so that 3rd parties can make apps in this web clipping system without having to enter into direct partnerships with Palm or a carrier. But who knows if they will....
--Jennifer

Posted by jhodgdon at Thursday, April 19, 2007 08:42:04

Peter,
Interesting stuff! Thanks for the link and info. It's always nice to know about new mobile software innovation taking place along the Front Range. There's quite a bit happening right now!

---

Jennifer,
If I were Palm this is exactly what I would be thinking. Palm's developer ecosystem and huge catalog of applications were built at a time when all you needed to get your software to your customers was a web site. Treo users can still install any software they want on their devices, but as more and more smartphones run on their networks the carriers are starting to worry about native applications and they are clamping down. I had one carrier back away from a deal just last week that would have involved thousands of new accounts for them. The stated reason was that Pikesoft would be installing custom 3rd party software on the handsets for our customer, which carriers fear could create costly support problems. Before our customer could deploy our app and buy the Treos the software would have to go through Palm certification, then carrier testing, and even then they couldn't promise that they would give a price break on 5000+ Treos. Apps on many other platforms already have to be certified and digitally signed if they want the user to have nag-free access to resources like the wireless network or location information (and then recertified any time the developer rolls out an update).

The exception to this control-freakery is web applications, which have only well-tested in-ROM code between them and the metal. If Palm can develop a user-friendly AND carrier-friendly way for web developers and users to get to each other without the carriers having to get in the middle this will be very hopeful for 3rd party software innovation on the new Palm OS.

Posted by cervezas at Thursday, April 19, 2007 09:23:35

wow! This is an interesting post. I hadn't heard about "Web Clipping" before.

I'm wondering though, why compile HTML into the handheld at all?

Compiling HTML into the device and executing the HTML would be similar to creating an app in say, JAVA or other languages correct?

I mean its not that *real* webpage elements (when called from the browser) are dynamically converted to their compiled HTML counterparts straight from the device.

Posted by andrew007 at Thursday, April 19, 2007 11:11:20

andrew007 wrote:
"why compile HTML into the handheld at all?"

It cuts the network usage and parsing/rendering hit in half. Take the traffic report example. In the browser you first must request from the server the page where you enter the query (your driving route). The response includes the HTML form and any graphics and layout for the page, which after being downloaded to the device must be parsed and rendered before the user can even begin to enter the highway they want traffic info for. A traffic report web clipping would have the graphics and form already on the device, compiled into a form that doesn't require parsing or complex HTML rendering logic. You see the page instantly the moment you tap on the Traffic icon in the launcher. Only when you submit the query do you hit the network and have to parse and render the response.

The old Web Clipping system allowed limited integration between the data on the device and your PQA. You could write native applications that could access this data and sublaunch a PQA, but you're out of the realm of web developer skills now. A new version of Web Clipping might allow some simple client-side scripting that would let you read and write to preferences or database records, so you can combine local storage and remote web services. It could be quite powerful and really open up some new experiences for users.

Posted by cervezas at Thursday, April 19, 2007 11:48:57

Bah! Just implement a good device, stack, and rich capable browser like the iPhone it appears will and Nokia's Linux 'thingy' already does (jsut add mobile and VOIP capability) and the whole web is your oyster. My advice to Palm: stop thinking in vendor- and platform-lock-in customized hacks that de-feature the web and keep it in a walled garden for carriers. Between the Nokia Linux handheld and the iPhone, Palm is in serious trouble if they don't move their thinking out of the 90s.

Posted by digginestdogg at Monday, April 30, 2007 15:48:56

Add Comment

Comments must be approved before being published. Thank you!