What If Lion and iOS “Really” Hooked Up?

As Steve walked out on stage to face the crowd in the most recent Apple event, I was quite excited to hear what he had to say. I had no idea what to expect from Lion and didn’t want to even venture too many guesses so that there would be more awe than disappointment at the new features.

However, as Jobs began to discuss the premise of Lion, the gears in my head started to spin. He explained that Apple had learned quite a bit about both hardware and software while developing their line of iOS devices. Several new technologies had arisen that were so amazingly successful that they couldn’t wait to bring them “back to the Mac.”


Back To The Mac

No Multi-Touch Mac This Time

Obviously, at this point everyone watching nearly gnawed off their own fingers waiting for Jobs to pull out a multi-touch Mac. Unfortunately, at several points throughout the day Apple employees made it a point to say that their touch-screen laptop prototypes simply weren’t working due to arm fatigue. In my opinion, the fact that multi-touch surfaces “want to be horizontal” as Jobs said, still leaves plenty of room for the swiveling iMac patent we’ve seen before, but I digress.

The point became clear: to incorporate technologies and lessons learned from the iPhone and iPad back into the current age-old Mac format. David Appleyard thoroughly outlined these new features in a follow-up article on Mac.AppStorm: more gestures via Magic Mouse/Trackpad, a home screen app launching system (Launchpad) and full-screen apps.


How would you interpret this image?

These are definitely great ideas and I can’t wait to see them incorporated into OS X. However, as I stared at that chart depicting technologies flowing from the iPad back to the Mac, I pictured the marriage of OS X and iOS to be much more complete. I looked over at my iPad and wondered what OS X would be like if this were one of my main input devices. What if some Mac applications and even OS X itself contained iOS counterparts that weren’t separate apps which occasionally synced, but were actually another aspect or view of the same app? Think Nintendo DS meets OS X.

How It Should Work

To see what I mean by all this abstract talk, let’s imagine a typical day in my futuristic iOS dream. You sit down in front of your iMac (the same non-multi-touch version you have now) and you launch Mail. A coworker has asked that you send him the latest draft of the project you’re working on. You keep the Mail window up on your Mac and launch a new Finder window on your iPad. It’s not a VNC-powered second monitor trick but an actual custom iPad remote interface to the Finder on your Mac. You find the file you want and swipe-toss it over to your iMac screen where it pops up in your Mail message.


Wouldn't it be great if your iPad were an adaptive input device?

Next, you tap the Safari shortcut on your Lion-iOS hybrid app and up comes Safari on your iMac. You scroll through Twitter for a while, command-clicking on several links to open them in different tabs in the background. You look down at your iPad where you now see a visual preview of all the tabs open in the background on your Mac. You swipe around and select one that looks interesting and your iMac brings it to the front.

Finally, you hop over to Adobe Photoshop to finish that website mockup. Your iPad then becomes a context-sensitive menu of options that has been ingenuously built to improve your productivity. At first it shows a big beautiful toolbar and a redesigned layers palette, both of which are much easier to use on a dedicated screen. As you grab a brush on your iMac and start painting, your iPad screen shifts to display all of the features normally found in the brushes palette, now reworked to be finger friendly.


My imaginary iPad Mac setup in Photoshop

The point that I’m trying to make is that there is a ton of untapped potential for using the iPhone and iPad as an input device that feels decades beyond even the Magic Mouse and Magic Trackpad. The infrastructure is already in place for the system to work just fine for anyone using a plain old mouse, Apple would merely be rewarding users who purchased iOS devices with some added bonuses.

Obviously, this would not merely fall into the realm of Apple. Third party developers would also have to get on board. It wouldn’t be ideal to constantly switch iPad apps so I picture one central remote app that supports downloadable third-party plugins.

Will This Ever Exist!?

Unfortunately, this is all a dream, though it could be a leaping off point for any developers that don’t want to wait for Apple to come up with a similar system.

Currently, HippoRemote Pro and Remote Buddy Ajax Remote are about as close as you can get. Both of these apps bring a lot of innovation to the table for controlling your Mac from an iOS device. Neither quite hits on the idea of rich, fully adaptive interfaces (most of the time they’re basically customized trackpads) but they’re a good glimpse into what it would be like to use your iOS devices in a way that actually integrates with your Mac workflow.

Leave a comment below and tell us about your ultimate vision of OS X Lion integrating with iOS. What great features would you take from the iPad or iPhone and incorporate them into OS X?

  • http://www.Twitter.com/tylorskory Tylor Skory

    This was actually my thought when the iPad first came out. The closest I have gotten to it is using an the app “Air Display”. It basically turns the iPad into an external screen and I drag on my Photoshop brushes, work timers, notes, etc. over to it.

    It works alright. My only beef is that every time I use it, it always comes disconnected at some point and I don’t feel like re-syncing it and dragging everything over again.

    I really hope that things start to move in the direction you mentioned, with a more intuitive and out of the box solution for not only moving seamlessly between devices, but also using all the existing devices together as part of our daily work-flows.

  • http://www.constantinpotorac.com Constantin Potorac

    This is an amazing idea and I must say I would love to have that.

    For the moment I purchased my iPad so that it would be easier for me to test ipad designs that I make and feel them while designing them but with this idea you are giving away here I must say it would make my iPad more then just a testing machine.

  • http://jackgriffiths.tumblr.com Jack Griffiths

    I have to say I disagree. Wouldn’t that be too complicated? I think current VNCs are good enough, and for the majority of people, this isn’t necessary. I don’t think it’ll happen.

    “Chucking things over” to an iMac wouldn’t be that good, it might be too sensitive and may require a bit of effort (but saying that, very little effort, but some user frustration) to do. I say keep iOS and Mac OS two separate products, sure, exchange some UI elements but not input (e.g. touch, keyboard/mouse etc…) methods.

    Also, iMacs are too big of a screen to have for a touch interface, there’s some elements that are too small for a finger to tap on, which would create bad UX. This would mean a complete overhaul in user interface, and by the looks of 10.7, Apple won’t be changing that any time soon.

    Also, imagine sitting at a desk with your iMac tilted, understandable for a MacBook, but anything larger would be impractical and just plain weird.

    Bending the screen down to switch between touch and keyboard/mouse peripherals would also take time to do, and with other Apple products, they don’t

    I agree entirely that touch isn’t the way forward for desktops.

  • Pingback: What If Lion and iOS “Really” Hooked Up? | appsfever.com()

  • http://www.ragusmedia.com/onair Mark Richardson

    I can’t wait for when all our devices are intelligently aware of each other and can all access our data from anywhere. I can’t believe how hard it still is to setup a network printer or move files from one computer to the next.

  • John

    Ever since i got my iPad ive been waiting for a app that syncs with my desktop experience. I have my iPad in a stand next to my display but there is no real use for it. I often run clock apps or magic window just to have something on there :).
    A osx app that adjusts to what im working on is a must for iPad.

    I still wait for a photoshop app for iOS. Not the existing photo editing app, but a remote for when you working on your computer.
    I would love the function to save color palettes you are working with, keep a library on your ipad with your custom made palettes (colourlovers.com style). Very useful if you have a bad display on your computer and want to work with colors on a better display. Just tap the color on your iPad and it gets selected as your foreground color in PS. And everything else from photoshop like brushes library like in your example above.

    Then when you are finish with your image you click a button in Photoshop (or on your iPad) and the image is saved in a library on your iPad allowing you to always have everything you are working on with you to show or to continue with on another computer.

    But.. adobe is not the company you expect this clever solutions from. Not because they cant, but because its not important enough for them.

  • Frank

    Does anyone know whether iPhone apps will be opened on the Lion? I have Games, Tools which I love to use on my iMac.

  • David Sharpe
  • http://life2chat.com/forum/member.php?action=profile&uid=754 fotografia blog

    I enjoy, cause I found just what I used to be looking for.
    You’ve ended my 4 day lengthy hunt! God Bless you man. Have a great day. Bye