Wednesday, March 28, 2018

Key Notes: Apple’s Field Trip event

As if you didn’t hear already, Apple announced a bunch of stuff today focused on education. With an upgraded iPad and new software, Apple presents its renewed plans for tech in the classroom.

An important distinction to make is that the new iPad is not a ‘School Edition’ iPad, if you will. There may very well never be a specific edition aimed at schools until if and when adoption rates spike along with radical education changes. Today’s event is framed as educational, but when it comes to iPad itself, the truth is that it will also be bought by millions of regular people and non-educational organizations. This product still has to be universal. It’s an iPad for the masses that also has benefits for schools, one of which is a price reduction.

Now, the new software on the other hand … that’s where the education piece really comes into play.

Read on

Tuesday, October 17, 2017

The developers of Astropad made a button out of the iPad’s camera →

Astro HQ, makers of the popular Astropad app which allows you to use your iPad as a secondary (tethered) monitor for your Mac, have announced a very interesting feature for their new Luna Display product 1 called the ‘Camera Button’. They have essentially turned the iPad’s front-facing camera into a button for triggering the Luna app’s UI.

Savannah Reising for Astro HQ:

Our problem started three years ago when we were working on our first product, Astropad. With Astropad mirroring your Mac screen on your iPad, you end up getting a unique UI overlap. First, there’s Mac UI showing up on your iPad, coming from whatever Mac program you’re using, such as Photoshop or Sketch. On top of that, there’s the native iPad UI. So if we wanted to add our own Astropad UI, where would it go? We didn’t want to create a crazy matrix of conflicting UI, so we looked for a way to minimize it.

On the first solution:

Our first solution for this tangled UI was the Astropad “ring.” It’s a little movable ring that always appears on your iPad screen when you’re working in Astropad. Tap on it once brings up a sidebar with shortcuts and settings. Tap on it again and it disappears. But could we minimize our UI real estate even more? As handy as this little ring was, it still gets in the way.

On creating the button:

Our Astro HQ cofounder Giovanni Donelli said that the idea to turn the camera into a button came like lightning, “I had been staring at a white bezel iPad for so long, and I kept wishing there was another home button we could use. My eyes kept falling on the camera, and I really wanted to touch it!” Giovanni built an initial prototype of the Camera Button within an hour.

Quite ingenious.

Savannah goes on to point out a couple of the the obvious concerns that come from having an always-on camera. First, according to their analysis, “the Camera Button requires less than 1% CPU to run”, and is therefore energy efficient. Second, she goes on to say they have designed the app so that the camera only detects light coming in — all other data is blurred and never leaves the iPad itself.

This is a bold move. When developers have done things like this in the past, Apple has sometimes rejected their ingenuity. I’m not sure if Apple has exact guidelines against this interaction, but we’ll see if the feature gets to stay. After all, the privacy concerns are real, especially if implemented by not-so-honest developers. If it’s allowed, I can see the ‘Camera Button’ being replicated in short order by other apps.

  1. Whereas Astropad requires a cable, Luna Display is a hardware solution that plugs into your Mac and pairs with your iPad wirelessly to function as a secondary monitor. 

Tuesday, October 10, 2017

Kuo predicts TrueDepth Camera and Face ID for 2018 iPads →

Ming-Chi Kuo:

We predict iOS devices to be equipped with TrueDepth Camera in 2018F will include iPhone X and 2018 new iPhone and iPad models. Because of this, we believe more developers will pay attention to TrueDepth Camera/ facial recognition related applications. We expect Apple’s (US) major promotion of facial recognition related applications will encourage the Android camp to also dedicate more resources to developing hardware and facial recognition applications.

TrueDepth and Face ID will obviously make it into iPad (and Mac), but it’s a question of when. Unless Apple can overcome the low yields on the 3D sensor they are currently experiencing, I think Kuo’s expectation may be a bit of a stretch for next year. Even more so if the iPhone 9 (?) is also going to be upgraded to TrueDepth.

Next year is going to be even more interesting than this one, if only to see where Apple will take these brand new technologies next.

Tuesday, September 19, 2017

iOS 11 Review: Most Meaningful Features


iOS 11 is out today, beginning at 10AM Pacific. I’ve been using it exclusively on my iPhone 7 Plus and iPad Pro 10.5-inch since the developer beta was released back in June. I have to say, this is probably the most jam-packed iOS release Apple has ever published. There are so many features, but I’m going to give you my thoughts on the ones I believe are most meaningful and important after using them day in and day out.

Read on

Sunday, September 17, 2017

The Father Of Mobile Computing (Alan Kay) Is Not Impressed →

In a long interview with Brian Merchant (author of ‘The One Device’), Alan Kay discussed his detailed views on computing. Specifically, Kay outlines how our amazing computers are usually deduced to consumption devices due to lack of education.

This is a fantastic insight into Alan Kay’s thought process and computing vision. Although I don’t agree with everything he says, he makes a lot of striking points.

Some backing on Kay:

Kay is one of the forefathers of personal computing; he’s what you can safely call a living legend. He directed a research team at the legendary Xerox PARC, where he led the development of the influential programming language SmallTalk, which foreshadowed the first graphical user interfaces, and the Xerox Alto, a forerunner of the personal computer that predated 1984’s Apple Macintosh by 11 years (only 2,000 of the $70,000 devices were produced). Kay was one of the earliest advocates, back in the days of hulking gray mainframes, for using the computer as a dynamic instrument of learning and creativity. It took imagination like his to drive the computer into the public’s hands.

Kay describing the Dynabook (one of the article’s main focuses) in his own words:

“Imagine having your own self-contained knowledge manipulator,” they implored—note the language, and the emphasis on knowledge. “Suppose it had enough power to outrace your senses of sight and hearing, enough capacity to store for later retrieval thousands of page-equivalents of reference materials, poems, letters, recipes, records, drawings, animations, musical scores, waveforms, dynamic simulations, and anything else you would like to remember and change.”

Sounds like the iPad, right? As Brian points out here, though, the key word is knowledge as a central point. Instead of being an open book to venture off, Kay essentially thinks tablets should be primarily utilitarian and productivity-driven.

Kay on the original iPhone:

When I first got to Apple, which was in ’84, the Mac was already out and Newsweek contacted me and asked me what I thought of the Mac. I said, “Well, the Mac is the first personal computer good enough to be criticized.”

So, after Steve [announced] the iPhone [in 2007], he brought it up to me and handed it to me. He said, “Alan, is this good enough to be criticized?” And I said, “Steve, make it this size [as big as a tablet] and you’ll rule the world.” Now, that has been misunderstood, because I didn’t know what they were doing. But as a scientist-engineer, I would’ve bet a thousand dollars–and I would’ve won–that there was already an iPad.

Quite an accurate prediction by Kay. We know without a doubt that Apple was already working on the technology in tablet form before the iPhone.

Kay on computing comprehension:

If people could understand what computing was about, the iPhone would not be a bad thing. But because people don’t understand what computing is about, they think they have it in the iPhone, and that illusion is as bad as the illusion that Guitar Hero is the same as a real guitar. That’s the simple long and the short of it.

This is the problem with television. Television is 24 hours a day and it seems like an entire world. It is a kind of a world, but it’s such a subset. And it’s so in-your-face that it essentially puts you into a dumb world. It’s got stuff going on all the time and almost none of it is of a

This right here is an incredibly tall order. Kay essentially says the iPad is viewed to the masses as a television, which I would mostly agree with. However, as he will go on to describe in detail later, the problem is education.

Kay on the original iPad and lack of dedicated stylus holder:

First thing I did was to test how good the actual touch sensor was. I had to go out and get a capacitive pen, because one didn’t come with the iPad. You’re supposed to use your finger on it. There were five things that you could draw with on it and only one of them was good. And with that [Autodesk] pen, I was able to draw, take a ruler and draw lines with this thing, and see how linear it came out on the display, and the thing was a lot better than it needed to be. You’re kind of drawing with a crayon, but they actually did a hell of a good job on it.

No place to put the pen though.

So, I talked to Steve on the phone [about adding a standard pen and penholder]. I said, “Look Steve. You know, you’ve made something that is perfect for 2-year-olds and perfect for 92-year-olds. But everybody in-between learns to use tools.”

And he says, “Well, people lose their pens.”
And I said, “Well, have a place to put it.”

Kay really wants a defined place to store his stylus. Here’s my philosophy: unless you’re using a folio of some sort, traditional paper notebooks don’t come with a defined pen holder, so why should the iPad? That said, most pens have caps, so you could just clip it to the notebook — something the iPad and Apple Pencil can’t do, of course — point notebook. Technically, the Apple Pencil can be held by the iPad’s internal magnets for the Smart Cover, but it’s a side effect not to be trusted versus an actual feature.

For the latest iPad Pro models, Apple has made an optional leather sleeve with a Pencil holder at the top. It looks great, but also costs $129 (10.5-inch) or $149 (12.9-inch). Plus, most people seem to prefer actual cases over sleeves. There are 3rd-party options, but they typically add bulk, and Kay wants something built in.

As for me, I really don’t see it as a big deal. I carry my Apple Pencil in the quick-access slot of my bag 1, so it’s usually just a few seconds away when I need it. I don’t see Apple solving Kay’s problem anytime soon, as they clearly view the Pencil as an ancillary device only to be used (and purchased) by those who truly need it. Otherwise, it would come with the iPad.

I think a better case could be made for including the Smart Keyboard with the iPad if it weren’t for the cost increase. People use keyboards way more the styluses. 2

Alright, back to Kay, now on human universals…


Years ago, this anthropologist Donald Brown wrote a book called Human Universals. This was just gathering up what generations of anthropologists had gleaned from studying thousands of traditional societies.

They first looked at traditional societies for differences, and found they’re all very different in detail but they’re all very similar in category. They couldn’t find a society that didn’t have a language, that didn’t have stories, didn’t have kinship, didn’t have revenge. They couldn’t find a society that did have equal rights. So, the things that were common to every society without fail, they started calling human universals. Most of them are probably genetic.

Suppose you want to make a lot of money. Well, just take the top 20 human universals and build a technological amplifier for them—like communication.

He goes on to reference the creation of the telephone as an example. The brilliance of this really resonates with me. Throughout history, we have continually improved communication, which I view as the most important human essential.

Kay on education in the 21st century — essentially what we need to do to increase people’s understanding of computing:

Brian: Do you think most people care about this stuff?

Kay: They never have. You know, if you look at [educator Maria] Montessori’s first two books, both were really important. […] One of the things she said was, look, the problem is, the culture around most children, whether at home or in school, is like the 10th century, and we’re living in the 20th century. If you really want them to learn, if you want them all to learn, it can’t be like choosing a musical instrument because you’re interested in it. Everybody learns their culture, because it’s in the form of a culture, and that trumps any particular interest we have. This is what [Marshall] McLuhan was talking about too. That’s a big deal. It’s a difference between taking a class in something and living in something. So if you want to fix this, you gotta fix the schools, and get the kids to grow up in the 21st century, rather than being in a technological version of the 11th century.

This really hits the nail on the head. A good example I can think of for grade school is handwriting. Who the hell needs handwriting anymore? Not to mention, through high school, everything is still largely taught from paper books or in the textbook format. Why don’t we have computers in every grade starting with kindergarten and new, immersive ways to teach?

I remember we had a computer lab in grade school. Though some of the teachings consisted of word processing, most of it was garbage educational games. I was fortunate enough to go to a technical high school and study Computer Science, but the other classes were still as old-school as ever.

Kay on the lack of teaching our devices do, an example being iPhone’s “Shake to Undo” feature:

So, in theory, you’re supposed to shake the iPhone and that means undo. Did you ever, did anybody ever tell you that? It’s not on the website. It turns out almost no app responds to a shake. And there’s no other provision. In fact, you can’t even find out how to use the iPhone on the iPhone. You ever notice that?

I agree with Kay here. Shake to Undo has always been an odd interaction method, with no indication the feature even exists (kind of similar to 3D Touch in certain respects). Apple really should re-think how to better implement Undo/Redo globally, because it really sucks. Maybe a two-finger counter-clockwise gesture for Undo and clockwise for Redo? I always feel like an idiot when I need to shake my phone to undo something.

Apple has always strived for intuition with their UI, but things like Shake to Undo and some of 3D Touch really stray from that path.

Kay thinks computers should better teach us how to use them:

Kay: It’s been an idea in the ARPA/PARC community—which hasn’t been funded since 1980 or so, but a lot of us are still alive—one of the ideas was that in personal computing, what you really need is some form of mentor that’s an integral part of the user interface.

Brian: Something like a digital assistant?

Kay: It’s something just like the GUI, which I had a lot to do with designing. I did that, more or less, as a somewhat disappointed reaction to realizing [AI] is just a hard problem. We had some of the best AI people in the whole world at PARC, but the computers were really small for what AI needs.

We’re getting closer to solving the AI hurdles thanks to things like machine learning, and Apple has been making a huge push for Siri to be at the forefront of all its products. Perhaps one day Siri itself will say something like “Welcome to iOS 11, let me give you a guided tour”, while proceeding to take you through the top new features natively on your phone, as opposed to just playing a video. Siri then ends with “Those are the biggest changes in iOS 11, but just ask if you want to learn more, or about something more specific”.

Optimism is key here. We’ll probably get to Kay’s vision one day, when people no longer view technology as something to be afraid of.

  1. Peak Design Messenger bag, if you were wondering. 
  2. Side note: I’m incredibly surprised by how much I love the Smart Keyboard. Everything I write for Gaddgict is written on it. 

Wednesday, June 7, 2017

Bullish on iPad

Photo Credit: Livin4wheel

Tim Cook, talking about iPad on the July 2015 earnings call:

I am still bullish on iPad…I think iPad upgrade cycle will eventually occur. We’re 6X greater in usage than nearest closest rival. It’s a fantastic product. I see a lot of runway.

iPad was introduced in 2010 by Steve Jobs as a growing market need for a post-Netbook device (remember those?). It was the first truly mainstream tablet, and came at a surprisingly low price (for Apple). During its introduction keynote, this below slide was poised to position the iPad between use cases for a laptop and a phone.

Read on