We implemented the first flow in a prototype, and ran a user test. From the research, we found out there were general themes that stood out:
Choosing 1 use case made people feel boxed in.
There was an ‘ah-ha’ moment when we first introduced the insert menu. Meaning that people saw the value in Evernote when we revealed this to them. Someone said, “I didn’t know Evernote offered this many options in their editor. It seems pretty powerful and unique. I don’t think I’ve seen other apps offer this.
Furthermore, it validated that the checklist was clear in form and function. The order needed to be re-arranged though, the value wasn’t immediately clear. There is value in being able to minimize and dismiss the checklist.
Users had a specific mental model of templates when we showed it at the beginning of the flow. They thought this was how you were supposed to start a note every time. Whether or not that is a good or bad thing is up for debate, but users kept trying to find the same micro template interaction again and expected it whenever they would create a new note.
We answered some questions through research, but other questions popped up from this research:
Should the editor tutorial be re-playable?
What do we do about the microtemplate mental model?
Should we add an extra question to narrow down personalization?
How do we make sure users understand the value from a checklist interaction, is there is a strong connection between onboarding and extended onboarding?
Although not part of the scope, the free trial interstitial at the beginning came up a lot during user research. Did we want to test more on this or save it for a future test?
Do we want to surface installing Evernote on other devices?
We had a ton of learnings from this experience, and made our best guess while the final designs. We worked with developers to ship this out the now, and I’m proud to say that the experiment is live and doing well. We plan on pushing this as the control experience.
Final conclusions:
Onboarding means working on that crucial moment of users making a decision: Is this is the right app for me? Is it doing what I want it to do? And even more…
During our time of designing this, our company was going through a large shift in changing clients. Lots of UI elements and pieces were still in flux. It was difficult keeping up with all of the changes that had to change again, as is the nature of tech.
This provided us a nice framework for future education around new features that will be released and allows us to experiment even more with user education.