6 Metrics for Managing UI Design
August 18th, 2008 by Russell WilsonAs part of a recent management summit at my company, we were asked to fill out an RMPT matrix for our departments (I head up Product Design). An RMPT matrix consists of (R)esponsibilities, (M)etrics, (P)rocesses, and (T)ools. I have been intending to develop better metrics for both measuring and guiding our design efforts, and this exercise served as a catalyst to get me started. Bear in mind that metrics help you focus your efforts and measure your progress, but you are also held accountable to them.
For (R)esponsibilities I specified the following:
1) Improve our products & innovate
2) Provide the UI design for new features/functions/products
3) Approve any UI design work done outside of Product Design
4) Validate our UI designs and explore user needs through user testing
Given those responsibilities (and that’s important because your metrics are linked to them) I then came up with the following metrics and met with my team who helped to refine them:
For a given period (e.g. a business quarter):
1) Number of layouts delivered
2) Number of interactive prototypes created
3) Percentage of product design requests completed by commit date
4) Number of users tested
5) Number of product improvements made
6) Number of products insights documented
Discussion:
1) We struggled with what to call this and how to word it specifically. We started with “Number of designs delivered”, moved to “Number of screens delivered” and settled on “Number of layouts delivered.” We chose layouts because designs seemed a little too broad and didn’t really give any indication of what we would actually be delivering.
2) We prototype when feasible and want to both push this effort as well as measure it. Again we struggled with the wording (i.e. “prototypes” vs. “designs”, etc.). We wanted to make it clear that we are measuring the number of interactive, non-static prototypes.
3) We recently implemented a Product Design Request System where we track the growing volume of design requests and deliverables to development and product management. We are holding ourselves accountable to deliver on these requests by our committed due date.
4) We test designs on users as much as possible and want to both measure this and push ourselves to do this as much as possible.
5) Here’s where it gets a little interesting. This one is admittedly qualitative and may need further refinement. With that said, it is easy for us to remain reactive and work day to day by responding to requests from product management and development without ever taking the initiative to improve our products by combining our research with our unique expertise in usability and design. This metric is meant to drive us to be proactive and take initiative to improve our products and to track those improvements over time to further illustrate our value. To make this metric more objective I plan to tie in efficiency measurements and satisfaction scores (SUS).
6) With our considerable user “face time” we are in a unique position to collect “insights” into product shortcomings, needs, and opportunities. We often take copious notes when doing user studies only to leave the notes sleeping silently in our Moleskines. We meet regularly with SME’s (subject matter experts), developers, users, and various other stakeholders. This metric is intended to remind us to document, publish, and take action on the “insights” that we collect.
My reason for publishing these metrics is to get feedback and to learn what metrics other designers work with. Let me know if you think an important metric is missing or if you disagree with these metrics and why.




