I'm part of a task force for ISU Extension evaluating reporting systems and procedures. Specifically, how do we (ISU Extension) better communicate our value to our stakeholders. Simple in theory; you have a service, you define objectives for this service and you measure and report on your success in meeting these objectives. However, there are a few challenges.
- Defining measurable objectives.
- Collecting measurement data.
- Ensuring your objectives tell a compelling story.
In a separate meeting today with IT leaders across campus, I participated in another discussion on performance indicators, but for IT services. I want to share a few points which I found very helpful in the discussion.
The following three sets of indicators can help you in defining objectives for a specific service. These were summarized by Jim Davis, ISU CIO.
- Capacity. Can you meet the needs of your clients and scale the service as necessary or desired?
- Effectiveness and efficiency. How well do you provide the service?
- Value. How does it impact your clientele?
While I have thought about these indicators as "outputs and outcomes", you might consider what Chris McCoy (a colleague in Engineering) refers to as "looking in and looking out".
The first two sets most likely measure "outputs"; indicators which help you manage your service and plan for the future, "looking inward". The third set of indicators would more likely measure "outcomes"; indicators which help you understand the value of your service and tell a story, "looking outward".
We are pretty good at defining indicators in the first two sets (when we take the time). The third set (value) of indicators are more difficult, not only for IT, but for other service providers as well. Of course if you are fully cost recovery, then you could argue that value is measured by revenue. I believe this is a dangerous simplification that will lead to certain irrelavency in the future.
So, how do you measure value? I have to believe the value of a service is measured by how much it increases the value of those it serves. So, I measure the value of Extension IT by measuring how it increases the value of Extension. Interesting to me is the continuous nature of this question. How does the Extension measure its value? I would assume by increasing the value of its clientele. :)
It's an interesting discussion based mostly on experience, I probably need to visit some literature on this subject.
Image by vtengr4047 on flickr.