Going from measuring online success to measuring significance
Posted: June 3rd, 2012 | Author: Jasper Visser | Filed under: Technology | Tags: evaluation, google analytics, metrics, mission, significance, success, thoughts | 6 Comments »Tweet

Photo by Allison on Flickr.
I recently realised that we, cultural institutions, are using the wrong metrics to measure our online success, because we’re measuring just that: generic success. We’re using statistics and software that is perfectly fine when you’re selling Cokes, but might not be ideal for culture, heritage and the arts.
In the real world we know our success cannot easily be measured in hard figures. Visitors numbers and shop turnover are important KPIs, especially as our funding and financial well-being often depends on it. Yet, these quantitative measures of success are hardly ever part of our mission. Instead we consider ourselves successful when we change behaviour, increase knowledge, spark imagination… Evaluators use complex toolkits and checklists to see if an exhibition had the right impact, an event the expected outcome. In the real world, we are successful if we are significant.
Not online. In almost all project presentations I’ve seen in the past year, success is measured in hits, comments and likes. Sometimes more advanced metrics are used that hint participation, enthusiasm, loyalty. Once or twice I’ve heard people refer to quality of service (search queries resolved). Success, online, is a number.
If online is a full part of your institution, online success is significance as well. Read the rest of this entry »



