University Web Developers

University Web Developers

We are in the initial stages of project planning for a web CMS implementation in FY2014.  As we begin to develop our project planning documentation, we are somewhat struggling to come up with meaningful, measurable metrics for determining success of our project.  So far, we are considering measuring: 1) the percentage of trained content managers that are "actively" using the system once implemented, and 2) the percentage of trained content managers who are "satisfied" or "very satisfied" with the usability and functionality of the CMS, based on their responses to an online survey.

Can anyone else share some metrics they have used to measure the success of a CMS implementation?

Thanks for your help~

Chris

Tags: CMS, management, metrics, project

Views: 608

Reply to This

Replies to This Discussion

Hi Chris,

I have some questions to consider when determining the best way to measure success of a new cms. I'll send you an email that may help.

Annette

Thanks, Annette!

Hi Annette -- any chance you could share a version of your questions here? It might be very helpful to those of us contemplating CMS changes and upgrades. Thanks!

Hi Daniel,

The measurement of success is based on the reason for the change of CMS in the first place. Is the CMS upgrade part of an overall redesign and updated information architecture? Or is it a stand alone project? Are you moving from having no CMS into one? Are you moving from one certain CMS to another due to contributor difficulties, development standstill or poor service?

Basically, it depends on what you are looking to measure and what your definition of success is being based on.  Also, you can compare the site/page updates before and after CMS implementation.

We get hired as a consultant many times to help zero in on all the pain points within and organization, analyze data, conduct user ability audits, and consolidate a schools goals which we then recommend a CMS that is best suited for their needs.   Since we have an extensive history of experience in higher ed our insight and contribution is quite valuable. It allows for our clients various departments to be heard and considered before making such a major decision.

Hope that helps! 

As Annette said, it depends on why you're doing it. What are the problems that need to be solved, and what are the outcomes that can be measured? I'm planning to switch to a CMS from not having one this coming year, and most of our issues are around quality control. I'll be looking at things like broken links, misspellings, web writing quality and internal standards compliance, information accuracy, etc., as well as bottom line metrics like conversions.

We are also transforming our web this year with new visual design system and CMS.  We should definitely all collaborate on drivers, best-practice, planning, and execution.

Our program has three high level objectives:

  • Provide an unparalleled authoring and publishing experience
    • Give author more powerful and easier to use tools
    • Remove IT from all publishing tasks
    • Remove on technology knowledge requirement from the authoring process
    • Measures: volume of new content and updated content, IT ticket rates, 
  • Deliver leading edge user experiences
    • Improve "findability" of content
    • Improve UX tailored to persona type
    • Be exceptional across multidevices
    • Measure: visitors, pageview, time on page, bounce rates, mobility satisfaction,content reuse,etc
  • Build a strong web builder community
    • Train users on UX, usability, content strategy, etc
    • Audit and support better content and UX
    • Measures: active users, training volume, self-support rates, seminar attendance,

I've done both. With positive results. And you can adjust according to feedback. 

How are you defining "actively using" the system? 

What constitutes a  "trained" content manager? And of course, what determines "satisfaction?"

Have you thought about it from an output perspective? How many web pages effectively published/maintained? 

Thanks to all for your responses.  

George-

"Actively using" the system means: that content manager's pages are being maintained/updated (evidenced by no outdated content) and they aren't coming to IT for those updates.

A "trained" content manager means they've gone through whatever training we and/or the vendor has provided them and they are "actively using" the system as defined above.

"Satisfaction" is measured via a post-implementation online survey of the content managers.  The question(s) will provide a 5 point range of responses, from "very dissatisfied" to "very satisfied".

We hadn't necessarily thought about it from an output perspective, not knowing a good way to measure/quantify that.  I struggle with the true worth or value of an absolute number like "web pages effectively published/maintained".  Couldn't you have a high number for that and still have users really unsatisfied with the process/system for getting their pages updated?

The amount of post-training assistance hours that are needed with content managers may be a helpful metric to track as well. You can (perhaps) learn something about both user "activity" and success of the training component.

Number of page revisions and length of days in approval processes may be good metrics to look at quarter over quarter, or whatever interval makes sense for you- In other words, as we progress, did we see the former increase and the latter decrease? etc.  I think those might help you make statements about the relevance and up-to-date-ness of your content.

What are the overall goals of the project, aside from implementation. Why bring a new CMS on board ? Was it to make content upkeep more effective? To address back end issues? Look to tie metrics to those higher goals as well.

While it's generally not the primary justification for implementing a new web CMS, it's almost inevitable that doing so will lead to changes in your consumer-facing web design regardless of what your current site architecture may be. That being that case, it's also helpful to include that perspective in your project objectives. What can you achieve along those lines in the CMS implementation process including such objectives as migration to responsive design, abandonment of outdated content, integration of social media, or improvement of site architecture and usability? An entire set of metrics surrounding the consumption side of the system may be appropriate.

Ultimately, you certainly should review contributor metrics as well, which will be heavily influenced by the culture of the organization. Those include such characteristics as the autonomy of contributors, their comfort level with web editing tools, and the organization's business model and resultant workflows. Ultimately, you'll be able to measure the success from the contribution side by how active your users are on the new system, their comfort level with it, and the consistency of the subsequent content based on the design, style, and workflow parameters you develop.

RSS

Elsewhere

Latest Activity

Dan Bashaw left a comment for Julie Fradette
"Hi Julie, I use a plugin (https://wordpress.org/plugins/page-links-to/) to set up simple page redirects. Using it at our root site to link to a deep page or an external page gives a 'short-ish' URL. brescia.uwo.ca/give/ is an example that…"
5 hours ago
Julie Fradette left a comment for Dan Bashaw
"Me neither :-) But when I tried to send you a message, it notified me that I could only message you if we're friends. I was curious about your experience with Wordpress as a CMS for your University website? We're a small University as well…"
5 hours ago
Dan Bashaw replied to Dan Bashaw's discussion Migration to WordPress
"Hi Julie, My experience has been very positive. We are now running several WordPress multisites, and if I could encapsulate the results it would be: Much improved editing experience for departmental users compared to other CMS. Much reduced…"
5 hours ago
Julie Fradette replied to Dan Bashaw's discussion Migration to WordPress
"Cara, your links have been extremely useful. We're seriously considering migrating to Wordpress over the summer. We've used TYPO3 since 2009, which is another open-source CMS. I appreciate all the comments posted so far, but I wonder what…"
6 hours ago
Dan Bashaw left a comment for Julie Fradette
"Hi Julie -- I had no idea we could friend people here! :)"
7 hours ago
Mark Mazelin replied to Mark Mazelin's discussion Website Translation Services
"Thanks Dan--this is helpful. As we evaluate options, I'll let you know if we'd like to pursue the SocialChine route. --Mark"
yesterday
Dan Bashaw replied to Mark Mazelin's discussion Website Translation Services
"Given a relatively small volume of pages, it is probably best to handle this manually, ensuring that your workflow triggers a translation when the English version of the page changes. With this approach you can use either local translators, or…"
yesterday
Profile IconBen L., John Nathan Parker and Jeffrey Green joined University Web Developers
Friday
Mark Mazelin posted a discussion

Website Translation Services

I've been tasked with getting some of our website translated into Spanish and Chinese. We had some pages translated into Spanish several years ago, but since multi-lingual was not part of our workflow, the content on those pages quickly became out-of-date and were just recently removed from the site.Do any of you have pages translated to other languages? Do you use a 3rd-party service to do it, or someone on campus with those skills? Or an automated service like Google translate?For those of…See More
Friday
Michelle L. Monti replied to Michelle L. Monti's discussion Questioning the Value of College Holiday Videos
"Thanks for responding, Erik! I agree and like your point about it being a different kind of piece without a call to action. Those projects have their place, but is sometimes hard to justify carving out the time for them."
Friday
Erik Hagen replied to Michelle L. Monti's discussion Questioning the Value of College Holiday Videos
"We did one in 2012 and 2013, but not 2014. We initially got caught up in the buzz because everyone was doing them, and it seemed like a fun idea. But this last cycle we were so busy with other projects we couldn't justify carving out the time.…"
Friday
Erik Hagen posted a discussion

Dynamically adding text to a PDF

We're looking for a service or tool that will let employees create their own business card and have a press-ready PDF sent to our print shop. Ideally the employee would type in their info into a form, and that text would be dropped into a predefined PDF template. I know this falls under the "web to print" industry, but I haven't found any workable services yet. Thanks!See More
Friday
Erin Leavitt commented on Lynn Zawie's group OmniUpdate
"Otero Junior College has gone live with their new responsive website. Design by our partner Donoughe Design. Great work!! www.ojc.edu "
Feb 25
Nursalim Hadi posted a discussion

Web Developer - College of Business - University of Illinois at Urbana-Champaign

WEB DEVELOPER Information Technology College of Business University of Illinois at Urbana-ChampaignSearch ExtendedThe College of Business seeks a Web Developer responsible for the College's web design. The primary focus for this full-time, non-tenured academic professional position will be to leverage available web technologies and services (including a Web CMS), extensive technical skill, and strong independent judgment and decision making skills to architect and implement web sites that…See More
Feb 25
Nursalim Hadi is now a member of University Web Developers
Feb 24
Amber Klaus is now a member of University Web Developers
Feb 21
Erin Leavitt commented on Lynn Zawie's group OmniUpdate
"Looking forward to working with our newest customer Merced College. Welcome to the OmniUpdate family!"
Feb 20
Kevin Hanselman posted a discussion

Webmaster at The Sage Colleges

The Webmaster manages and maintains all aspects of The Sage Colleges’ website, www.sage.edu, as well as Sage’s online presence and e-communications, in order to provide a successful online interaction for our audiences with Sage and to support key enrollment and advancement goals. This full-time administrative position reports to the Senior Director of…See More
Feb 20
Erin Leavitt commented on Lynn Zawie's group OmniUpdate
"East Los Angeles College has a new responsive website. Looks great! www.elac.edu "
Feb 19
Erin Leavitt commented on Lynn Zawie's group OmniUpdate
"Everybody's favorite OU Campus trainer gives some great tips on building your own training program in today's blog post. Check it out! "
Feb 18

UWEBD has been in existence for more than 10 years and is the very best email discussion list on the Internet, in any industry, on any topic

About

© 2015   Created by Mark Greenfield.

Badges  |  Report an Issue  |  Terms of Service