University Web Developers

University Web Developers

We are in the initial stages of project planning for a web CMS implementation in FY2014.  As we begin to develop our project planning documentation, we are somewhat struggling to come up with meaningful, measurable metrics for determining success of our project.  So far, we are considering measuring: 1) the percentage of trained content managers that are "actively" using the system once implemented, and 2) the percentage of trained content managers who are "satisfied" or "very satisfied" with the usability and functionality of the CMS, based on their responses to an online survey.

Can anyone else share some metrics they have used to measure the success of a CMS implementation?

Thanks for your help~

Chris

Views: 949

Reply to This

Replies to This Discussion

Hi Chris,

I have some questions to consider when determining the best way to measure success of a new cms. I'll send you an email that may help.

Annette

Thanks, Annette!

Hi Annette -- any chance you could share a version of your questions here? It might be very helpful to those of us contemplating CMS changes and upgrades. Thanks!

Hi Daniel,

The measurement of success is based on the reason for the change of CMS in the first place. Is the CMS upgrade part of an overall redesign and updated information architecture? Or is it a stand alone project? Are you moving from having no CMS into one? Are you moving from one certain CMS to another due to contributor difficulties, development standstill or poor service?

Basically, it depends on what you are looking to measure and what your definition of success is being based on.  Also, you can compare the site/page updates before and after CMS implementation.

We get hired as a consultant many times to help zero in on all the pain points within and organization, analyze data, conduct user ability audits, and consolidate a schools goals which we then recommend a CMS that is best suited for their needs.   Since we have an extensive history of experience in higher ed our insight and contribution is quite valuable. It allows for our clients various departments to be heard and considered before making such a major decision.

Hope that helps! 

As Annette said, it depends on why you're doing it. What are the problems that need to be solved, and what are the outcomes that can be measured? I'm planning to switch to a CMS from not having one this coming year, and most of our issues are around quality control. I'll be looking at things like broken links, misspellings, web writing quality and internal standards compliance, information accuracy, etc., as well as bottom line metrics like conversions.

We are also transforming our web this year with new visual design system and CMS.  We should definitely all collaborate on drivers, best-practice, planning, and execution.

Our program has three high level objectives:

  • Provide an unparalleled authoring and publishing experience
    • Give author more powerful and easier to use tools
    • Remove IT from all publishing tasks
    • Remove on technology knowledge requirement from the authoring process
    • Measures: volume of new content and updated content, IT ticket rates, 
  • Deliver leading edge user experiences
    • Improve "findability" of content
    • Improve UX tailored to persona type
    • Be exceptional across multidevices
    • Measure: visitors, pageview, time on page, bounce rates, mobility satisfaction,content reuse,etc
  • Build a strong web builder community
    • Train users on UX, usability, content strategy, etc
    • Audit and support better content and UX
    • Measures: active users, training volume, self-support rates, seminar attendance,

I've done both. With positive results. And you can adjust according to feedback. 

How are you defining "actively using" the system? 

What constitutes a  "trained" content manager? And of course, what determines "satisfaction?"

Have you thought about it from an output perspective? How many web pages effectively published/maintained? 

Thanks to all for your responses.  

George-

"Actively using" the system means: that content manager's pages are being maintained/updated (evidenced by no outdated content) and they aren't coming to IT for those updates.

A "trained" content manager means they've gone through whatever training we and/or the vendor has provided them and they are "actively using" the system as defined above.

"Satisfaction" is measured via a post-implementation online survey of the content managers.  The question(s) will provide a 5 point range of responses, from "very dissatisfied" to "very satisfied".

We hadn't necessarily thought about it from an output perspective, not knowing a good way to measure/quantify that.  I struggle with the true worth or value of an absolute number like "web pages effectively published/maintained".  Couldn't you have a high number for that and still have users really unsatisfied with the process/system for getting their pages updated?

The amount of post-training assistance hours that are needed with content managers may be a helpful metric to track as well. You can (perhaps) learn something about both user "activity" and success of the training component.

Number of page revisions and length of days in approval processes may be good metrics to look at quarter over quarter, or whatever interval makes sense for you- In other words, as we progress, did we see the former increase and the latter decrease? etc.  I think those might help you make statements about the relevance and up-to-date-ness of your content.

What are the overall goals of the project, aside from implementation. Why bring a new CMS on board ? Was it to make content upkeep more effective? To address back end issues? Look to tie metrics to those higher goals as well.

While it's generally not the primary justification for implementing a new web CMS, it's almost inevitable that doing so will lead to changes in your consumer-facing web design regardless of what your current site architecture may be. That being that case, it's also helpful to include that perspective in your project objectives. What can you achieve along those lines in the CMS implementation process including such objectives as migration to responsive design, abandonment of outdated content, integration of social media, or improvement of site architecture and usability? An entire set of metrics surrounding the consumption side of the system may be appropriate.

Ultimately, you certainly should review contributor metrics as well, which will be heavily influenced by the culture of the organization. Those include such characteristics as the autonomy of contributors, their comfort level with web editing tools, and the organization's business model and resultant workflows. Ultimately, you'll be able to measure the success from the contribution side by how active your users are on the new system, their comfort level with it, and the consistency of the subsequent content based on the design, style, and workflow parameters you develop.

RSS

Elsewhere

Latest Activity

Lauren Zakich commented on Lynn Zawie's group OmniUpdate
"Join us in welcoming Jacksonville University to the OmniUpdate family! "
14 hours ago
Catherine Donnelly replied to Mark Greenfield's discussion The Future of the UWEBD Social Network
"I would support using LinkedIn for this group (and have confirmed that I am a member over there).  Generally I  follow highered topics/people on twitter, but long-range/complicated discussions are impossible on that platform. A combo of…"
Tuesday
Lauren Zakich commented on Lynn Zawie's group OmniUpdate
"Jim Heiney from Lock Haven University shares his advice on how an editorial calendar can help keep your web content up to date and engaging in today’s blog post.  "
Sep 22
Lauren Zakich commented on Lynn Zawie's group OmniUpdate
"We have a new addition to our OmniUpdate family. Welcome, Cerritos College! "
Sep 21
Lauren Zakich commented on Lynn Zawie's group OmniUpdate
"Emergency Alerts for OU Campus allows you to communicate with students, staff, and the community with custom website announcements. When time matters most, make sure your website is the go-to place for info."
Sep 20
Neil Joellenbeck replied to Mark Greenfield's discussion The Future of the UWEBD Social Network
"This is the first time I have been here in a long time. Selfishly, I would hope that you would be able to continue the site, but I understand realities. As I re-acquaint myself, I'm seeing a lot of value in what you have tirelessly built.…"
Sep 16
Gareth J M Saunders replied to Mark Greenfield's discussion The Future of the UWEBD Social Network
"Hi Mark, in line with many others who have posted, first a big thank you for providing this resource for so many years. I was a keen reader of it and occasional poster a good few years ago. And I loved my Website Hero mug until I dropped it and had…"
Sep 15
Sara Arnold commented on Lynn Zawie's group OmniUpdate
"Have you heard about our new UX Feedback Program? Your input can directly affect the future of OU Campus! Learn more in today's blog post. "
Sep 14
Lauren Zakich joined Lynn Zawie's group
Thumbnail

OmniUpdate

Share your experiences using OmniUpdate CMS
Sep 13
Genevieve Howard replied to Mark Greenfield's discussion The Future of the UWEBD Social Network
"I want to chime in along with the others in thanking you for being a leader in our niche group! I appreciate your effort. I lean toward LinkedIn. "
Sep 13
A. Watson replied to Mark Greenfield's discussion The Future of the UWEBD Social Network
"I was a recent addition and did not find too much activity here that I could leverage but LinkedIn does seem to be the logical destination.  Perhaps there is interest here and you can crowd source the migration. Migrating the content could…"
Sep 13
Eloine Chapman replied to Mark Greenfield's discussion The Future of the UWEBD Social Network
"I would be very sorry to see this resource go. I am just a one person shop at my college and feel quite a alone as far as anyone understanding the complexity of what I do. It's a wonderful thing to see people facing the same challenges I face…"
Sep 13
Christopher Spires replied to Mark Greenfield's discussion The Future of the UWEBD Social Network
"I wouldn't feel necessary to stick with Ning if the cost isn't a burden. Facebook, LinkedIn, and Slack are all satisfactory options in my opinion. Slack is a great option for more instant communication, and you'll probably find a lot…"
Sep 13
Mark Lawrence replied to Mark Greenfield's discussion The Future of the UWEBD Social Network
"Thank you Mark, this has been an invaluable resource - particularly for seeing how our cohorts at other institutions approach the problems we all face. But, as many people have said today, I haven't visited in a while. I think that's…"
Sep 13
Charlie Lindahl replied to Mark Greenfield's discussion The Future of the UWEBD Social Network
"Ah. Thank you. I've just sent a request to have TAMU.EDU added to the list."
Sep 13
Laurie Trow replied to Mark Greenfield's discussion The Future of the UWEBD Social Network
"Is this for the Slack? If so, you need to email leta@berkeley.edu to have your edu domain added."
Sep 13
Hugh Jarvis replied to Mark Greenfield's discussion The Future of the UWEBD Social Network
"Regardless of where this goes, Mark, thanks for setting it up and running it all these years! I find it quite useful myself, lurking mostly, but occasionally joining in where it might help us, or I might be able to provide value. I like having this…"
Sep 13
Charlie Lindahl replied to Mark Greenfield's discussion The Future of the UWEBD Social Network
"OK, I give up. I am at Texas A&M, and @tamu.edu is not listed among those allowed to create userids. Can someone either (1) add TAMU.EDU or (2) send me an invitation to uwebd slack? (clindahl@tamhsc.edu). Thanks, Charlie"
Sep 13
Jay Massey replied to Mark Greenfield's discussion The Future of the UWEBD Social Network
"Mark, I agree that the paid Ning site may have outlived its usefulness in light of other group media apps. Like many have stated, Slack and FaceBook / LinkedIn groups. are good options. Slack may not have as much adoption as FB or LI yet. Consider…"
Sep 13
David P. Dillard replied to Mark Greenfield's discussion The Future of the UWEBD Social Network
"If you decide to leave Ning, please consider as an additional place to have this discussion group at no cost, the GROUPS.IO discussion group network which is free and of a very high quality. It also provides a wiki to those who have discussion…"
Sep 13

UWEBD has been in existence for more than 10 years and is the very best email discussion list on the Internet, in any industry, on any topic

About

© 2016   Created by Mark Greenfield.   Powered by

Badges  |  Report an Issue  |  Terms of Service