University Web Developers

University Web Developers

We are in the initial stages of project planning for a web CMS implementation in FY2014.  As we begin to develop our project planning documentation, we are somewhat struggling to come up with meaningful, measurable metrics for determining success of our project.  So far, we are considering measuring: 1) the percentage of trained content managers that are "actively" using the system once implemented, and 2) the percentage of trained content managers who are "satisfied" or "very satisfied" with the usability and functionality of the CMS, based on their responses to an online survey.

Can anyone else share some metrics they have used to measure the success of a CMS implementation?

Thanks for your help~

Chris

Tags: CMS, management, metrics, project

Views: 666

Reply to This

Replies to This Discussion

Hi Chris,

I have some questions to consider when determining the best way to measure success of a new cms. I'll send you an email that may help.

Annette

Thanks, Annette!

Hi Annette -- any chance you could share a version of your questions here? It might be very helpful to those of us contemplating CMS changes and upgrades. Thanks!

Hi Daniel,

The measurement of success is based on the reason for the change of CMS in the first place. Is the CMS upgrade part of an overall redesign and updated information architecture? Or is it a stand alone project? Are you moving from having no CMS into one? Are you moving from one certain CMS to another due to contributor difficulties, development standstill or poor service?

Basically, it depends on what you are looking to measure and what your definition of success is being based on.  Also, you can compare the site/page updates before and after CMS implementation.

We get hired as a consultant many times to help zero in on all the pain points within and organization, analyze data, conduct user ability audits, and consolidate a schools goals which we then recommend a CMS that is best suited for their needs.   Since we have an extensive history of experience in higher ed our insight and contribution is quite valuable. It allows for our clients various departments to be heard and considered before making such a major decision.

Hope that helps! 

As Annette said, it depends on why you're doing it. What are the problems that need to be solved, and what are the outcomes that can be measured? I'm planning to switch to a CMS from not having one this coming year, and most of our issues are around quality control. I'll be looking at things like broken links, misspellings, web writing quality and internal standards compliance, information accuracy, etc., as well as bottom line metrics like conversions.

We are also transforming our web this year with new visual design system and CMS.  We should definitely all collaborate on drivers, best-practice, planning, and execution.

Our program has three high level objectives:

  • Provide an unparalleled authoring and publishing experience
    • Give author more powerful and easier to use tools
    • Remove IT from all publishing tasks
    • Remove on technology knowledge requirement from the authoring process
    • Measures: volume of new content and updated content, IT ticket rates, 
  • Deliver leading edge user experiences
    • Improve "findability" of content
    • Improve UX tailored to persona type
    • Be exceptional across multidevices
    • Measure: visitors, pageview, time on page, bounce rates, mobility satisfaction,content reuse,etc
  • Build a strong web builder community
    • Train users on UX, usability, content strategy, etc
    • Audit and support better content and UX
    • Measures: active users, training volume, self-support rates, seminar attendance,

I've done both. With positive results. And you can adjust according to feedback. 

How are you defining "actively using" the system? 

What constitutes a  "trained" content manager? And of course, what determines "satisfaction?"

Have you thought about it from an output perspective? How many web pages effectively published/maintained? 

Thanks to all for your responses.  

George-

"Actively using" the system means: that content manager's pages are being maintained/updated (evidenced by no outdated content) and they aren't coming to IT for those updates.

A "trained" content manager means they've gone through whatever training we and/or the vendor has provided them and they are "actively using" the system as defined above.

"Satisfaction" is measured via a post-implementation online survey of the content managers.  The question(s) will provide a 5 point range of responses, from "very dissatisfied" to "very satisfied".

We hadn't necessarily thought about it from an output perspective, not knowing a good way to measure/quantify that.  I struggle with the true worth or value of an absolute number like "web pages effectively published/maintained".  Couldn't you have a high number for that and still have users really unsatisfied with the process/system for getting their pages updated?

The amount of post-training assistance hours that are needed with content managers may be a helpful metric to track as well. You can (perhaps) learn something about both user "activity" and success of the training component.

Number of page revisions and length of days in approval processes may be good metrics to look at quarter over quarter, or whatever interval makes sense for you- In other words, as we progress, did we see the former increase and the latter decrease? etc.  I think those might help you make statements about the relevance and up-to-date-ness of your content.

What are the overall goals of the project, aside from implementation. Why bring a new CMS on board ? Was it to make content upkeep more effective? To address back end issues? Look to tie metrics to those higher goals as well.

While it's generally not the primary justification for implementing a new web CMS, it's almost inevitable that doing so will lead to changes in your consumer-facing web design regardless of what your current site architecture may be. That being that case, it's also helpful to include that perspective in your project objectives. What can you achieve along those lines in the CMS implementation process including such objectives as migration to responsive design, abandonment of outdated content, integration of social media, or improvement of site architecture and usability? An entire set of metrics surrounding the consumption side of the system may be appropriate.

Ultimately, you certainly should review contributor metrics as well, which will be heavily influenced by the culture of the organization. Those include such characteristics as the autonomy of contributors, their comfort level with web editing tools, and the organization's business model and resultant workflows. Ultimately, you'll be able to measure the success from the contribution side by how active your users are on the new system, their comfort level with it, and the consistency of the subsequent content based on the design, style, and workflow parameters you develop.

RSS

Elsewhere

Latest Activity

Erin Leavitt commented on Lynn Zawie's group OmniUpdate
"Eastern Michigan University College of Education's website is now mobile optimized! Get out your mobile device and check it out: www.emich.edu/coe "
23 hours ago
Erin Leavitt commented on Lynn Zawie's group OmniUpdate
"Don't miss out on today's webcast: How to Handle the Google Mobilegeddon happening at 11 am PDT with our friends at Converge Consulting! Learn about the impact of Google's recent mobile-friendly update, tips to keep your…"
Thursday
Profile IconUniversity of Victoria and Ewa Zennermann joined University Web Developers
Wednesday
Colleen Brennan-Barry posted a discussion

HighEdWeb Invites Nominations for Board of Directors

The Higher Education Web Professionals Association Board of Directors is the governing body of the Association, working to create and manage policy, coordinate business issues, and manage the growth and prosperity of HighEdWeb. The Board meets monthly to discuss updates and issues, and works to lead various Association initiatives year-round.There are several open Director spots, due to growth and natural term expiration, and so HighEdWeb is now inviting nominations. Nominations (of yourself or…See More
May 20
Beth Hastings posted a discussion

Web Designer opening - Columbia, Missouri

Job SummaryThe Web Designer position works closely with various college departments to create and maintain a college website that is marketing focused and content driven. This individual is a talented and creative graphic designer with strong background in designing modern and innovative web pages. The ability to implement the designs into working web pages using front-end development skills in HTML5 and CSS3 is key.Essential FunctionsDesign visually-appealing, innovative web pages and graphics…See More
May 20
Erin Leavitt commented on Lynn Zawie's group OmniUpdate
"New blog post from Jim Heiney of Lock Haven University: The Perils and Perks of Outside Consultants "
May 20
Matt Herzberger replied to Doug Thompson's discussion Transitioning course catalog from old-school InDesign/PDF to web-based system...
"More than anything I would suggest focusing on workflow and how you can manage the process similar to that of the offline pdf creation process. So might want to do a proof of concept with wordpress to see if you can pull it off and then also looked…"
May 20
Doug Thompson posted a discussion

Transitioning course catalog from old-school InDesign/PDF to web-based system...

So, the "powers that be" here are looking into various catalog systems...for next year.In the meantime, we're now working on our (hopefully last) old-school InDesign/PDF catalog, and I got to thinking...maybe it would be a good thing to do some sort of web-based static page (to keep it simple, for now) catalog this time around, to make the transition next year to whatever catalog system the "powers that be" decide upon an easier one.We have a Wordpress instance and then we have our regular…See More
May 19
Edward Terry posted a discussion

Web Designer - Austin, TX

I have this open only for a day or so. Please let me know if I can answer any questions.http://www5.austincc.edu/ehire/posting/online_version.php?job_num=1410053See More
May 18
Erin Leavitt commented on Lynn Zawie's group OmniUpdate
"Join us on Thursday, May 28 at 11 am PT when Becky Vardaman and Robyn Anderson from Converge Consulting and our very own Rich Paul discuss the impact of Google's recent mobile-friendly update. Register now!"
May 15
Ronna Johnston added a discussion to the group Mobile
Thumbnail

Conference Mobile App

We are hosting a large conference in 2016 and looking for a simple mobile app to use, we don't have time to build one in house. Just something with venue info and sessions as a base. Does anyone have suggestions? Thanks much!Ronna JohnstonUniversity of Northern ColoradoSee More
May 14
Brent Schneider joined DNI's group
Thumbnail

Cascade Server CMS

For folks who use (or are interested in) Hannon Hill's Cascade Server CMS productSee More
May 14
Erin Leavitt commented on Lynn Zawie's group OmniUpdate
"New article featured in Career College Central about course catalogs by Lance Merker: "Going Mobile: Five Steps to a Mobile-Friendly Course Catalog"  "
May 14
Erin Leavitt commented on Lynn Zawie's group OmniUpdate
"A BIG OmniUpdate welcome to Iowa Western Community College!"
May 13
Jeff Rauschert replied to Katie Ryan Lambert's discussion Website Redesign - Change Management & Communications
"Katie, we are in the same boat as you. We will be changing to a site that focuses more on prospective students, moving non-related content to SharePoint. We have similar concerns but are going in with a plan of cutting our number of content authors…"
May 13
Profile IconJeff Rauschert and Steve Kellman joined University Web Developers
May 13
Erin Leavitt commented on Lynn Zawie's group OmniUpdate
"Rogue websites can cause all kinds of problems for your higher ed website, but how do you stop them for good? Check out these steps in today's blog post "Taming the Beast: Rogue Websites in Higher Ed" Taming the Beast: Rogue…"
May 12
BlueNorma joined Lynn Zawie's group
Thumbnail

OmniUpdate

Share your experiences using OmniUpdate CMS
May 7
Erin Leavitt commented on Lynn Zawie's group OmniUpdate
"Congratulations to University of Michigan School of Public Health for going live in OU Campus v10 with design by Michigan Creative! sph.umich.edu  "
May 7
Erin Leavitt commented on Lynn Zawie's group OmniUpdate
"Today's blog post sums up the Higher Ed Live Special Edition broadcast, “The Catalog to End All Catalogs,” with Nathan Gerber from Utah Valley University and Dawn Truelsen from Fresno State. Get the scoop! "
May 5

UWEBD has been in existence for more than 10 years and is the very best email discussion list on the Internet, in any industry, on any topic

About

© 2015   Created by Mark Greenfield.

Badges  |  Report an Issue  |  Terms of Service