University Web Developers

University Web Developers

We are in the initial stages of project planning for a web CMS implementation in FY2014.  As we begin to develop our project planning documentation, we are somewhat struggling to come up with meaningful, measurable metrics for determining success of our project.  So far, we are considering measuring: 1) the percentage of trained content managers that are "actively" using the system once implemented, and 2) the percentage of trained content managers who are "satisfied" or "very satisfied" with the usability and functionality of the CMS, based on their responses to an online survey.

Can anyone else share some metrics they have used to measure the success of a CMS implementation?

Thanks for your help~

Chris

Views: 1212

Reply to This

Replies to This Discussion

Hi Chris,

I have some questions to consider when determining the best way to measure success of a new cms. I'll send you an email that may help.

Annette

Thanks, Annette!

Hi Annette -- any chance you could share a version of your questions here? It might be very helpful to those of us contemplating CMS changes and upgrades. Thanks!

Hi Daniel,

The measurement of success is based on the reason for the change of CMS in the first place. Is the CMS upgrade part of an overall redesign and updated information architecture? Or is it a stand alone project? Are you moving from having no CMS into one? Are you moving from one certain CMS to another due to contributor difficulties, development standstill or poor service?

Basically, it depends on what you are looking to measure and what your definition of success is being based on.  Also, you can compare the site/page updates before and after CMS implementation.

We get hired as a consultant many times to help zero in on all the pain points within and organization, analyze data, conduct user ability audits, and consolidate a schools goals which we then recommend a CMS that is best suited for their needs.   Since we have an extensive history of experience in higher ed our insight and contribution is quite valuable. It allows for our clients various departments to be heard and considered before making such a major decision.

Hope that helps! 

As Annette said, it depends on why you're doing it. What are the problems that need to be solved, and what are the outcomes that can be measured? I'm planning to switch to a CMS from not having one this coming year, and most of our issues are around quality control. I'll be looking at things like broken links, misspellings, web writing quality and internal standards compliance, information accuracy, etc., as well as bottom line metrics like conversions.

Thanks to all for your responses.  

George-

"Actively using" the system means: that content manager's pages are being maintained/updated (evidenced by no outdated content) and they aren't coming to IT for those updates.

A "trained" content manager means they've gone through whatever training we and/or the vendor has provided them and they are "actively using" the system as defined above.

"Satisfaction" is measured via a post-implementation online survey of the content managers.  The question(s) will provide a 5 point range of responses, from "very dissatisfied" to "very satisfied".

We hadn't necessarily thought about it from an output perspective, not knowing a good way to measure/quantify that.  I struggle with the true worth or value of an absolute number like "web pages effectively published/maintained".  Couldn't you have a high number for that and still have users really unsatisfied with the process/system for getting their pages updated?

The amount of post-training assistance hours that are needed with content managers may be a helpful metric to track as well. You can (perhaps) learn something about both user "activity" and success of the training component.

Number of page revisions and length of days in approval processes may be good metrics to look at quarter over quarter, or whatever interval makes sense for you- In other words, as we progress, did we see the former increase and the latter decrease? etc.  I think those might help you make statements about the relevance and up-to-date-ness of your content.

What are the overall goals of the project, aside from implementation. Why bring a new CMS on board ? Was it to make content upkeep more effective? To address back end issues? Look to tie metrics to those higher goals as well.

While it's generally not the primary justification for implementing a new web CMS, it's almost inevitable that doing so will lead to changes in your consumer-facing web design regardless of what your current site architecture may be. That being that case, it's also helpful to include that perspective in your project objectives. What can you achieve along those lines in the CMS implementation process including such objectives as migration to responsive design, abandonment of outdated content, integration of social media, or improvement of site architecture and usability? An entire set of metrics surrounding the consumption side of the system may be appropriate.

Ultimately, you certainly should review contributor metrics as well, which will be heavily influenced by the culture of the organization. Those include such characteristics as the autonomy of contributors, their comfort level with web editing tools, and the organization's business model and resultant workflows. Ultimately, you'll be able to measure the success from the contribution side by how active your users are on the new system, their comfort level with it, and the consistency of the subsequent content based on the design, style, and workflow parameters you develop.

RSS

Elsewhere

Latest Activity

Linda Faciana commented on Lynn Zawie's group OmniUpdate
"Join our next webcast with Maxwell Rowe from @mackeycreativelab as he discusses ways to help students reach their educational goals using the guided pathways model on your website. http://bit.ly/2zhdcIt"
13 hours ago
Sara Arnold commented on Lynn Zawie's group OmniUpdate
"Frustrated with student retention efforts and low graduation rates? Maybe it’s time to consider the guided pathways model for your institution's website. Check out our latest white paper for all the details! http://bit.ly/38rNild"
yesterday
Sara Arnold commented on Lynn Zawie's group OmniUpdate
"OmniUpdate is excited to be in the running for a People’s Choice Stevie Award for Favorite Customer Service! If you’d like to show your support, cast your vote now! You can vote as many times as you’d like."
Jan 16
Linda Faciana commented on Lynn Zawie's group OmniUpdate
"Take a ½ hour out of your day to learn 4 important tips on keeping your website accessible! Join Ryan from Paskill Stapleton & Lord @PSandL as he shares the accessibility guidelines for your university website. http://bit.ly/2zhdcIt"
Jan 7
Sara Arnold commented on Lynn Zawie's group OmniUpdate
"Get up to speed on GDPR and how it affects your higher ed institution and student recruitment. http://bit.ly/2YZZtRQ"
Jan 7
Sara Arnold commented on Lynn Zawie's group OmniUpdate
"Web governance should not be an afterthought; when it’s done right, it can actually enhance your workflow and make your job easier. http://bit.ly/33vIZU0"
Nov 8, 2019
Sara Arnold commented on Lynn Zawie's group OmniUpdate
"Exciting news... OmniUpdate has merged with Destiny Solutions! Learn more on our blog. http://bit.ly/332KSr8"
Oct 30, 2019
Linda Faciana commented on Lynn Zawie's group OmniUpdate
"Switching to a new CMS? Join our next webcast with Briana Johnson from @OSUIT to learn how to convince decentralized web content authors to tolerate the switch, actively participate, and enjoy it! http://bit.ly/2zhdcIt"
Oct 29, 2019
Sara Arnold commented on Lynn Zawie's group OmniUpdate
"Your website is the front door to your college or university. Your website design has to accommodate for the way that students interact with and use the information your institution provides. http://bit.ly/2P8VldR"
Oct 24, 2019
Sara Arnold commented on Lynn Zawie's group OmniUpdate
"Learn how a new website design and CMS helped Florida Gulf Coast University increase new visits to the school’s website with improved SEO. http://bit.ly/2ByaQq4"
Oct 21, 2019
Profile IconJames Pollard and Michael Clarke joined University Web Developers
Oct 21, 2019
Linda Faciana commented on Lynn Zawie's group OmniUpdate
"Join our next webcast with Kelly Rushing from @uofsouthalabama to learn how to create accessible PDFs for your website by starting with your source documents. http://bit.ly/2zhdcIt"
Oct 18, 2019
Sara Arnold commented on Lynn Zawie's group OmniUpdate
"Learn why your college or university should choose SaaS across the board, especially for your next CMS. http://bit.ly/2Iy0SZE"
Oct 8, 2019
Linda Faciana commented on Lynn Zawie's group OmniUpdate
"Join us for our next webcast with OmniUpdate CEO Lance Merker, who will delve into key insights about Generation Z’s online search behaviors to help you refine your school's web marketing strategy. http://bit.ly/2zhdcIt"
Oct 3, 2019
Sara Arnold commented on Lynn Zawie's group OmniUpdate
"Our newest guide will help you learn what it means to be accessible, how to implement accessibility best practices, quick fixes to try as well as a long-term plan, plus tools to help you in your website accessibility efforts. Download it now!"
Oct 1, 2019
Linda Faciana commented on Lynn Zawie's group OmniUpdate
"Are online forms more efficient? Learn how El Camino College used Formstack to create online forms that expedited processing, improved communications, increased transparency, and promoted accountability across campus. http://bit.ly/2zhdcIt"
Sep 18, 2019
Sara Arnold commented on Lynn Zawie's group OmniUpdate
"It's important to understand the science behind your web pages to better engage and ultimately attract prospective students to your site. http://bit.ly/2ZYK8FZ"
Sep 12, 2019
Linda Faciana commented on Lynn Zawie's group OmniUpdate
"If you’re struggling with web challenges such as accessibility, SEO, design consistency, workflow, content governance, or how to start a website redesign, you’re not alone. Join our next webcast to learn how other higher ed institutions…"
Sep 5, 2019
Sara Arnold commented on Lynn Zawie's group OmniUpdate
"eQAfy confirms that OU Campus is still the #1 commercial CMS for colleges and universities in the United States. http://bit.ly/2Lir9Mn"
Aug 28, 2019
Sara Arnold commented on Lynn Zawie's group OmniUpdate
"Here’s an outline of everything you need to know about OCR compliance, including what it is, what your college or university can do to stay compliant, and resources for OCR compliance. #accessibility http://bit.ly/2rcPDgG"
Aug 23, 2019

UWEBD has been in existence for more than 10 years and is the very best email discussion list on the Internet, in any industry, on any topic

About

© 2020   Created by Mark Greenfield.   Powered by

Badges  |  Report an Issue  |  Terms of Service