"Hi Kimbel -- Does you manual process include a checklist and workflow documentation?
If not, it sounds to me like checklists and schedulers are your best next steps. You can structure and document what you do now, and then look at it to see if there…"
University Web Developers
harvesting your Directory?
Hello all -
Running a Web report recently, I realized that the third-highest URL in my site was the Faculty & Staff Directory search results page. This struck me as rather bizarre, so I dug a little deeper and learned that, indeed, hits had tracked up rather significantly in the last month.
I dug deeper, and it seems that we are getting hit with quite a few IPs whose reverse DNS points to pipl.com, which appears to be something of a search aggregator.
I did some targeted searches to see if I could pull up something clearly from our directory, but was unsuccessful.
Of course, there are some common-sense precautions in place to prevent wholesale harvesting of the directory, but this seems like a questionable practice, and I've attempted to block access from the offending IPs.
Has anyone else encountered this? Thoughts on blocking as a reasonable response?
Oddly, about the same time (although a week after this started) I converted the directory search results to a compliant Microformat. This raises an interesting question as to whether such specific coding can actually hurt more than help...
Running a Web report recently, I realized that the third-highest URL in my site was the Faculty & Staff Directory search results page. This struck me as rather bizarre, so I dug a little deeper and learned that, indeed, hits had tracked up rather significantly in the last month.
I dug deeper, and it seems that we are getting hit with quite a few IPs whose reverse DNS points to pipl.com, which appears to be something of a search aggregator.
I did some targeted searches to see if I could pull up something clearly from our directory, but was unsuccessful.
Of course, there are some common-sense precautions in place to prevent wholesale harvesting of the directory, but this seems like a questionable practice, and I've attempted to block access from the offending IPs.
Has anyone else encountered this? Thoughts on blocking as a reasonable response?
Oddly, about the same time (although a week after this started) I converted the directory search results to a compliant Microformat. This raises an interesting question as to whether such specific coding can actually hurt more than help...
Tags: blocking, directory, harvesting, microformats, pipl.com, privacy, security
Views: 5
Elsewhere
Latest Activity
Kimbel Jeffers replied to Kimbel Jeffers's discussion Office Reservation software"The problem is we use a manual process right now and things keep falling through the cracks."
Annette Spearman replied to Derek Tonn's discussion Freelance web design recommendations (small projects)"Hi Derek,
We can help you! I'll in box you all my info so we can connect and set up some time to talk.
Annette
"
Mark Rothbaum posted a discussion5-Minute Survey on Use of Facebook in Admissions
We're conducting our annual survey on Facebook and Admissions. Please take a few minutes to complete the survey at:http://www.varsityoutreach.com/FacebookSurvey/Our GoalOur goal is to explore trends related to how schools are using Facebook to reach out to prospective and admitted students.How Is the Data Used?All data will be shown in the aggregate. Answers from individual schools will not be released and will remain…See More
Colleen Brennan-Barry posted a discussionHighEdWeb Welcomes Steve Wozniak & Scott Stratten
HighEdWeb is very pleased to announce HighEdWeb 2013 Annual Conference opening keynote speaker Steve Wozniak and closing keynote speaker…See More
faris ahmed commented on social networking web design's blog post Megastar Media Webby Award Honorees"wow thats amazing article .
your stuff never fails to amaze me
honestly . great work as always :D
something i would like to add in is that
the entries each year are rapidly increasing .
but i think thats cause they take the…"
Lynn Zawie posted a discussionFreelance Web Developer Needed
Stony Brook University web team is looking for some help coding a new design. HTML5, CSS3, JQuery, Responsive Design expertise needed. If you are interested in bidding on this project, I am happy to share more details. Work would need to begin early summer. ..LynnSee More
Sara Michel commented on Lynn Zawie's group OmniUpdate"Great blog post by Higher Education Marketing on leveraging Google pay-per-click ad extensions for higher ed."
Sara Michel commented on Lynn Zawie's group OmniUpdate"Check out Naropa University's new online magazine. Looks awesome! Great job team."
Norma J Dowell replied to Derek Tonn's discussion Freelance web design recommendations (small projects)"Hi Derek!
First of all, apologies for taking so long to respond! Secondly, I am not your web developer for such an issue, but if you can find someone to pick their brain and use as a sounding board, it may be all you need. In the past, when I…"
Daniel Bashaw replied to Kimbel Jeffers's discussion Office Reservation software"Hi Kimbel.
I know you've been tasked with finding a software solution, though I'm wondering if you may need an interim step first: Does your institution have checklists covering all of the steps needed in on-boarding, relocating, and…"
Kimbel Jeffers posted a discussionOffice Reservation software
I've been tasked with finding a software tool that helps manage the onboarding and exit process of new and departing faculty. Ultimately i would like this software to management faculty office interms of when resources can be removed from a particular office and when a new faculty member can be moved in with the necessary resources. This tool should have notifications and alerts so there are no conflicts with someone being removed from a office and someone being placed in a office. Does anyone…See More
Sara Michel commented on Lynn Zawie's group OmniUpdate"Congrats to Harper College on going live with their new online course catalog! Looks great!"
Helen Mosher posted a status"After 8 years being away from higher-ed communications work, I'm very interested in returning."
Sarah McMaster replied to Katra Farah's discussion Online chat interfaces"Thanks, Daniel. We don't currently have any livechat solution so this is new fact-finding territory for us! I will keep the forum posted as/if we are able to move forward."
Daniel Bashaw replied to Katra Farah's discussion Online chat interfaces"In our case the impact of our current proprietary chat tool seems to be minimal, as it is little-used. It requires log-in with contact details and is slow to load. I don't have any metrics on its impact to back up my perception though.
I expect…"
UWEBD has been in existence for more than 10 years and is the very best email discussion list on the Internet, in any industry, on any topic
About
© 2013 Created by Mark Greenfield.
