2:00 - 2:15pm: Introduction of topic; clarification of projects and initiatives list

2:12 - 2:45pm: How to approach the question: “How will we assess the progress and ultimate success or failure of these projects and initiatives?”

2:45 – 3:30pm: Application of model and/or ideas to the list of projects and initiatives

3:30 – 4:00pm: Next steps: how to complete the process for remaining projects? Are there types of projects that don't require formal assessment? How can we ensure this kind of evaluative process for future projects and initiatives?

Attendees: Anne Kenney, Pat Shafer, Kathy Chiang, Kornelia Tancheva, Scott Wicks, Xin Li, Eli Brown, Jean Poland, Oya Rieger, Kizer Walker

Guests: Karen Calhoun, Jim LeBlanc, Elaine Westbrook, Marty Kurth, Anna Korhonen, John Corson-Rikert

Clarification

Projects that have been started or will be finished in the next 6-9 months (near term projects)

     -List of projects

-Annex transfers

-Archival Encoded Description

-Archiving University web sites

-Data Mart Digital Collections Creation, Maintenance or Delivery

-Digital Registry

-EDI Orders

-Enhanced Communication

-E-Only Reviews

-E-Resources Acquisitions & Licensing

-ERM Maintenance

-Find it!

-Get it!

-Goldsen Digital Art Archive

-ITSO Migration

-Large Scale Digitization

-MOA

-Old materials in boxes in G&E

-Digital Preservation Project

-ArXiv

-DPubs

-Blackboard phase 3

-Scholarly Communications program obligations

-Cyberinfrastructure

-VIVO extension

-Find it! Extension

-Succession Planning/library fellows

-Staff development

-Information fluency – outreach

-Do you understand what the project is?

-Is it a good candidate for test run?

Picked 3 projects that could be used in a model

-E-Only Reviews

-Find it!

-LSDI

Model to assess the project

7 factors to assess

-Articulation of goal

-Did we meet goal? Anticipated outcome.

-What does our audience/clientele think?

-What about vendor performance?

-Cost/finance?

-Growth/sustainability?

-Unanticipated consequences/lessons learned

Tools to measure/assess

-Outcome based evaluation

-Faculty feedback/stakeholders

-Balance scorecard

-User

-Internal

-Finance

-Growth

E-Only Review

Articulation of the goal

-Saving subscription costs

-No compromise on scholarship

-Pro/Con (prospective conversion on part of publishers)

Did we meet, are we meeting goals?

-Internal communication not as good

-Assessment of original goal adjustment

-Realized non-subscription savings

-There were savings in binding

-Could have used more “public” conversation about project

-Subscription savings more difficult to assess (LTS has the savings numbers)

-Process for faculty feedback for pre-assessment, but no post-assessment

Vendor Performance

-Variability of services

-Ongoing assessment of vendor by vendor basis

-Rights, access restrictions vary

Growth and Sustainability

-Related to perpetual access

-Titles gone into e-journal archiving

Next Steps

How to complete the process for remaining projects? Are there types of projects that don’t require formal assessment? How can we ensure this kind of evaluative process for future projects and initiatives?

-Consensus – exercise was helpful

-The assessment steps are very similar to grant proposals

-This process of assessment should be used formally for projects regardless of whether the project will go ahead or not, so that we understand the implications.

-Groups can use this process first and then take the results to LMT for their review

-This process should be used for DataMart and LSDI