Association of Research Libraries (ARLĀ®)

http://www.arl.org/resources/pubs/scat/mandel-2.shtml

Publications, Reports, Presentations

Scholarly Communication and Technology

Online Books at Columbia: Measurement and Early Results on Use, Satisfaction, and Effect

Carol A. Mandel

Deputy University Librarian
Columbia University

Mary C. Summerfield

Coordinator, Online Books Project
Columbia University Libraries

Paul Kantor

Consultant

Table of Contents

1.EXECUTIVE SUMMARY
2.CONCEPTUAL FRAMEWORK
3.THE ONLINE BOOKS COLLECTION

3.1Design Of the Online Books Collection
3.2Development of the Online Books Collection
3.2.1Purchased Texts
3.2.2Collaborating Publishers And Their Books
3.3User Access to the Collection
3.3.1Formats and Functionalities Over Time
3.3.2Who Can Use The Collection
3.3.3Access Paths to CWeb Books
3.3.4Publicity Campaign
4.USE OF ONLINE BOOKS
4.1Methodology For Studying Use of And Reactions to Various Formats
4.1.1Measurement Plans
4.1.2Documentation Measures for Use of Online Books
4.1.3Documentation Measures for Reactions to Online Books
4.2Socio-Technical Environment
4.2.1External Socio-Technical Environment
4.2.1.1Media Coverage Of the Internet
4.2.1.2Personal Computer Specifications & Pricing Trends
4.2.1.3Household Computer Penetration & Internet Access
4.2.2Columbia Socio-Technical Environment
4.2.2.1Campus Infrastructure: February 1997
4.2.2.2Community Perceptions of Access To Computing Resources
4.2.2.3Community Use of Online Resources
4.3Findings On Use Of Books In Online Collection
4.3.1Reference Books
4.3.1.1Total Use Over Time
4.3.1.1.1Concise Columbia Electronic Encyclopedia
4.3.1.1.2Columbia Granger's World of Poetry*
4.3.1.1.3The Oxford English Dictionary
4.3.1.1.4Garland Reference Works
4.3.1.2Host Computers for Reference Book Use
4.3.2Monographic Books
4.3.2.1Total Use Over Time
4.3.2.1.1The Past Masters Collection
4.3.2.1.2Columbia University Press Monographs
4.3.2.1.2.1Social Work Books
4.3.2.1.2.2Other Works
4.3.2.1.3Oxford University Press Monographs
4.3.2.2Host Computers for Monographic Book Use
4.3.2.3Use By Day And Time -- All Types of Books
4.3.3Session Analysis for Use of CWeb Books
4.3.3.1Two Weeks' Sessions - All Online Books
4.3.3.2Sessions for Social Work Books
4.3.4Analysis of Unique Users Of Online Books
4.3.4.1Use and Users
4.3.4.2Use Concentration
4.3.4.2.1Reference Books
4.3.4.2.2Non-Reference Books
4.3.4.3User Cohorts
4.3.4.3.1Reference Books
4.3.4.3.1.1The OED
4.3.4.3.1.2Grangers Reference Works:
4.3.4.3.2Non-Reference Books
4.3.4.3.2.1Past Masters
4.3.4.3.2.2Columbia University Press
4.3.4.3.2.3Oxford University Press
4.3.4.4Online Book Use Per User
5.UNDERSTANDING FACTORS INFLUENCING USE
5.1Resource Factors
5.2Attitude Factors - In-Class Survey
5.2.1The In-Class Survey
5.2.2Methods of Studying A Class Reading
5.2.3Preferences for Studying Class Reading
5.2.4Reasons for Preference
5.2.5Impact of Preferred Method
5.2.6Comparison of Personal Behavior and Perception of Others' Behavior
6.THE ONLINE SURVEY
6.1The Online Interview Instrument
6.2Early Results from CWeb Survey
6.2.1CWeb Survey Responses by Online Text Used
6.2.2CWeb Survey: Primary Project for Using Book
6.2.3CWeb Survey: Ways of Using Book
6.2.4CWeb Survey: Forms of This Book Ever Used
6.2.5CWeb Survey: Preferred Form of This Book
6.2.6CWeb Survey: Reasons for Preference
6.2.7CWeb Survey: Preferred Format and Reasons for Preference
6.2.8CWeb Survey: Frequency of Use in Past Three Months
6.2.9CWeb Survey: Total Usage in Minutes in Past Three Months
6.2.10CWeb Survey: Frequency of Use of Any Online Book in Past Year
6.2.11CWeb Survey: Effect of Online Books on Scholarly Work
6.2.11.1CWeb Online Survey: Productivity, Book Type and Format
6.2.11.2CWeb Online Survey: Work Quality, Book Format and Type
6.2.12CWeb Online Survey: Columbia Cohort of Respondents
6.2.13CWeb Online Survey: Discipline of Respondents
6.2.14Online Survey: Place in Project
6.3User Comments
7.BEHAVIORAL FACTORS
7.1Access to Networked Computer
7.2Time In Online Activities
7.2.1Responses to CWeb Online Survey
7.2.2Responses to Questionnaire with Paper OED
7.2.3Responses to In-Class Questionnaire, Fall 1996 and Spring 1997
8.CONCLUSIONS


FOOTNOTES

Figure 1. Interrelation of Factors Involved in the Use and Impact of Online Books.

Exhibit 1. Columbia University Digital Library Collections

Exhibit 2. Online Books Evaluation Project: Titles Included - Home Page

Exhibit 3. Online Books Evaluation Project: Titles Included - Current Social Sciences

Table 1. Types of Surveys

Table 2. New York Times Stories Involving Information Services

Table 3. Minimum Recommended Specifications for Home Computers, May 1994 - April 1997

Table 4. Characteristics of a $2,000 Computer, December 1994 - June 1997

Table 5. U.S. Internet Households

Table 6. March 1997 In-Library Survey: Is there a computer (in the library or elsewhere) attached to the campus network (directly or by modem) that you can use whenever you want?

Table 7. Fall 1995 Campus Survey: Is there a computer (in the library or elsewhere) attached to the campus network (directly or by modem) that you can use whenever you want?

Table 8. March 1997 In-Library Survey: Weekly Hours on Online Activities by Access to Computers Linked to Campus Network, Winter 1997

Table 9. March 1997 In-Library Survey: Weekly Hours In Online Activities by Columbia Status, Winter 1997

Graph 1. Concise Columbia Electronic Encyclopedia Sessions, 1994 - 1997: CNet

Table 10. Columbia Granger's World of Poetry: Number of Hits by Month

Table 11. Oxford English Dictionary: Number of Hits by Month

Table 12. Garland Reference Works: Number of Hits by Month, December 1, 1996 - May 31, 1997

Table 13. Host Computers for Reference Book Use, May 1, 1996 - March 15, 1997 - Percent Distribution

Table 14a. Past Masters On The Web, Total Monthly Hits: May 1995 - March 1997

Table 14b. Key Past Masters Texts On The Web, Monthly Hits: August 1996 - May 1997

Table 15. Scholarly Hits on Columbia University Press Books, May 1, 1996 - May 31, 1997

Table 16. Columbia Circulation of Columbia University Press Monographs: 1994 - 1996

Table 17a. Scholarly Uses (Hits) Oxford University Press Monographs In Literary Criticism, May 1, 1996 - May 31, 1997

Table 17b. Scholarly Uses (Hits) Oxford University Press Monographs In Philosophy, May 1, 1996 - May 31, 1997

Table 18. Columbia Circulation of Oxford University Press Monographs: 1995 - 1996

Table 19. Host Computers for Monographic Book Use, May 1, 1996 - May 31, 1997

Table 20. Patterns of Use from Web Server: May 1, 1996 - March 15, 1997 Hits

Table 21. Hits by Time of Day: May 1, 1996 - March 15, 1997

Table 22. Online Book Usage (Web): Hits Per Use Session

Table 23. Session Analysis for Social Work Books, Fall 1996

Table 24. Hits by Book Category, March 15 - May 31, 1997

Table 25. Unique Users and Hits for Reference Books, March 15 - May 31, 1997

Table 26. Non-Reference Books by Number of Users, March 15 - May 31, 1997

Table 27. Unique Users and Hits for Non-Reference Books, March 15 - May 31, 1997

Table 28. Distribution of Hits Per Unique User, March 15 - May 31, 1997

Table 29. Distribution of Unique Titles Viewed Per User, March 15 - May 31, 1997

Table 30. Hits Per Unique User by Academic Cohort, March 15 - May 31, 1997

Exhibit 4. Survey Of Book Use For Course Readings

Table 31. Methods of Reading This Assignment: Whole Sample Fall 1996 And Spring 1997

Table 32. Preferred Method Reading This Assignment: Whole Sample Fall 1996 and Spring 1997

Table 33. Reason for Preferred Method: Whole Sample Fall 1996 and Spring 1997

Table 34. Preferred Method & Reason for Preferred Method: Whole Sample Spring 1997 - Row Percentages

Table 35. Nature of Impact of Preferred Method: Whole Sample Fall 1996 and Spring 1997

Table 36. In-Class Surveys: Personal Behavior and Perception of Methods Used by Classmates to Read This Assignment: Whole Sample Fall 1996 and Spring 1997

Exhibit 5. Online Survey Instrument: Non-Reference Books

Table 37. CWeb Online Survey Responses by Online Text Used, September 1996 - June 1997

Table 38. CWeb Online Survey Responses by Work Involved, September 1996 - June 1997

Table 39. CWeb Online Survey Responses: Uses of The OED , September 1996 - June 1997

Table 40. CWeb Online Survey Responses: Uses of Other Books, September 1996 - June 1997

Table 41. CWeb Online Survey Responses: Forms of the Book Ever Used, September 1996 - June 1997

Table 42. CWeb Online Survey Responses: Preferred Book Form, September 1996 - June 1997

Table 43. CWeb Online Survey Responses: Reasons for Book Form Preference, September 1996 - June 1997

Table 44. CWeb Online Survey Responses: Preferred Book Form and Key Reasons for Preference, September 1996 - June 1997

Table 45. CWeb Online Survey Responses: Frequency of Use of This Book in Past three Months, September 1996 - June 1997

Table 46. CWeb Online Survey Responses: Total Usage of This Book In Minutes in Past Three Months, September 1996 - June 1997

Table 47. CWeb Online Survey Responses: Total Usage of Online Books In Past Year, September 1996 - June 1997

Table 48. CWeb Online Survey: In doing the type of work for which you used this book, do paper books or online books help you be more productive? by Book, September 1996 - June 1997

Table 49. CWeb Online Survey: Do you find that you are able to do work of higher quality when you use paper books or online books? by Book, September 1996 - June 1997

Table 50. CWeb Online Survey: Quality and Productivity, September 1996 - June 1997

Table 51. CWeb Online Survey: Respondent's Columbia Status, September 1996 - June 1997

Table 52. CWeb Online Survey: Respondent's Discipline, September 1996 - June 1997

Exhibit 6. An Extended Comment

Table 53. In-Class Surveys: Ready Access to Networked Computer: Whole Sample Spring 1997

Table 54. In-Class Survey: Preferred Method of Reading This Assignment and Access to Networked Computer: Whole Sample Spring 1997

Table 55. CWeb Online Survey: Weekly Hours In Online Activities, September 1996 - June 1997

Table 56. Weekly Hours In Online Activities for 11 Respondents to Paper Questionnaire on Use of OED, 1996 -- Percent of Respondents

Table 57. In-Class Surveys: Weekly Hours In Online Activities: Whole Sample Fall 1996 and Spring 1997

Table 58. In-Class Surveys: Mean Weekly Hours In Online Activities By Class Type: Fall 1996 and Spring 1997

Table 59. In-Class Surveys: Weekly Hours In Online Activities By Access to Networked Computer: Spring 1997

Appendix 1. Contemporary Books In the Online Collection

Appendix 2. Format Availability, Winter 1997, and Introduction Date

Appendix 3. Home Computers: Minimum Specifications Recommended

Appendix 4. Gateway 2000 Home Computers: System Specifications

Appendix 5. U.S. Household PC & Internet Penetration

Appendix 6. Concise Columbia Electronic Encyclopedia Sessions, 1994 - 1997: CNet