CMU has been said to be the “most wired campus in theUS” for two years in a row. What kind of impact doessuch a infrastructure has on the daily academic life ofCMU?CMU has been said to be the “most wired campus in theUS” for two years in a row. What kind of impact doessuch a infrastructure has on the daily academic life ofCMU?
While the students in CMU are enjoying the convenienceof online course materials, sometime too convenientthat they don’t even have to show up for classes, wewant to look at this issue from a different perspective:What do the faculties think about putting coursematerials on the web.While the students in CMU are enjoying the convenienceof online course materials, sometime too convenientthat they don’t even have to show up for classes, wewant to look at this issue from a different perspective:What do the faculties think about putting coursematerials on the web.
CMU Faculties’ Opinion AboutOnline Course MaterialsCMU Faculties’ Opinion AboutOnline Course Materials
36-20336-203
Group 6Group 6
Yi Niu, Maisha O’Neal, Ethan Tira-ThompsonYi Niu, Maisha O’Neal, Ethan Tira-Thompson
IntroductionIntroduction
Why did we chose this project?Why did we chose this project?
What can this survey tell us?What can this survey tell us?
What future benefits would come out of thissurvey?What future benefits would come out of thissurvey?
Question to be exploredQuestion to be explored
What is the percentage of faculties in CMUthat is using web materials to supportteachingWhat is the percentage of faculties in CMUthat is using web materials to supportteaching
How is the materials distributed onlineHow is the materials distributed online
Do the faculties find online materialshelpful / harmfulDo the faculties find online materialshelpful / harmful
Outcome predictionOutcome prediction
More than half of the faculties in CMU isusing online materials for their coursesMore than half of the faculties in CMU isusing online materials for their courses
Online materials are considered helpful bythe facultiesOnline materials are considered helpful bythe faculties
More faculties will provide online coursematerials to their students in the futureMore faculties will provide online coursematerials to their students in the future
Project designProject design
Email + web based survey supported bypersonal interview follow upsEmail + web based survey supported bypersonal interview follow ups
Reason:Reason:
All faculties in CMU has an email address,and free internet access in schoolAll faculties in CMU has an email address,and free internet access in school
Personal follow up of the non-responseensures high response ratePersonal follow up of the non-responseensures high response rate
SamplingSampling
Target populationTarget population
All teaching faculties in CMUAll teaching faculties in CMU
Sampling frameSampling frame
All faculties listed in CMU email directoryAll faculties listed in CMU email directory
Sampled populationSampled population
Proportional stratified by collegeProportional stratified by college
Sample assemblySample assembly
We built a list of Andrew user IDsWe built a list of Andrew user IDs
Filtered out students and administrationFiltered out students and administration
Pulled proportionally stratified sample fromfacultyPulled proportionally stratified sample fromfaculty
Target size: 250; final sample 252Target size: 250; final sample 252
Later learned Philosophy Department wasaccidentally left out, added 13 samples.Later learned Philosophy Department wasaccidentally left out, added 13 samples.
Generated random IDsGenerated random IDs
Questionnaire DesignQuestionnaire Design
20 questions total20 questions total
Yes / No questions + Multiple choiceYes / No questions + Multiple choice
For “other” or “unsure”, additionalinformation is collected in form of openended questionsFor “other” or “unsure”, additionalinformation is collected in form of openended questions
Goal: get as much related information aspossibleGoal: get as much related information aspossible
Pilot TestingPilot Testing
First to non-professors (to check for clarity)First to non-professors (to check for clarity)
Then to a few professors across theuniversity (to check for content)Then to a few professors across theuniversity (to check for content)
Pilot Testing ResultsPilot Testing Results
Simplify certain questions/instructions.Simplify certain questions/instructions.
Create an “Other” option for specificquestionsCreate an “Other” option for specificquestions
Sample ContactSample Contact
Initially send email with link to survey webpage to 265 subjectsInitially send email with link to survey webpage to 265 subjects
Confidentiality is stressed. Each subjectanswer the survey with assigned random IDnumberConfidentiality is stressed. Each subjectanswer the survey with assigned random IDnumber
Sample Contact (Cont.)Sample Contact (Cont.)
1st round follow up by email, 2 days afterinitial email1st round follow up by email, 2 days afterinitial email
2nd round follow up by email, 3 days after1st round follow up2nd round follow up by email, 3 days after1st round follow up
Personal interview for non-response followup as final attemptPersonal interview for non-response followup as final attempt
Response RateResponse Rate
By April 23 2001, 72 replies:By April 23 2001, 72 replies:
April 18th: 18 replies (Initial email)April 18th: 18 replies (Initial email)
April 19th: 8 repliesApril 19th: 8 replies
April 20th: 7 repliesApril 20th: 7 replies
April 21st: 18 replies (1st follow up)April 21st: 18 replies (1st follow up)
April 22nd: 8 repliesApril 22nd: 8 replies
April 23rd: 7 repliesApril 23rd: 7 replies
Response Rate: 29% (72/250)Response Rate: 29% (72/250)
Descriptive StatisticsDescriptive Statistics
Background information (72 responses):Background information (72 responses):
Gender:Gender:
51 male (77.3%)51 male (77.3%)
15 female (22.7%)15 female (22.7%)
Age:Age:
20-305 (7.6%)20-305 (7.6%)
31-4018 (27.3%)31-4018 (27.3%)
41-5024 (36.4%)41-5024 (36.4%)
51-609 (13.6%)51-609 (13.6%)
>6010 (15.2%)>6010 (15.2%)
Descriptive StatisticsDescriptive Statistics
Background information (72 responses):Background information (72 responses):
TitleTitle
Professor:21 (31.8%)Professor:21 (31.8%)
Assistant Professor:16 (24.2%)Assistant Professor:16 (24.2%)
Associate Professor: 7 (10.6%)Associate Professor: 7 (10.6%)
(Senior) Lecturer :8 (11.1%)(Senior) Lecturer :8 (11.1%)
Research Faculty:5 (7.6%)Research Faculty:5 (7.6%)
Visiting Faculty:4 (6.1%)Visiting Faculty:4 (6.1%)
Descriptive StatisticsDescriptive Statistics
Background information (72 responses):Background information (72 responses):
Years teaching:Years teaching:
> 2017 (26.2%)> 2017 (26.2%)
16 - 207 (10.8%)16 - 207 (10.8%)
11 - 159 (13.9%)11 - 159 (13.9%)
6 - 1112 (18.5%)6 - 1112 (18.5%)
1 - 516 (24.6%)1 - 516 (24.6%)
< 13 (4.6%)< 13 (4.6%)
Don’t teach1 (1.5%)Don’t teach1 (1.5%)
Descriptive StatisticsDescriptive Statistics
Background information (72 responses):Background information (72 responses):
Years teaching in CMU:Years teaching in CMU:
>20 9 (13.7%)>20 9 (13.7%)
16-206 (9.1%)16-206 (9.1%)
11-158 (12.1%)11-158 (12.1%)
6-1011 (16.7%)6-1011 (16.7%)
1-520 (40.4%)1-520 (40.4%)
<19 (13.7%)<19 (13.7%)
Don’t teach at CMU3 (4.6%)Don’t teach at CMU3 (4.6%)
Descriptive StatisticsDescriptive Statistics
Background information (72 responses):Background information (72 responses):
63 (95.5%) respondents have computer at home63 (95.5%) respondents have computer at home
60 (91.0%) respondents have internetconnection at home60 (91.0%) respondents have internetconnection at home
Connection type:Connection type:
Dial up modem42 (63.6%)Dial up modem42 (63.6%)
DSL20 (30.3%)DSL20 (30.3%)
Cable3 (4.6%)Cable3 (4.6%)
Not sure1 (1.5%)Not sure1 (1.5%)
Descriptive StatisticsDescriptive Statistics
51 respondent are teaching in CMU duringthe current Academic Year51 respondent are teaching in CMU duringthe current Academic Year
Method of class handout distributionMethod of class handout distribution
Online + in class hand out 30 (36.59%)Online + in class hand out 30 (36.59%)
In class only24 (29.3%)In class only24 (29.3%)
Online only18 (22.0%)Online only18 (22.0%)
Library reserve3 (4.2%)Library reserve3 (4.2%)
No handout2 (2.4%)No handout2 (2.4%)
Descriptive StatisticsDescriptive Statistics
38 respondents (65.5% who teaches thisyear) have course web page (web site) forthis Academic Year.38 respondents (65.5% who teaches thisyear) have course web page (web site) forthis Academic Year.
Reason not to have course web page (website)Reason not to have course web page (website)
No need for net10 (35.7%)No need for net10 (35.7%)
Don’t know how4 (14.3%)Don’t know how4 (14.3%)
Too much work2 (7.1%)Too much work2 (7.1%)
Descriptive StatisticsDescriptive Statistics
Course web page (web site) locationCourse web page (web site) location
Own home page:48 (82.8%)Own home page:48 (82.8%)
Black Board:11 (19.0%)Black Board:11 (19.0%)
Andrew course:7 (10.6%)Andrew course:7 (10.6%)
Descriptive StatisticsDescriptive Statistics
Content of web page (web site)Content of web page (web site)
Syllabus / Policy38 (65.5%)Syllabus / Policy38 (65.5%)
Lecture note29 (50.0%)Lecture note29 (50.0%)
Class handout35 (60.3%)Class handout35 (60.3%)
Homework assignment36 (62.1%)Homework assignment36 (62.1%)
Assignment solutions27 (46.6%)Assignment solutions27 (46.6%)
Past exam / solutions18 (31.0%)Past exam / solutions18 (31.0%)
Additional material / link32 (55.2%)Additional material / link32 (55.2%)
Q&A / course discussion10 (17.2%)Q&A / course discussion10 (17.2%)
Descriptive StatisticsDescriptive Statistics
Helpfulness vs. HarmfulnessHelpfulness vs. Harmfulness
Most helpful30 (66.7%)Most helpful30 (66.7%)
Somewhat helpful10 (22.2%)Somewhat helpful10 (22.2%)
Indifferent5 (11.1%)Indifferent5 (11.1%)
No negative / harmful opinion yetNo negative / harmful opinion yet
Descriptive StatisticsDescriptive Statistics
Future usage of course web pagesFuture usage of course web pages
40 respondent are planning on using course web pagesnext year40 respondent are planning on using course web pagesnext year
21 are not going to use course web pages21 are not going to use course web pages
5 are not sure about the decision5 are not sure about the decision
Location of future course web pagesLocation of future course web pages
Own home page:43 (65.2%)Own home page:43 (65.2%)
Black Board:13 (19.7%)Black Board:13 (19.7%)
Andrew Course:10 (15.2%)Andrew Course:10 (15.2%)
Descriptive StatisticsDescriptive Statistics
Additional information gathered by usingonline surveyAdditional information gathered by usingonline survey
Respondent net locationRespondent net location
Unresolved55 (83.3%)Unresolved55 (83.3%)
Commercial4 (6.1%)Commercial4 (6.1%)
Educational 3 (4.6%)Educational 3 (4.6%)
Network2 (3.0%)Network2 (3.0%)
Old Style Arpanet1 (1.5%)Old Style Arpanet1 (1.5%)
Israel1 (1.5%)Israel1 (1.5%)
Descriptive StatisticsDescriptive Statistics
Additional information gathered by using onlinesurveyAdditional information gathered by using onlinesurvey
Respondent OS typeRespondent OS type
Windows 20009 (13.6%)Windows 20009 (13.6%)
Windows NT9 (13.6%)Windows NT9 (13.6%)
Windows 9812 (18.2%)Windows 9812 (18.2%)
Windows 95 3 (4.6%)Windows 95 3 (4.6%)
PowerPC10 (15.2%)PowerPC10 (15.2%)
Macintosh14 (21.2%)Macintosh14 (21.2%)
Linux6 (9.1%)Linux6 (9.1%)
SunOS1 (1.5%)SunOS1 (1.5%)
Unknown2 (3.0%)Unknown2 (3.0%)
Descriptive StatisticsDescriptive Statistics
Additional information gathered by usingonline surveyAdditional information gathered by usingonline survey
Respondent browser typeRespondent browser type
Netscape 5.x3 (4.5%)Netscape 5.x3 (4.5%)
Netscape 4.x32 (48.5%)Netscape 4.x32 (48.5%)
Netscape 3.x1 (1.5%)Netscape 3.x1 (1.5%)
IE Explorer 5.x22 (33.3%)IE Explorer 5.x22 (33.3%)
IE Explorer 4.x5 (7.6%)IE Explorer 4.x5 (7.6%)
IE Explorer 3.x2 (3.0%)IE Explorer 3.x2 (3.0%)
Summary Of DataSummary Of Data
65% teaching faculties using onlinematerials for the course65% teaching faculties using onlinematerials for the course
89% faculties find course web pages veryhelpful or somewhat helpful89% faculties find course web pages veryhelpful or somewhat helpful
No faculties think online course materialsare harmfulNo faculties think online course materialsare harmful
More faculties plan on putting coursematerials online in the futureMore faculties plan on putting coursematerials online in the future
Statistical AnalysisStatistical Analysis
Need more data to do further analysisNeed more data to do further analysis
Known ProblemsKnown Problems
Should have put lecturer in the Title listShould have put lecturer in the Title list
Questions?Questions?