University of West Georgia
Index of DE Evaluation Documents and Use of Assessment Results to Make Improvements
I. Distance and
Distributed Education CenterCourse Evaluations and Evaluation Summaries prepared by DE Faculty:
In order to strengthen UWG’s distance and distributed learning programs, separate evaluations have been developed for distance courses. These evaluations specifically address issues to ensure that the technology used is appropriate, and that students are satisfied with their learning experiences. Each term a Student Evaluation is distributed to all students enrolled in distance learning courses. The evaluation is made available online to those enrolled in web-based courses. Fall 2003 and prior, paper copies were distributed to those enrolled in GSAMS courses. The evaluations were developed by the Distance Learning Administrator and a team of faculty experienced in distance teaching. Evaluation results, including a compilation of student comments, are reported to each department chair, and then forwarded to the respective faculty.
Approved by the UWG Faculty Senate for Fall 2001, all distance faculty are sent a form along with the results of their distance course surveys (see table Ic. below). The Evaluation Summary for Distance Courses form asks that the faculty provide written documentation reflecting on their DE course evaluation results and how the students' feedback will be used for improvement. The Distance and
Distributed Education Centerretains copies of all evaluations. Data collected is used to help determine which courses need to be offered, the effectiveness of the interaction, and how training and support services can be improved.
Our university’s selected online course delivery tool, CourseDen (formerly called WebCT), also allows for formative assessment and evaluation by the instructor, who can track student usage patterns. The Office of Institutional Research and Planning compiles data enabling comparisons of grades and retention rates of distance courses to campus classes.
Ia. GSAMS (2-way videoconferencing) Course Evaluation Data
Ib. CourseDen/WebCT (online) Course Evaluation Data
|Summer 2009 Aggregate Results||Fall 2009 Evaluation Document||Fall 2009 Aggregate Results|
|Spring 2010 Evaluation Document||Spring 2010 Aggregate Results|
|Summer 2010 Evaluation Document||Summer 2010 Aggregate Results|
|Fall 2010 Evaluation Document||Fall 2010 Aggregate Results|
|Spring 2011 Evaluation Document||Spring 2011 Aggregate Results|
|Summer 2011 Evaluation Document||Summer 2011 Aggregate Results|
|Fall 2011 Evaluation Document||Fall 2011 Aggregate Results|
|Spring 2012 Evaluation Document||Spring 2012 Aggregate Results|
|Summer 2012 Evaluation Document (Sample course survey) [PDF}||Summer 2012 Aggregate Results|
|Fall 2012 Evaluation Document (Sample course survey) [PDF}||Fall 2012 Aggregate Results|
|Spring 2013 Evaluation Document [PDF}||Spring 2013 Aggregate Results|
|Summer (May) 2013 Evaluation Document [PDF}||Summer (May) 2013 Aggregate Results|
|Summer (July) 2013 Evaluation Document [PDF}||Summer (July) 2013 Aggregate Results|
|Fall 2013 Evaluation Document [PDF]||Fall 2013 Aggregate Results|
|Summer 2004 DE Course Evaluation Summary Form||Summer 2004 Compiled Results of Eval. Summaries and Actions to be Taken|
|Fall 2004 DE Course Evaluation Summary Form||Fall 2004 Compiled Results of Eval. Summaries and Actions to be Taken|
|Spring 2005 DE Course Evaluation Summary Form||Spring 2005 Compiled Results of Eval. Summaries and Actions to be Taken|
|Summer 2005 DE Course Evaluation Summary Form||Summer 2005 Compiled Results of Eval. Summaries and Actions to be Taken|
|Fall 2005 DE Course Evaluation Summary Form||Fall 2005 Compiled Results of Eval. Summaries and Actions to be Taken|
|Spring 2006 DE Course Evaluation Summary Form||Spring 2006 Compiled Results of Eval. Summaries and Actions to be Taken|
|Summer 2006 DE Course Evaluation Summary Form||Summer 2006 Compiled Results of Eval. Summaries and Actions to be Taken|
|Fall 2008 DE Course Evaluation Summary Form||Fall 2008 Compiled Results of Eval. Summaries and Actions to be Taken|
|Spring 2009 DE Course Evaluation Summary Form||Spring 2009 Compiled Results of Eval. Summaries and Actions to be Taken|
|Summer 2009 DE Course Evaluation Summary Form||Summer 2009 Compiled Results of Eval. Summaries and Actions to be Taken||Fall 2009 DE Course Evaluation Summary Form||Fall 2009 Compiled Results of Eval. Summaries and Actions to be Taken|
|Spring 2010 DE Course Evaluation Summary Form||Spring 2010 Compiled Results of Eval. Summaries and Actions to be Taken|
|Summer 2010 DE Course Evaluation Summary Form||Summer 2010 Compiled Results of Eval. Summaries and Actions to be Taken|
|Fall 2010 DE Course Evaluation Summary Form||Fall 2010 Compiled Results of Eval. Summaries and Actions to be Taken|
|Spring 2011 DE Course Evaluation Summary Form||Spring 2011 Compiled Results of Eval. Summaries and Actions to be Taken|
|Summer 2011 DE Course Evaluation Summary Form||Summer 2011 Compiled Results of Eval. Summaries and Actions to be Taken|
|Fall 2011 DE Course Evaluation Summary Form||Fall 2011 Compiled Results of Eval. Summaries and Actions to be Taken|
|Spring 2012 DE Course Evaluation Summary Form||Spring 2012 Compiled Results of Eval. Summaries and Actions to be Taken|
|Summer 2012 DE Course Evaluation Summary Form||Summer 2012 Compiled Results of Eval. Summaries and Actions to be Taken|
|Fall 2012 DE Course Evaluation Summary Form||Fall 2012 Compiled Results of Eval. Summaries and Actions to be Taken|
|Spring 2013DE Course Evaluation Summary Form||Spring 2013Compiled Results of Eval. Summaries and Actions to be Taken|
II. Campus-wide Student Evaluations
Courses offered through Distance Education are also evaluated by a campus-wide "Student Evaluations Instrument" ( see SEI here). The form ask students to evaluate all disciplines on a systematic basis regarding course strengths, weaknesses, and suggestions for improvements. It is the instructor's responsibility to either conduct the SEI in a face-to-face session or to request that the DDEC post the SEI in the alternate online format.
III. eCore Assessments are conducted and data maintained, by the central University System of
's GeorgiaVIEW Office. Georgia
UWG is one of only four host institutions for the University System of Georgia's eCore program. The eCoreŽ are core curriculum classes taught on the Web. Core classes are typically classes required during the first two years of a college degree. Not all core curriculum classes will be available as eCoreŽ. See this USG website for specific details on the eCore program: http://ecore.westga.edu/
UWG's eCore Enrollment, by semester, for Fall 2000 through Fall 2006 is available here: http://alt.usg.edu/research/ecorestats/enrollment/graphs/flash_content/suwg.html
Data from eCore ™ Student Services Questionnaire & Data from eCore ™ Student Profile Survey is available here: http://www.alt.usg.edu/research/studies/
IV. Distance Students Focus Groups & Random Phone Surveys
Beginning Spring 2002, the Distance & Distributed Ed Center conducted bi-annual focus groups comprised of randomly selected focus groups. Students were given the option to travel to campus for an interview or participate via e-mail. Random phone surveys of distance students are sometimes conducted, in lieu of focus groups.
The purpose of the focus groups and phone surveys is to evaluate the current satisfaction of distance students with student services and development services, and to discover what improvements should be made to promote a greater sense of community and belonging. Results from these focus groups and phone surveys will be used to improve the DE courses at UWG.
Spring 2002 Distance Students Focus Group Results
Fall 2002 Distance Students Focus Group Results
Spring 2003 Random Phone Survey of Students & Results
Spring 2004 Random Phone Survey of Students & Results
Spring 2005 Random Phone Survey of Students & Results
Spring 2006 Random Phone Survey of Students & Results
Summer 2007 Distance Students Focus Group Results
Spring 2008 Random Phone Survey of Students & Results
Spring 2010 Random Phone Survey of Students & Results
Spring 2011 Random Phone Survey of Students & Results
Spring 2012 Random Phone Survey of Students & Results
Summer 2013 Random Phone Survey of Students & Results
V. Faculty Distance Learning Assessment
A "Faculty Distance Learning Assessment," was distributed to UWG faculty early fall 1998 semester to measure faculty acceptance of distance education and to determine what factors motivate and inhibit distance participation. Faculty who had used WebCT for distance teaching were significantly more positive than those who had only used GSAMS. The primary factors inhibiting faculty participation in distance teaching were concern for course quality and workload. Motivating factors tended to more often be intrinsic (challenge, desire to keep up) for those who had distance teaching experience and extrinsic (release time, monetary reward) for those who had not. Results were use to determine how the
DDE Centercould improve the quality of support services for DE faculty. See: http://www.westga.edu/~distance/attitudes.html
The DDEC began using Remedy, a help-desk tracker, in January 2003, to enable us to identify patterns of support needs, including peak times, common problems, as well as satisfaction with support services.
All telephone and email support calls from faculty and students received by distance learning are logged into the system.
VII. Quality Assurance Procedures
1. All courses and support for distance and distributed education at UWG will comply with the standards of the Southern Regional Electronic Campus and the BOR.
2. Distance courses, either credit, or non-credit must have comparable student learning as programs on campus. All distance courses must be complete and coherent, with provisions for appropriate interaction among faculty and students, and appropriate course supervision.
3. Responsibility for assuring compliance with standards falls under the auspices of the Distance Education Director (IDEA).
4. Formal evaluation of student satisfaction and perceived learning in DE courses is conducted each term by the DDE. Periodic (annual or semi-annual) evaluation of faculty satisfaction and training is conducted by the DDE.
5. An annual review and updating of standards and goals is conducted each summer by the DDE staff.
6. A Distance & Distribted Education Steering Committee meets at least four times per year to discuss distance planning and policies that impact the university as a whole. The group is composed of 22 members which include the DDE staff and various campus faculty and staff involved with current distance education issues. Current members include the DDE staff (Melanie Clay, Janet Gubbins, Christy Talley and Stacey Rowland); department faculty/program chairs (Will Lloyd, Elizabeth Bennett, Barbara McKenzie, Mary O'Neill, John Fuller, Ara Volkan, Tom Padgett, Micheal Crafton); Library representative (Carol Goodson, Shirley Lankford); central ITS representatives (Kathy Kral, Mike Russell, Brian McCrary); college IT representatives (Diane Williamson, Matthew Clay) , Director of Institutional Research and Planning (Andrew Luna), Special Program Staff (Paul Smith) and Director (Donald Wagner). Other members are invited to join transient sub-groups as issues arise.
VIII. DDEC Standards Arising From Evaluation Feedback, Faculty Study, and DE Workgroup Issues
1. Scheduling for all UWG GSAMS rooms is the responsibility of the distance education staff.
2. Priority for GSAMS rooms will be given to credit courses, then non-credit courses, then school meetings, and then other business.
3. All GSAMS meetings require the presence of a distance staff member or facilitator. Exceptions require the approval of the distance education coordinator.
4. The Distance Education/Honors Computer Lab will be maintained and staffed jointly by the
Distance Education Center, the Advanced Academy, and the Honors Program. Priority for use of the room will be for distance training purposes, followed by Honors Student academic use.
5. Schedule for GSAMS room will be maintained and available on Google Calendar.
1. A help-line will be available for students who need assistance with technical problems, registration, advisement, or other information related to distance and distributed courses.
2. Online resources for students will include a CourseDen (WebCT) tutorial, a handbook for distance students, and schedules of upcoming distance courses.
3. Other services for distance students will be coordinated, evaluated, and revised with the registrar, the bookstore, admissions, and other campus services.
4. All advising, informational and registration materials will clearly and accurately represent the nature and technical skills necessary for each distance course.
1. All messages received on telephone help-line will be returned within 24 hours (Monday through Friday).
2. Telephone helpers will respond in a calm and courteous manner.
3. If unable to solve problem, ask for student/faculty e-mail address and phone number. Either research problem or refer to appropriate department. Follow up within 7 days to make sure that problem is solved.
4. Reports of all "new" problems and solutions will be forwarded to Distance Education director.
1. The telephone help-line will be available to faculty.
2. All faculty support will be conducted in a courteous, customer-oriented manner.
3. Faculty will receive full course development assistance as requested during their first term of teaching via the internet.
4. Certificates of recognition will be awarded to outstanding distance faculty at the end of each term.
5. An end-of-the term report, recognizing distance faculty efforts and specific achievements, will be emailed to distance faculty, their department heads, deans, and vpaa at end of each term.
6. A "Distance Faculty Appreciation Day" will be sponsored annually by the
Distance Education Center.
7. A distance library will be maintained in the
Distance Education Centerwith books, periodicals, training videos, and periodicals available for checkout by staff and faculty.
1. All courses and support for distance education at UWG will comply by the standards of the Southern Regional Electronic Campus.
2. Distance courses, either credit or non-credit, must have comparable student learning as programs on-campus. All distance courses must be coherent and complete, with provisions for appropriate interaction among faculty and students, and appropriate course supervision.
3. Responsibility for assuring compliance with standards fall under the auspices of the distance education coordinator.
1. An annual review, evaluation, and updating of standards, goals, and progress will be conducted annual each August by distance staff.
2. All full-time and part-time staff will submit monthly progress and planning reports to distance education director via email by last day of month.
3. The distance learning steering committee, composed of distance staff and various campus faculty and staff, will meet at least two times per year to discuss distance policies and planning that impact university as a whole.
1. Student assistants will provide technical support for all GSAMS classes, professional development webinars, and online courses using CourseDen/WebCT.
2. Before beginning helpdesk work, SAs will have completed at least 2 hours of training (including fax, computer, and softboard); and an online CourseDen/WebCT tutorial.
3. An experienced SA will monitor the beginning SA during his or her first one-on-one session with an instructor or student.
4. All SAs are expected to attend periodic meetings, training sessions, and other events representing UWG distance education.
1. A campus newsletter (now an online blog) including updates and distance faculty profiles will be distributed by each quarter.
2. All web site information will be reviewed on first Monday of each month.
3. Responses to outside inquiries regarding UWG distance education will be made by phone, e-mail, or postal mail within 7 days.
4. A file of all publicity and newspaper articles will be maintained in distance education library.
5. Full-time distance staff will write at least two articles per year for release as press releases, juried articles, or conference presentations.
1. All online faculty must receive at least 2 hours of personal training prior to beginning any type of online course.
2. First-time online faculty will receive support in course development (in DL lab) as needed.
3. Veteran faculty will receive support through additional hands-on training sessions.
4. A distance education orientation for new faculty will be conducted each September.
1. A database of all distance and distributed courses, dates, department, enrollments, and evaluation results will be updated each term and will reside on the Honors House server. A backup copy will also be maintained.
2. Online course proposal forms (paper copies) will be kept permanently in distance education files.
3. Course evaluation data (distance courses) will be kept for one year. Summaries will reside herein.
UWG|Online (a.k.a. UWG Distance & Distributed Education Center)
Maple Street, Carrollton, Georgia30118
Phone: 678-839-6248; Fax: 678-839-0636 EMail: email@example.com
Last updated: October 1, 2013 by Shawn Nix