UPDATE - 21st CCLC - Alternative Data Collection Plan
Dear Programs,
As you all may be aware, the Online Data Entry System is not yet online and we do not anticipate activation before the end of this program year. As such, the 21st CCLC Leadership Team has implemented an Alternative Data Collection Plan to collect all data necessary to ensure your 21st CCLC programs fully comply with state and federal requirements for data collection and evaluation. Attached to this email, please find four files - numbered from (1) to (4). The Alternative Plan should make sense if the four documents are read in the recommended order, but please feel free to email me ANY questions that you might have regarding any of these documents or the Plan. As most of you know, we would certainly rather answer questions now than have uninterpretable data later.
Note that there are three forms that have not been addressed in this Alternative Plan, but you should expect an email later this week with instructions for submitting the data from the last three forms.
We thank you all for your patience regarding the Online Data Entry System (ODES). Once activated and uploaded with the data you will be providing over the next weeks, we are certain the ODES will be a tremendous asset to all Florida 21st CCLC programs. All the data you submit using the Alternative Plan will be made available through the ODES by the end of Summer and, more importantly, much of the data you provide now will be used next year (thus reducing the amount of data you will have to enter).
Thank you again for your patience and please do not hesitate to email myself or the Program Evaluation Unit with any questions regarding data collection. If you are unable to open any of the four attachments, please go to http://21stcclc.hhp.ufl.edu and click "log in" to view these four attachements. You will also find the Data Collection Worksheets on this site, some of which might still be useful for collecting data from sites prior to final submission. Note that this website may not be updated with these forms until Monday afternoon.
Best,
Charles Byrd
 |
What is the purpose of evaluating Florida's 21st Century Community Learning Centers programs?
The purpose of evaluation is to examine the quality and effectiveness of Florida’s 21st Century Community Learning Centers programs, while also highlighting the accomplishments of individual programs as per their stated objectives.
- Quality is evaluated in terms of the five objective areas set forth by the Florida Department of Education (i.e., need for project, adequacy of resources, quality of project design, quality of management plan and budget, and quality of project evaluation).
- Effectiveness is evaluated in terms of student outcomes and performance, teacher surveys, and program satisfaction surveys from students and parents.
The ultimate intent of the evaluation is to provide information and direction to program managers, teachers and other practitioners administering Florida's 21st CCLC programs.
What is the method for online data collection?
Evaluation instruments were developed, or adopted for use by, program directors, site coordinators, teachers, participants, and parents. Instrument development was based on a comprehensive review of literature and followed the concepts of the CIPP evaluation model (Stufflebeam et al., 1971; Stufflebeam & Shinkfeld, 1985) and McGee’s (1989) decision-making model. Following development, a panel of research consultants with expertise in measurement, pedagogy, management, and psychology, as well as the Florida Department of Education, examined the relevance, representativeness, and clarity of each instrument.
Currently, evaluation instruments consist of two quarterly forms and twelve annual forms. The quarterly forms are designed to collect data on student academic performance and program participation during a specified quarter of the academic year. The annual forms are each administered once during the academic year. Depending on content, these annual forms are either administered at the beginning, middle, or end of the academic year.
In an effort to aid programs with data submission and to increase the validity of submitted data, all survey forms have been adapted for distribution through a secured online internet server. In addition, all data is entered and submitted directly by individual program directors, site coordinators, teachers, or participants. Such online data collection has allowed programs to view and update submitted data as necessary, reduced potential errors of second-party data entry and coding, and enhanced the integrity and interpretability of submitted data.
What other types of data are collected?
In addition to data collected through written instruments, a team of state evaluators conduct at least two separate visits of each of Florida's 21st CCLC programs operating during the academic school year. Such program visits are intended to validate data submitted online, collect additional data that was not collected through written surveys, and provide an opportunity for immediate feedback regarding program operation. To aid in this process, several interview forms have been developed to provide guidance and enhance consistency of interviews, document reviews, and on-site observations. A more complete description of the methods and data analyses may be requested from Florida's 21st CCLC Program Evaluation office.
|
