Posts

Ongoing Performance Monitoring to Drive Gains in Student Achievement

By Annice Weinstein, Senior Manager, Assessment Data & Analysis

November 2020 

EdTec’s charter school data and assessment experts support school leaders in developing plans to monitor progress on identified measurable outcomes, and schools that follow a defined process have shown considerable gains in student performance.  

Amid all the uncertainty and unexpected changes this school year, it is important not to lose sight of your charter goals for academic achievement and student success, particularly given the current political climate. With some forward planning, you can keep your school on target by defining your measurable outcomes, monitoring progress, and regularly sharing results with your school community throughout the year to reinforce common goals.

Identify Key Measurable Outcomes 

The first step is to identify the primary measurable outcomes for your school. This should include key statewide accountability measures such as state tests, English learner progress, chronic absenteeism, suspension rates, and graduation rates. For academic achievement, consider including measures that can be evaluated throughout the year as well, such as performance on common benchmarks or normed assessments, or measures of course performance like the percentage of students with passing grades in all core courses. Make sure to include measures that are representative of the unique qualities of your charter. For example, set college application/acceptance rates or post-secondary outcomes as a measure for a college preparatory charter, or student survey results if social-emotional growth and a positive school climate are a focus. And remember to engage your stakeholders – teachers, administrators, parents, students – to determine the best measures of success for your students.

Edtec helps charters prepare their student outcome data for presentation at stakeholder engagement meetings.

Create a Cycle of Data Inquiry 

Once your team has identified the key measures for your school, start to map out your calendar of when the data will be available and your schedule of reviewing progress with your stakeholders. The level of analysis will vary depending on the group but do your best to present the same measures to all stakeholder groups. For example, your teachers may take a deep dive into NWEA MAP performance, overall and by strand, for their whole class, groups of students and individual students. For your parents, it may be sufficient to let them know the MAP subjects tested and how students schoolwide are progressing towards an annual target. The frequency of review will also depend on the data type. Chronic absenteeism could be monitored monthly, grades by semester, benchmark tests after each administration, and graduation rates annually. Determine what measures make sense to share at different points throughout the year.

Define the Data Collection Process 

The most complicated part of the process will be determining how you will collect data on key performance measures in a way that allows for a streamlined analysis. For some measures, it’s a matter of tasking a staff member to extract data from your existing systems on a regular basis, such as downloading a state test data file from its reporting system or aggregating attendance data from your student information system (SIS). For custom measures, it helps to house the data in a single online reporting system, such as Otus or Illuminate DnA. If you plan to collect information from each individual teacher, establish templates for data collection to make it easier to aggregate scores across classes.

Using an assessment and learning management system such as Otus can help to streamline the data collection and reporting process.

Plan for Streamlined Reporting 

Finally, think about how you plan to report the information. For example, if you want to know how many of your students are reading at or above grade level by the end of the year, do not just collect students’ raw scores on their reading assessments. Include a field in your template that translates the raw score to a proficiency score of Below Grade Level, Approaching Grade Level, or At or Above Grade Level, so you can easily see how many students are At or Above Grade Level. If you select NWEA MAP performance, it makes more sense to track progress towards a student’s growth target than it does to track whether the student is on grade level, since the system reports focus more on growth than grade level equivalents.

No matter what measures you select, make sure you can also disaggregate the data by significant student subgroups. This is easier to do if you store the data in a system such as Otus or Illuminate DnA, but this analysis can be done manually as well as long as all the data sources include a unique student identifier, such as the SIS student ID or state student ID. Performance of student subgroups can be a key factor in charter renewal decisions, and many charters excel in supporting historically disadvantaged student groups, so it’s good to stay on top of your progress.


EdTec’s data and assessment experts provide NWEA analysis services, Illuminate DnA implementation and customization support, as well as setup and licensing for the Otus Data, Assessment, and Learning Management solution at a low per-student cost. Additionally, we help charters to plan for stakeholder engagement meetings and to present outcome data to stakeholders, authorizers, and the community. Through EdTec’s new partnership with the National Student Clearinghouse®, we offer the StudentTracker® service to charter schools bundled with our robust, charter-specific data services.

If you’re interested in learning more about how we can support your school in these areas, reach out to us at assessment@edtec.com.

Otus logo and images are the property of Otus, LLC and reproduced with permission. 

California Charters, Know the Impact of Participation Rate on Your School’s Academic Indicators!

By Annice Weinstein, Senior Manager, Assessment Data and Analysis

March 29, 2019

In 2018, the California Department of Education added participation rate as a factor into the calculations for the Academic Indicators on the CA School Dashboard. But how exactly does that affect your school?

For both ELA and Math, the goal is to have a participation rate of 95% or higher on the Smarter Balanced Summative Assessments (SBAC) and the California Alternate Assessments (CAAs.) If the participation rate falls below 95%, a fourth of a point (.25) is deducted from the Distance from Standard (DFS) for that subject for each percentage point below the target 95%.

For example, if a school had a participation rate of 91% on the SBAC/CAA ELA and a DFS in ELA of 9:

95% – 91% = 4 (points below the target participation rate)

4 x .25 = 1 (deduction amount from the DFS)

9 – 1 = Adjusted DFS of 8

Participation rate is calculated for every subgroup with 11 or more students and factored into the Academic Indicators for all reported Dashboard subgroups.

The following students are not included in the participation rate calculation: students absent from testing due to a significant medical emergency who are also flagged with the medical emergency condition code on the CAASPP file, and for the ELA portion of the SBAC/CAA, English learners enrolled in a U.S. school for less than one year. Parent waivers do not exempt students from the participation rate calculations.

Schools are also responsible for testing students who transfer in during the beginning 14-day grade period or during the Accountability Testing Window. These students will be included in the participation rate calculation. Schools are not responsible for testing students who transfer in during the ending 14-day grace period or transfer out during the beginning 14-day grace period. However, schools are responsible for testing students who transfer out during the Accountability Testing Window or during the ending 14-day grace period.

To see how participation rate may have affected your school’s Academic Indicators in 2018, schoolwide and for each significant subgroup, enter your school name into the box on this site:

https://public.tableau.com/profile/aweinstein#!/vizhome/2018_Participation_Rate_Impact/ParticipationRateDashboard

CALPADS Update for CA Charter Schools

By Gerald Cockrell, Data and Categorical Program Specialist

September 19, 2018

For California charter schools, it can be hard to stay on top of all the changes to CALPADS. Use the list below as an easy checklist to make sure your school isn’t forgetting anything this year. Check out our previous CALPADS post to see our list of the most important CALPADS reports to prepare for Fall 1.

Important Changes to CALPADS for the 18/19 School Year

  • There are new CALPADS submission certification deadlines for ‘18-‘19 and they are much earlier than previous years. Please plan accordingly, especially for the Fall 1 submission which now ends around Thanksgiving instead of the end of January.
    • Fall 1 Certification Deadline: 11/21/18
    • Fall 1 Amendment Window Deadline: 12/7/18
    • Fall 2 Certification Deadline: 2/1/19 (No Amendment Window)
    • EOY 1 – EOY 3 Certification Deadline: 8/17/19 (No Amendment Window)
  • In addition to the shorter submission windows CALPADS also has a significant outage planned for 9/21-10/01 to make major system changes. Please plan accordingly. It’s also important to get any SSID’s or other information from CALPADS you may need for assessment or ELPAC testing.
  • New students with a non-English primary language must have an ‘18-‘19 enrollment record and a “TBD” SELA record in CALPADS in order for them to show up in TOMS and be tested with the Initial ELPAC.
  • This update is not new, but it is important enough to warrant an annual reminder: all National School Lunch Program (NSLP) Free and Reduced Price Meal (FRPM) applications for the year MUST BE RECEIVED BY 10/31/18 for the student eligibility to count towards your official FRPM or LCFF Unduplicated counts.

To help you prepare for Fall 1 and make sure your charter school’s data is accurate for funding and accountability, check out our previous CALPADS post about the most important CALPADS reports.

Keep Calm and Review Your CALPADS Reports!

By Gerald Cockrell, Data and Categorical Program Specialist

November 13, 2017

Given the large amount of data reported for CALPADS Fall I, and the multitude of certification reports available, it can be difficult to determine which data are the most important and where to find them!  To help ease the frustration, we’ve created a list of the most important reports and included detail about the information each report contains and who should be reviewing them.

[table id=1 /]

There are many other reports available as well, but starting with the ones listed in this table will provide a clear view of the data that affect your funding and accountability.  As a reminder, special attention should be paid to FRPM data, EL data, and high school graduate data.

If you have any concerns about the data being reported for Fall I, feel free to reach out to EdTec’s data team to discuss how we can help. You can reach Gerald at gerald.cockrell@edtec.com, or 213.292. 6620 x414.