Kids

Oklahoma’s Universal Preschool Program: Better Than OK

By William T. Gormley, Jr.

Over the past decade, my colleagues and I have produced a series of peer-reviewed articles evaluating the effectiveness of Oklahoma’s universal pre-K program, which President Obama praised in his State of the Union Address. Oklahoma’s program, established in 1998, now reaches approximately three-fourths of the state’s four-year-olds. The “Sooner State” has decided that sooner is better than later when it comes to early childhood education.

Our research has focused on Tulsa, the largest school district in the state. The Tulsa school district was an attractive research site because it serves children from diverse racial and ethnic groups.

When we first visited Tulsa, we had reason to believe that the Tulsa pre-K program would be successful. Unlike many other preschool programs, Oklahoma mandates high quality, at least in terms of educational inputs: every lead teacher must have a B.A. degree, must be early childhood certified, and must be paid a public school wage. A child-staff ratio of 10/1 ensures that each child receives personal attention.

As it turns out, our hunch was correct. In fact, the Tulsa pre-K program has generated phenomenal improvements in school readiness. If we look at students as a whole, kindergarten students who attended the Tulsa pre-K program are 9 months ahead of their peers in reading, 7 months ahead in writing, and 5 months ahead in math.

Both disadvantaged and middle-class students experience statistically significant and substantively significant gains in test scores. Disadvantaged students benefit more, but middle-class students also benefit considerably.

Gains are especially striking for English language learners – specifically, Hispanic students whose parents were born in Mexico. For Hispanic children whose parents primarily speak Spanish at home, pre-K participants scored 12 months better than their control group in reading, 4 months better in writing, and 10 months better in math. We also see statistically significant and substantively significant gains in test scores for whites, blacks, and Native Americans.

Thanks to an in-depth investigation of preschool classrooms, we know that what is happening in Tulsa is not magic – it is good, solid teaching. Using Robert Pianta’s instrument for observing classroom dynamics, we found that Tulsa’s pre-K teachers provide higher levels of “instructional support” than their counterparts in school-based pre-K programs in 11 other states. Using another instrument, we found that Tulsa’s pre-K teachers devote more classroom time to reading and math than their counterparts elsewhere.

We also know that the Tulsa pre-K program is producing some socio-emotional impacts. In concrete terms, we found that kindergarten students who participated in pre-K were more attentive and less timid than kindergarten students who did not participate in pre-K. Unlike some national child care studies, we found that participation in the Tulsa pre-K program produced no negative socio-emotional effects.

Since our studies were published, we have received many questions, some praise, and some criticism.

One persistent criticism is this: if Oklahoma’s pre-K program is so fantastic, then why haven’t Oklahoma’s NAEP scores increased sharply as a result? Shikha Dalmia and Lisa Snell of the Reason Foundation and Lindsey Burke of the Heritage Foundation have raised this question, noting that 4th grade reading scores have actually declined in Oklahoma since universal pre-K was introduced.

The first problem with this critique is that NAEP scores are more useful for describing state and national trends than for evaluating state policy interventions. Sweeping conclusions about  preschool based on NAEP data ignore other public policies that profoundly affect the performance of Oklahoma’s school students. One of these is the level of state funding for K-12 education.  Whereas Oklahoma ranks extremely high in both pre-K access and pre-K quality, it ranks extremely low (in the bottom five nationally) in financial support for K-12 public schools. Without a substantial infusion of state funds, it would be difficult, though not impossible, for Oklahoma to improve its 4th and 8th grade test scores.

A second problem with the critique is more subtle. It assumes that an intervention, like a pre-K program, will produce 4th grade effects as soon as the first cohort of participants reaches 4th grade. Unfortunately, 4th grade test scores depend not just on exposure to pre-K but also on any changes in pedagogy that take place in K-3 classrooms. In practice, it probably takes a while for K-3 teachers to adjust their habits and expectations to reflect the new surge in pre-K enrollments. Our latest evidence from Tulsa is consistent with this hypothesis.  When we investigated the persistence of positive pre-K program effects on 3rd grade test scores for the earliest cohort in our data base (students who participated in pre-k in 2000-01), we found no difference between pre-K participants and non-participants. However, when we investigated this for our latest cohort (students who participated in pre-K in 2005-06), we did find persistent differences between pre-K participants and non-participants through 3rd grade. In short, it takes a few years for a school system to adapt to the potentially powerful changes wrought by a high-quality pre-K program.

A different criticism of our Tulsa findings is that our research design falls short of the high standards established by randomized experiments, such as the Perry Preschool and Carolina Abecedarian Projects. The rigorous research design we employed, considered novel at the time, was a “regression discontinuity” strategy for estimating the effects of early childhood education, which took advantage of a strict September 1 birthday cutoff for determining preschool eligibility. By comparing children whose parents decided to enroll them in the school-based pre-K program but who differed in their date of birth, we were able to focus exclusively on students who had just completed pre-K and on students who were about to begin pre-K. This is an excellent way to reduce “selection bias” because the treatment group and the control group both participated in the same pre-K program, albeit at different times.

Of course, we also controlled for each student’s precise date of birth, because older students generally do better on standardized tests than younger students, and for many other variables as well.

To some critics, like Grover Whitehurst of the Brookings Institution, our regression discontinuity design is problematic. Whitehurst cites the hypothetical example of two adopted children who are roughly similar in age but one qualifies for pre-K a year earlier than the other. Won’t parents try to give the slightly older child cognitive and play experiences that help him or her to keep up with older peers at school? If so, it might not be fair to compare the two children.

This is a reasonable hypothesis, but it is only that. The opposite hypothesis, suggested by others, would be that parents focus more assiduously on the child who just missed the pre-K cutoff, in an effort to compensate for delayed entry into preschool.

The bottom line is that our treatment group children and our control group children are strikingly similar in their observable characteristics, even before applying statistical controls. This suggests that our regression discontinuity design is working and working well.

Although we strongly prefer our regression discontinuity approach when studying short-term effects, we have also utilized other techniques, like OLS regression and propensity score matching, to estimate our model. Whichever technique we use, the positive effects of the Tulsa pre-K program are clear and unmistakable.

Because students from recent pre-K cohorts in Tulsa have not yet become adults, it is impossible to say for sure whether the changes wrought by Oklahoma’s universal pre-K program will eventually yield higher earnings and other favorable outcomes. However, by integrating Tulsa kindergarten test scores with Tennessee data linking kindergarten test scores to adult earnings, we have projected that the adult earnings benefits of the Tulsa pre-K program are likely to exceed the costs by 3 to 1 or 4 to 1. Were we to include criminal justice effects, the benefit-cost ratio could be even higher.

There is much more to be learned from Oklahoma, Georgia, Chicago, Boston, and other research sites where high-quality pre-K programs have been made available to large numbers of students. Scholars and activists should continue to scrutinize the empirical research on early childhood education. At the same time, we should not allow skeptics to blind us from the central message of many well-designed empirical studies: a high-quality preschool education benefits children in the short run, especially disadvantaged children, and benefits society as a whole in the long run. That is the key insight animating President Obama’s universal pre-K initiative, and it has been validated by plenty of credible scientific research.

William T. Gormley, Jr. is professor of public policy at Georgetown University and has served as the Co-Director of the Center for Research on Children in the U.S. since 2001.

Share/Bookmark


About

Celebrating its 20th anniversary, the Georgetown Public Policy Review is the McCourt School of Public Policy’s nonpartisan, graduate student-run publication. Our mission is to provide an outlet for innovative new thinkers and established policymakers to offer perspectives on the politics and policies that shape our nation and our world.


'Oklahoma’s Universal Preschool Program: Better Than OK' have 14 comments

  1. May 7, 2014 @ 2:02 pm Lessons for K-12 From Pre-K Classrooms | Perspectives | BillMoyers.com

    […] the same time, new data from high-quality state pre-K programs – Oklahoma’s universal pre-K, New Jersey’s Abbott program and Boston Public Schools’ pre-K – echo early benefits seen in […]

    Reply

  2. September 18, 2014 @ 2:20 pm search

    I usually do not write many responses, however i did a few searching and wound
    up here Georgetown Public Policy Review / Oklahoma’s Universal Preschool Program:
    Better Than OK – Georgetown Public Policy Review.

    And I actually do have 2 questions for you if you do not mind.
    Could it be just me or does it seem like a few of these
    responses look as if they are written by brain dead people?
    :-P And, if you are writing on additional places, I’d
    like to follow anything fresh you have to post. Would you list of all of your shared pages like your Facebook page,
    twitter feed, or linkedin profile?

    Reply

  3. September 19, 2014 @ 10:28 pm insolent means

    I think what you said made a ton of sense.
    However, think on this, what if you added a little information? I ain’t suggesting your content isn’t solid., however suppose you added something to possibly get folk’s attention?
    I mean Georgetown Public Policy Review / Oklahoma’s Universal Preschool Program:
    Better Than OK – Georgetown Public Policy Review is a
    little vanilla. You could glance at Yahoo’s home page and
    watch how they create article headlines to get viewers to click.
    You might try adding a video or a related pic or two to grab readers
    interested about what you’ve got to say. Just my opinion, it
    would make your posts a little bit more interesting.

    Reply

  4. September 20, 2014 @ 12:44 am cell phone spy yahoo answers

    Nice blog here! Also your site loads up fast! What web host are you using?
    Can I get your affiliate link to your host? I wish myy site loade uup aas fast as yours lol

    Reply

  5. September 20, 2014 @ 6:02 am www.lognip.com

    Hi colleagues, its fantastic paragraph regarding teachingand completely defined,
    keep it up all the time.

    Reply

  6. September 20, 2014 @ 6:44 am dukan diet starts

    Please let me know if you’re looking for a
    writer for your blog. You have some really good articles and I think I would be a good asset.
    If you ever want to take some of the load off, I’d absolutely
    love to write some articles for your blog in exchange for a
    link back to mine. Please shoot me an e-mail
    if interested. Regards!

    Reply

  7. September 21, 2014 @ 12:45 am dich vu ban ve may bay

    I used to be recommended this website by way of my cousin. I’m not certain whether this put up is written by way of him as nobody else know such certain approximately my difficulty.
    You’re wonderful! Thanks!

    Reply

  8. September 21, 2014 @ 3:44 am breeze blocks

    Oh my goodness! Awesome article dude! Thank you, However I am having
    difficulties with your RSS. I don’t know the reason why I can’t
    join it. Is there anyone else having identical RSS issues?
    Anybody who knows the answer will you kindly respond? Thanx!!

    Reply

  9. September 21, 2014 @ 5:25 am Michel

    First off I want to say excellent blog! I had a quick question which I’d
    like to ask if you do not mind. I was curious to find out how you center yourself and clear your mind prior to writing.

    I have had a hard time clearing my thoughts in getting my ideas out
    there. I truly do take pleasure in writing however it just seems like the first 10 to 15 minutes are generally wasted simply just trying to figure out how to
    begin. Any suggestions or hints? Appreciate it!

    Reply

  10. September 22, 2014 @ 11:53 am ummahglobalrelief.com

    What i don’t realize is in truth how you are no longer actually much more smartly-favored than you may be
    right now. You’re very intelligent. You recognize thus considerably in terms of
    this matter, made me individually believe it from numerous various angles.
    Its like women and men aren’t involved until it is something to do with Lady gaga!

    Your individual stuffs outstanding. All the time deal with it up!

    Reply

  11. September 22, 2014 @ 12:29 pm supercell all games

    This article gives clear idea for the new users
    of blogging, that truly how to do blogging.

    Reply

  12. September 22, 2014 @ 2:31 pm Spencer Lodge

    Hmm it seems like your website ate my first comment (it was
    super long) so I guess I’ll just sum it up what I had written and say, I’m thoroughly enjoying your blog.
    I too am an aspiring blog writer but I’m still new to the whole
    thing. Do you have any recommendations for beginner blog writers?
    I’d genuinely appreciate it.

    Reply

  13. September 22, 2014 @ 3:21 pm Gluten-Free life

    Please let me know if you’re looking for a author
    for your blog. You have some really good posts and I think I would be a good asset.
    If you ever want to take some of the load off, I’d
    love to write some content for your blog in exchange for a
    link back to mine. Please shoot me an e-mail if interested.
    Thanks!

    Reply

  14. September 23, 2014 @ 3:57 am Rueben

    Hello everyone, it’s my first visit at this web site,
    and paragraph is really fruitful designed for me, keep up
    posting such articles or reviews.

    Reply


Would you like to share your thoughts?

Your email address will not be published.