Measuring the success of Ed Tech: Not all about test scores

Measuring the success of Ed Tech: Not all about test scores

Summary: Sometimes, technology gets thrown at struggling schools as a panacea for a variety of ills with predictably bad results. How should we be measuring those results, though, in the schools that are doing it right?

SHARE:

The New York Times ran a feature on Saturday called "In Classroom of Future, Stagnant Scores". The article is part of a series called "Grading the Digital School" and asked some tough questions about whether technology in schools can actually improve student achievement. Most significantly, it pointed to the lack of hard data around the quantifiable success of investing in technology-rich schools. While we have a responsibility to ensure that technology is adding value in schools, I'm inclined to believe that the lack of supporting data is the result of poor measures rather than poor results.

As noted in the article,

Since 2005, scores in reading and math have stagnated in Kyrene [the Arizona school district featured as an example of a technology-rich environment], even as statewide scores have risen.

To be sure, test scores can go up or down for many reasons. But to many education experts, something is not adding up — here and across the country. In a nutshell: schools are spending billions on technology, even as they cut budgets and lay off teachers, with little proof that this approach is improving basic learning.

Let me start by saying that I've seen too many technology implementations in schools that add no real educational value, but take a nice dent out of taxpayer wallets. There are plenty of ways to go about making a school "technology-rich" that actually take away from the real business of learning. When rollouts are half-hearted, teachers and parents don't completely embrace the approach, students and teachers lack accountability, and teachers aren't provided with the right training and coaching, then schools end up buying a lot of expensive toys. eSchool News recently highlighted schools in New Mexico that are saddled with hefty repair bills and failing, aging, abused computers from their 1:1 efforts.

I am not in the give-everyone-computers-and-watch-them-succeed camp.

However, I wouldn't be in the business of Ed Tech if I didn't think that the potential existed for kids to learn in new, engaging ways that prepared them for real-world challenges and managed to better differentiate instruction so that every student could be better served in our public schools. What's happening in a district like Kyrene where everything seems to be happening the way educational technologists believe it should? Kyrene has solid community investment, good teacher buy-in, and progressive techniques. Why aren't standardized test scores following?

On counterpoint in the article sounded fairly familiar:

Karen Cator, director of the office of educational technology in the United States Department of Education, said standardized test scores were an inadequate measure of the value of technology in schools. Ms. Cator, a former executive at Apple Computer, said that better measurement tools were needed but, in the meantime, schools knew what students needed.

It would be nice to think that schools know what kids need, but we also need to find ways to measure the more intangible skills that students acquire using technology in relevant and (I believe) powerful ways. We see technology breaking down barriers to collaboration, improving writing and criticism, providing software that differentiates instruction and gives real-time feedback to teachers on student strengths and weaknesses, and allowing teachers to guide students through rich and varied resources. Standardized tests, all too often, measure students' abilities to take tests.

Some of the best standardized tests get at students' critical reasoning skills and their ability to tease out abstract concepts from real-world problems. Even these, though, may not be aligned with the way students are learning, particularly in more constructivist settings where technology enables a different kind of creativity. And even in states with tests widely acknowledged as "good", most students will see short-term bumps when schools teach to the test.

Real learning, the sort that many hope will happen in technology-rich environments, is rare when curricula are closely aligned with test materials. Don't get me wrong - Alignment is the name of the game and tests should assess what students are learning. Too frequently, though, schools tweak and rework their curricula based on minute analyses of yearly test items. Those schools that delve deeply into subjects may find their scores for the year distinctly lacking, even if their students are richer for the deep dive. Imagine, for example, a school-wide, year-long focus on statistics and data analysis, where students use spreadsheets, scientific probes, online surveys and other tools to really explore the world around them. Invariably, scores relating to measurement, statistics, expository writing, and reporting will improve overall. However, there won't be time that year to teach 27 other standards in English and math, no matter how many important skills and concepts students take with them.

The tests will also not measure the ability of students to manage projects independently or search the web for research materials, both of which would have been key outcomes of the project-oriented learning I described above.

Yes, we need better tests. And we need data about the real value of tech in the classroom. But more than that, we need research into pedagogy that supports the use of tech in the classroom. We need students to focus on developing portfolios rather than racking up test scores. We need students to know how to tackle a project when they encounter one (and not just Google "statistics" but really manage resources and develop and implement a plan). And we need teachers to not just have a day of professional development before school starts on how to have kids use Google Docs; they need ongoing coaching from experts in the field to ensure that all of these technology investments are adding real value, even if the tests left over from NCLB don't have the chops to assess that value.

Topics: Google, Apple, Collaboration, Software

Christopher Dawson

About Christopher Dawson

Chris Dawson is a freelance writer, consultant, and policy advocate with 20 years of experience in education, technology, and the intersection of the two.

Kick off your day with ZDNet's daily email newsletter. It's the freshest tech news and opinion, served hot. Get it.

Talkback

6 comments
Log in or register to join the discussion
  • RE: Measuring the success of Ed Tech: Not all about test scores

    Besides this being a great read, it gives true insight on the tech problem for education! You don't replace teachers for technology. Tech should help us to train and educate better....but therefore we need well trained teachers who embrace tech, AND ready for new learning paradigm where you play a double rol, one being a teacher, transferring and stimulering knowledge, one being a coach guiding, inspireing and training students....and technologie really can help. But this also means you have to rethink evaluation; it's not testing pure knowledge anymore, it's about the way we use tech and knowledge to become learning human being!
    Flatworldbusiness
  • RE: Measuring the success of Ed Tech: Not all about test scores

    Technology is all well fine and dandy, but that's only if it's being put to good use. In my college, we had access to all sorts of technology and web tools. The problem was, none of the instructors knew how to utilize it properly. Out of all the classes I took before I graduated, maybe a fourth of them made use of the system beyond posting a syllabus online, with maybe a quarter of that number actually using it well. And in a rather odd twist, the Computer Science professors were the absolute worst of these. Most of my professors seemed to have problems finding their way around the OS (Compsci ones included), which just makes all of the fancy technology around campus a bit useless. I realize college is a bit out of scope for this article, but just wanted to throw in my two bits.

    Though to be fair, I had a High School EAST Lab that never accomplished anything as well. The "Facilitator" there was inept as well. I can still remote log on to his administrator account 5 years later.
    Aerowind
  • RE: Measuring the success of Ed Tech: Not all about test scores

    Great article. It is true that if technology is not implemented properly, students and teachers will not realize its full potential. As a professional, I cannot imagine what I would do if I did not know how to create a PPT, interact with coworkers around the world, or have access to the vast resources outside of the classroom walls that technology allows. We are going to discuss this with many leaders in education, technology and policy that are leading the charge in creating the 21st century classroom. Registration is still open and free - Washington, DC October 20-21: www.wirelessedtech.com.
    Sharlal
  • RE: Measuring the success of Ed Tech: Not all about test scores

    <p><a href="http://www.coachfactoryoutletcenter.com" title="coach factory outlet"><h1><strong>coach factory outlet</strong></h1></a> is really sizzling kinds of shopping way for you. With the usage of the replica designer coach bags, you can surely be able to change your individual looks in a stunning manner.discount coach handbags, leaders and affordable for the American luxury brand known to create attractive designer <a href="http://www.coachfactoryoutletcenter.com" title="coach outlet"><h1><strong>coach outlet</strong></h1></a> online store and accessories.<a href="http://www.coachfactoryoutletcenter.com" title="coach factory outlet online"><h1><strong>coach factory outlet online</strong></h1></a> provides people many coach goods. If you wish to snatch the coach handbag, then this best method is made for that you like for coach discount.<a href="http://www.coachfactoryoutletcenter.com" title="coach factory outlet store"><h1><strong>coach factory outlet store</strong></h1></a> sell the products which are classical design for stylish ladies. The pretty shape and bright color of the wallet is full of fashion elements to show your unusual identity.Besides,the soft leather and well-made handle give you a really unique appearance in any occasion.</p><p>If you need practical, fashionable and well-known <a href="http://www.coach--purses.com" title="coach purses"><h1><strong>coach purses</strong></h1></a>, you can consider to choosing on the Coach Outlet. Its nice and popular design will make you feel a sense of fresh air.If you do not know design can be the most fashionable this fall, consider a glance on <a href="http://www.coach--purses.com" title="coach factory outlet"><h1><strong>coach factory outlet</strong></h1></a>! This summer, you have a wide range of options, because there are numerous designs, you can find from.Becoming a regular member of <a href="http://www.coach--purses.com" title="coach outlet online"><h1><strong>coach outlet online</strong></h1></a>, you can even buy wholesale purses, handbags, leather wallets at preferential prices. Why not have a try?Remember the <a href="http://www.coach--purses.com" title="coach outlet"><h1><strong>coach outlet</strong></h1></a> provide coach bags which won't be deteriorated into its overall styles by any means. It will maintain its looks, colors, and uniqueness for long time.</p><p>Using a range of quality fabrics and materials, <a href="http://www.coachbagsoutletsstore.net" title="coach bags"><h1><strong>coach bags</strong></h1></a> are durable and modish. No wonder they are loved by million of fad-seekers.Coach is a renowned leather brand throughout the world. <a href="http://www.coachbagsoutletsstore.net" title="coach handbags"><h1><strong>coach handbags</strong></h1></a> are famous for their special designs and beautiful shapes.Coach New Signature BackPack Black-Beige is a useful backpack for outdoors activities. It's convenient that you can freely take along with for travel,climbing and go for school.In our <a href="http://www.coachbagsoutletsstore.net" title="coach outlet"><h1><strong>coach outlet</strong></h1></a>,there are many graceful styles of Coach backpack for you.Coach is a leading American designer and maker of luxury lifestyle handbags and accessories.There is no doubt that here <a href="http://www.coachbagsoutletsstore.net" title="coach outlet store"><h1><strong>coach outlet store</strong></h1></a> is the exact place you should visit.</p><p>On establishing contact with a <a href="http://www.coachoutletonlinesstores.com" title="coach outlet"><h1><strong>coach outlet</strong></h1></a> hire agency, a few clarifications would need to be put to rest prior to working out a deal.As long as you open our <a href="http://www.coachoutletonlinesstores.com" title="coach factory outlet"><h1><strong>coach factory outlet</strong></h1></a> webpage, you will view various Coach New Arrivals which are the most popular also the most fashionable in this year.Most significantly, the coach designer purses of <a href="http://www.coachoutletonlinesstores.com" title="coach factory outlet online"><h1><strong>coach factory outlet online</strong></h1></a> industry won't deteriorate your individual fashions at all. Rather they would immediately change your overall looks marvelously.If you want to buy some cheap coach sling bags with fashionable styles, delicate designs, top qualities and the cheap prices, just pay a visit to the <a href="http://www.coachoutletonlinesstores.com" title="coach factory store online"><h1><strong>coach factory store online</strong></h1></a>.</p><p>By the fashion, novel appearance, sophisticated technology, superior quality, <a href="http://www.coachoutletonlinestore1.net" title="coach outlet"><h1><strong>coach outlet</strong></h1></a> won domestic and international customers, their products exported to the Middle East, Southeast Asia and other regions.In a word, buying at <a href="http://www.coachoutletonlinestore1.net" title="coach factory outlet online"><h1><strong>coach factory outlet online</strong></h1></a> on the net is extra handy and dependable than other outlets. Now I dont have adequate bucks to go in another country, but I undoubtedly adore the coach products.Today, following half a century, mentor leather-bases <a href="http://www.coachoutletonlinestore1.net" title="coach factory outlet"><h1><strong>coach factory outlet</strong></h1></a> continues to be the delicate craft of leather-based master is accountable for,That <a href="http://www.coachoutletonlinestore1.net" title="coach factory store online"><h1><strong>coach factory store online</strong></h1></a> annually consultation on item pattern to 5,000 high-end consumers, investing of as a good deal as much more than three million bucks a year.</p><p>I got to know it from my elder sister who owns enviable luxury Coach bags. <a href="http://www.coachoutletonlinex.com" title="coach outlet online"><h1><strong>coach outlet online</strong></h1></a> Store is established to be your home shopping paradise.If you want to have the latest Coach arrivals, <a href="http://www.coachoutletonlinex.com" title="coach factory outlet online"><h1><strong>coach factory outlet online</strong></h1></a> may be a good choice. It provides its members with actually beneficial?prices?and high quality services.Though handbags are basically an accessory item of girls, there are many modern handbags and wallets for males too as it has become the ultimate fashion accessory at <a href="http://www.coachoutletonlinex.com" title="coach factory outlet"><h1><strong>coach factory outlet</strong></h1></a>.You know, Coach items are so perfect and fascinating. Now I grow up, and find <a href="http://www.coachoutletonlinex.com" title="coach outlet"><h1><strong>coach outlet</strong></h1></a> on the Internet offering affordable products with reliable quality.</p><p><a href="http://www.coachhoutlett.com" title="coach factory outlet"><h1><strong>coach factory outlet</strong></h1></a> offer excellent, elegant coach products in order to generate room for your new collections.They're purchased more quickly that you may at any time imagine.Coach New Signature BackPack Black-Beige is a useful backpack for outdoors activities. It's convenient that you can freely take along with for travel,climbing and go for school.In our <a href="http://www.coachhoutlett.com" title="coach outlet"><h1><strong>coach outlet</strong></h1></a>,there are many graceful styles of Coach backpack for you.<a href="http://www.coachhoutlett.com" title="coach factory outlet online"><h1><strong>coach factory outlet online</strong></h1></a> is one of the most popular and successful leather brands in the U.S. market.Coach stands for the most-admired innovative style and conventions in American fashion.Maybe you haven't seen such a great handbag sold at such a cheap price. Various Coach Handbags are provided in the <a href="http://www.coachhoutlett.com" title="coach factory"><h1><strong>coach factory</strong></h1></a> with other wonderful colors and styles for your demand.</p><p>If you want to have the latest Coach arrivals, <a href="http://www.coachoutletfactoryss.com" title="coach factory outlet online"><h1><strong>coach factory outlet online</strong></h1></a> may be a good choice. It provides its members with actually beneficial?prices?and high quality services.discount coach handbags, leaders and affordable for the American luxury brand known to create attractive designer <a href="http://www.coachoutletfactoryss.com" title="coach outlet"><h1><strong>coach outlet</strong></h1></a> online store and accessories.There certainly are a amount of methods to acquire affordable coach products at <a href="http://www.coachoutletfactoryss.com" title="coach factory outlet"><h1><strong>coach factory outlet</strong></h1></a>,it could possibly the most effective options.the most vital cause may be the reality that you simply can purchase genuine coach products at there.If people began to create a certain coach handbags, this fashionable line will be a coach. It will remind people of happy time when they like <a href="http://www.coachoutletfactoryss.com" title="coach factory store"><h1><strong>coach factory store</strong></h1></a>.It may be a good helper for me.</p>
    ericachen
  • RE: Measuring the success of Ed Tech: Not all about test scores

    <p>It is a symbol regarding position not to mention nature, Here I would like to launch a excellent bags pertaining to business men, which may be <a href="http://www.ilouisvuittonoutlet.org" title="louis vuitton online"><h1><strong>louis vuitton online</strong></h1></a> Cupertino M56398.Have you ever dreamed of being as charming as Madonna? Have you ever thought of becoming an envy of all your friends? If so, come to <a href="http://www.ilouisvuittonoutlet.org" title="louis vuitton outlet"><h1><strong>louis vuitton outlet</strong></h1></a>.At this moment, <a href="http://www.ilouisvuittonoutlet.org" title="louis vuitton outlet online"><h1><strong>louis vuitton outlet online</strong></h1></a> has utilized a variety of various fabrics in addition to fabrics, nevertheless Louis Vuitton remains the conventional hand-dyed leather may be a must-have item.You will find a variety of new Louis Vuitton products for women at <a href="http://www.ilouisvuittonoutlet.org" title="louis vuitton sale"><h1><strong>louis vuitton sale</strong></h1></a>. The Louis Vuitton briefcase is traditionally styled, but its highest qualtiy glove tanned leather, stitching and solid brass signature hardware help to set it apart.</p><p>Have you ever dreamed of being as charming as Madonna? Have you ever thought of becoming an envy of all your friends? If so, come to <a href="http://www.ilouisvuittonoutlet.net" title="louis vuitton outlet"><h1><strong>louis vuitton outlet</strong></h1></a>.the first Louis Vuitton bag was created in the year 1888, this is the so-called Damier Canvas style. At louis-vuitton-outlet-online.Welcome you can all chicing fashional <a href="http://www.ilouisvuittonoutlet.net" title="louis vuitton outlet online"><h1><strong>louis vuitton outlet online</strong></h1></a> handbags.As we show below, <a href="http://www.ilouisvuittonoutlet.net" title="louis vuitton outlet"><h1><strong>louis vuitton outlet</strong></h1></a> have a number of Louis Vuitton Earrings, louis vuitton replica handbags, in different styles for your selection.</p><p>Buy a unique and charm LV wallets, you should pay attention not only to look good. Quality is very important. The <a href="http://www.louisvuittonoutletonlinee.com" title="louis vuitton online"><h1><strong>louis vuitton online</strong></h1></a> designer leather wallets are always looking for new and long will be happy to help you.Looking for a <a href="http://www.louisvuittonoutletonlinee.com" title="louis vuitton outlet online"><h1><strong>louis vuitton outlet online</strong></h1></a> and don't know where they are? The easiest way is to Google it. That simple. You should at least get a hit on the actual online designer store and you can search geographically for the one nearest to you.any <a href="http://www.louisvuittonoutletonlinee.com" title="louis vuitton outlet"><h1><strong>louis vuitton outlet</strong></h1></a> New backpack features usa a function grownup overall look. Varied piece allows that it is captivated me within the approve and also further than your body.</p><p>Welcome to buy Discount Louis Vuitton Bags and Authentic Louis Vuitton in our <a href="http://www.louisvuitton-outletsales.com" title="louis vuitton sale"><h1><strong>louis vuitton sale</strong></h1></a>.Absolutely guaranteed quality and making every details greatest in products our company principle.any <a href="http://www.louisvuitton-outletsales.com" title="louis vuitton outlet"><h1><strong>louis vuitton outlet</strong></h1></a> New backpack features usa a function grownup overall look. Varied piece allows that it is captivated me within the approve and also further than your body.In the festivity put forth some <a href="http://www.louisvuitton-outletsales.com" title="louis vuitton outlet sale"><h1><strong>louis vuitton outlet sale</strong></h1></a> together with glance the trunk just as before from the store because of their certificate roof-rack.I often visit the store online which includes a huge variety <a href="http://www.louisvuitton-outletsales.com" title="louis vuitton sale"><h1><strong>louis vuitton sale</strong></h1></a>.I really like these products inside as it values for money.</p><p>You can choose the discount Louis Vuitton bags on our website. Cheap <a href="http://www.louisvuitton-bagsoutlets.com" title="louis vuitton bags outlet"><h1><strong>louis vuitton bags outlet</strong></h1></a> are specifically designed to make a statement of fashion and elegance..<a href="http://www.louisvuitton-bagsoutlets.com" title="louis vuitton bags"><h1><strong>louis vuitton bags</strong></h1></a> are graceful in shapes and delicate in details. New arrivals are supplied on Louis Vuitton Outlet. New colors and styles make you a new lady in this summer.Have you ever dreamed of being as charming as Madonna? Have you ever thought of becoming an envy of all your friends? If so, come to <a href="http://www.louisvuitton-bagsoutlets.com" title="louis vuitton outlet"><h1><strong>louis vuitton outlet</strong></h1></a>.Louis Vuitton Pochette Damier Azur is one of the best choice from our fashion <a href="http://www.louisvuitton-bagsoutlets.com" title="louis vuitton outlet online"><h1><strong>louis vuitton outlet online</strong></h1></a>.You may find cheap price Louis Vuitton Damier Azur Canvas handbags and purses for the best sales and deals.</p>
    ericachen
  • beats by dre

    This paper is useful to me, say thanks to the actual writer's share 12 Very honored to be able to see this article
    beats by dre uk
    http://www.monsterbeatsbydreoutlet.co.uk/
    Li Lin