Education and testing

Recently I have read several articles about various aspects of the education system in the U.S. Most people agree that our educational system is not wholly successful. However, that’s where the discussion about how to improve the system begins – and where the agreement ends. Everyone has a different idea about what success looks like and how to measure it.

Two recent articles in The Washington Post were critical of standardized testing. One describes the results (and implications) when an adult – a school board member – took the 10th grade standardized math and reading tests. The adult, to put it mildly, did not do well on the tests, and said, “It makes no sense to me that a test with the potential for shaping a student’s entire future has so little apparent relevance to adult, real-world functioning.” (Apparently this issue persists through higher education as well; employers are finding that college grads lack job skills.)

Another article cited the revolt of New York state school principals against students’ test scores being used to evaluate teachers. The most problematic part of this plan is that there has been no pilot testing. In an “open letter of concern,” the principals wrote, “We are very concerned…that at the state level, change is being imposed in a rapid manner and without high-quality evidentiary support. Our students, teachers and communities deserve better. They deserve thoughtful reforms that will improve teaching and learning for all students.”

After giving background and articulating specific concerns, they offer recommendations, one of which is, “Pilot and adjust the evaluation system before implementing it on a large scale. Any annual evaluation system should be piloted and adjusted as necessary based on field feedback before being put in place state-wide. In other words, the state should pilot models and then use measures of student learning to evaluate the model.”

Tests are an instrument of measurement; pilot tests are essential to ensure that the tests are measuring what they are supposed to be measuring. Furthermore, in the evaluation and assessment part of the research process, testing is only the “gathering data” step – but there’s no point doing assessment at all if you aren’t going to act on the results. Testing, in large part, confirms what we already know; what are we going to do about it?

An op-ed by Duke professor Helen Ladd and author of the Fiske Guide to Colleges Edward Fiske in The New York Times earlier this month cited the acknowledged and proven correlation between economic advantage and student performance. Federal education policy, they write, does not take this into account. Setting testing requirements will not help; supporting high-quality early childhood and preschool education programs will, they suggest.

There are a few takeaway points from all this. One: Standardized tests must be tested themselves before being used state- and nation-wide to assess student learning and achievement, or to assess teachers and principals. Two: There is little purpose in testing at all if the true problems are not going to be addressed, and if insufficient support is going to be given to solve these problems. And lastly: Education ought to prepare students for their adult life; it ought to arm them with higher-order thinking skills (i.e. application, analysis, synthesis, evaluation).

 

Amazon vs. Bricks-and-Mortar

It’s not even Amazon vs. the independent bookstores anymore; now it’s Amazon against any physical bricks-and-mortar bookstore that offers browsability, serendipity, and (hopefully) knowledgeable, informed, helpful staff who can make personalized suggestions tailored to your needs, likes, and dislikes.

Author Richard Russo wrote an op-ed in The New York Times on December 11 about Amazon’s competitive strategy of encouraging buyers to use its price check app in stores by offering credits to consumers, who then buy from Amazon instead of from stores. (It should be noted that while book prices can be checked with the app, they do not qualify for the promotion.)

Russo sent this news on to a number of other authors, including Scott Turow (president of the Authors Guild), Stephen King, and Ann Patchett. King called the strategy “invasive and unfair”; Turow suggested that it might not be “lawful” for Amazon to encourage consumers to go to a store solely to obtain pricing information without any intention of buying; and Patchett said, “I do think it’s worthwhile explaining to customers that the lowest price point does not always represent the best deal. If you like going to a bookstore then it’s up to you to support it. If you like seeing the people in your community employed, if you think your city needs a tax base, if you want to buy books from a person who reads, don’t use Amazon.”

Authors and bookstore owners and employees aren’t the only ones who object to Amazon’s price check promotion; Maine Senator Olympia Snowe said, “Amazon’s promotion – paying consumers to visit small businesses and leave empty-handed – is an attack on Main Street businesses that employ workers in our communities.”

Fortunately, it is not all bad news for bookstores. An “unusually vibrant selection” of books this season seems to have helped bookstore foot traffic and sales, which are up from this time last year. Former Borders customers are finding other bookstores, too. One bookstore owner in Seattle said, “What’s extraordinary about the books that are out there is that they’ve been so well written and such a pleasure to read. Maybe people have an appetite for nonfiction right now, just for some sort of grounding in reality.”

The book business is, as much as book lovers would like to deny it, a business, but Amazon’s price check app and promotion are “bare-knuckles” enough to leave a bad taste in one’s mouth. Before doing ordering all your holiday presents on Amazon, consider what you get for a few extra dollars at the bookstore: personal recommendations from people who read. Of course, the level of service stores offer varies, but if you’re in the Cambridge/Somerville area, I can recommend the excellent Porter Square Books in good faith.

And if you aren’t looking to buy, just looking to read, another great place to get a recommendation is your local library. 🙂

MLS

After yesterday afternoon’s half-hour group presentation in class (LIS 531Y, Usability and User Experience Research) on our team’s usability study on the EBSCO Discovery Service (EDS), and last night’s condensed presentation on the same to the Usability Professionals Association (UPA) Boston Chapter, I am completely done with papers and presentations (and all other work) for my MLS degree. HURRAY!

Photos: one group member from each EBSCO team presented the results of the usability tests to the UPA Boston meeting on at Simmons College on December 12.

As it happens, a recent (December 7) Library Journal article included comparisons of four discovery services, the first of which was EDS. Amanda Clay Powers of the Mississippi State University Libraries observed that EDS worked especially well for undergraduates (novice) and for doctoral students and faculty (advanced), but less well for upper-level undergraduates and master’s students, who were still best served by subject-specific databases.

The research we did in Usability and User Experience Research this semester was focused less on content and more on usability and specific system features (such as the cite tool, the “find similar books” option, and the ability to save or share search results). Still, the LJ article was an interesting overview, especially as it compared multiple discovery interfaces.

One Week

One week of classes left! I have been busy recently with final projects and papers (some parts of which I may post here in the future), but the end is in sight. Meanwhile, a few articles on usability, user experience, and design:

UX Hierarchy of Needs – The author proposes that there is a “UX hierarchy of needs,” namely (from the bottom up) Functionality, Information, Aesthetics, and Usability. The first two are the basic needs, the latter two are the higher needs. However, I’m inclined to switch usability and aesthetics – as a user, I’d rather a system be easy to use than pretty to look at (although aesthetics is more than just “prettiness” – it also encompasses branding).

9 Rules to Make Your Icons Clear and Intuitive – Much more thought and planning goes into (or should go into) those tiny buttons than you might think. This article (same author and site, UXMovement, as above) covers some good basic rules-of-thumb, such as labeling icons, grouping similar icons, and keeping icon order and placement consistent. However, some established icons that break one or more of these rules still work well because so many people know what to look for – the chain link representing the hyperlink, for example, or the ABC for strikethrough. (The author recommends a blue underlined L for the first, and a struck-through S instead of ABC for the latter.)

14 Guidelines for Web Site Tabs Usability – Many sites use tabs for navigation; they are good real-world metaphors (most people are familiar with filing cabinets or binders), they improve content organization, and they are “visually pleasing.” The author outlines some guidelines, illustrating many of his points with appropriate screenshots (remember when Amazon used tabs?). Among these guidelines: tab labels should be 1-2 words, in plain language; tags should be organized in an order that makes sense to users, and related tags can be grouped; and the active and inactive tabs should be clearly indicated so the user can tell what section of the website they are currently in.

Two Approaches

The Authors Guild has spoken out against Amazon’s Lending Library, arguing that Amazon’s contracts with publishers cover only the sale of books, not lending or giveaways. For additional background on this issue, here’s my November 3 post with several links. The Guild may have a point here, and urges its authors to contact their agents and publishers.

In the “good news” category, however, we have Ann Patchett’s new independent bookstore, Parnassus Books, opening soon in Nashville, TN. The most recent NYT article notes that small, independent bookstores compete “where Amazon cannot: by being small and sleek, with personal service, intimate author events and a carefully chosen rotation of books” (including e-books). Best of luck to Ann, her business partner Karen Hayes, and Parnassus Books!

Open Library

If you aren’t already familiar with Open Library, a project of the non-profit Internet Archive, you now have one more reason to head over and check it out: all 50 state librarians have voted to build an alliance with IA. What does this mean? The Chief Officers of State Library Agencies (COSLA) and Open Library will be working together to ensure free access to e-books through all public libraries in the U.S.

Already, anyone can borrow e-books from Open Library‘s collection of 10,000 e-books, provided by the Internet Archive and its partner libraries. You can borrow up to 5 books for 2 weeks each, in a variety of formats (in-browser, e-Pub, or PDF). If your public library is a member, you may have access to even more.

Happy reading!

How to Cook Without a Book?

“But a Nook can’t read, so a Nook can’t cook. So…what good to a Nook is a hook cook book?”
One Fish Two Fish Red Fish Blue Fish, Dr. Seuss

I’m sure that’s not what Barnes & Noble had in mind when they named their e-reader.

A recent article in the New York Times asks if cookbooks are obsolete (leading question much?). It describes how a number of wonderful apps are sweeping traditional cookbooks and recipe cards off the kitchen counter and back onto their shelves to gather dust.

As usual, there is plenty of room for both sides. Certainly, some people will gravitate toward these apps and e-versions of cookbooks on tablets or e-reader devices, either replacing or enhancing their print cookbooks; others will ignore the new toys (audio, video, flowcharts, built-in timers and glossaries) and continue using their print books.

There’s also a middle ground: Eat Your Books offers a way to search through all the indexes of all your cookbooks for a particular recipe. The recipes themselves can’t be accessed through the site unless they are free online, but by searching the indexes of all the books you already own, you can find what you’re looking for much more easily; it’s a way of semi-digitizing your cookbooks. You can also add blogs such as Chocolate & Zucchini and Smitten Kitchen to your “shelves” and search those too.

Incidentally, the NYT article neglects to mention what would happen if one were to spill soup onto one’s iPad.

Losing “cite” of what’s important

I’ve been thinking about citation a lot lately. (Chances are, if you aren’t a student and you just read that sentence, you’re already weeping from boredom; but if you are a student, you might have made some sort of frustrated growling sound, or perhaps banged your head against the nearest wall.) I’m in my last semester of grad school in a program where most professors require APA citation (some are flexible – you can use another format as long as you’re consistent about it). As an undergrad I used Chicago style, and in high school I used MLA, so I’ve transitioned a few times, but I was pretty sure I had APA down; after all, attention to detail is what I do. However, two professors this semester have corrected my APA style citations, which makes me think that other professors just weren’t looking that closely – or that they simply didn’t care as much about the details, just that sources were acknowledged somehow and that the writing was good.

Then this morning, I read an opinion piece in the Chronicle of Higher Education: “Citation Obsession? Get Over It!”  The author, a teacher of writing at James Madison University, says that librarians aren’t able to help students with broader information literacy concerns (such as finding, choosing, and evaluating sources) because they are overwhelmed with anxious students needing help with citations. “What a colossal waste,” he writes. “Citation style remains the most arbitrary, formulaic, and prescriptive element of academic writing taught in American high schools and colleges.” He continues, “Now a sacred academic shibboleth, citation persists despite the incredibly high cost-benefit ratio of trying to teach students something they (and we should also) recognize as relatively useless to them as developing writers.”

The author, Kurt Schick, advocates focusing on the function rather than the form of citation. Most citation styles include the same basic information: author, title, publication date, publisher. It would seem that, with the help of a style guide, it wouldn’t be too hard to put that information in the right order – and it wouldn’t be, if all we were using was books and articles from academic journals. But information can come from a wide range of sources in a wide range of formats, and there are all kinds of exceptions. As long as the core information is there, allowing others to track down the item in question, does it really matter where the periods and parentheses are? Schick argues that no, it doesn’t – not until it’s time to publish. Until then, professors’ and librarians’ and writing center staffs’ time is better spend helping students with essential information literacy and writing skills: “We could…reinvest time wasted on formatting to teach more important skills like selecting credible sources, recognizing bias or faulty arguments, paraphrasing and summarizing effectively, and attributing sourced information persuasively and responsibly.” Students should absolutely understand the importance of acknowledging their own use of others’ words and ideas in their writing; no one is arguing that the concept of citation and attribution isn’t essential. The formatting, however, may not be that important.

Until this sea change takes place, however, the form of citation remains paramount for many professors at many institutions. For anyone required to use APA, I highly recommend the Purdue OWL (Online Writing Lab) APA Formatting and Style Guide. Individual college and university libraries and writing centers may have also prepared their own handouts, guides, and tips for citation. There are also citation tools like RefWorks and Zotero, and databases often have a “cite” tool built in; these can certainly be helpful, but they aren’t perfect, and students will still need to proofread for formatting errors.

Know of any other good citation style guides online? Please share in the comments.

Amazon, Library?

In case you haven’t already heard, Amazon recently announced the Kindle Owners’ Lending Library. Unlike borrowing books from a public library (free! Well, your taxes pay for it), in order to borrow books from Amazon’s library, you must (a) own a Kindle, and (b) have Amazon Prime membership, which unless you get the student deal is $79/month. Is this bad for libraries? Actually, probably not.

While I don’t want to generalize, I will say that people who belong to categories (a) and (b) above may still visit public libraries, but they probably don’t rely on them as their only source of information/entertainment. Even for those who do have a Kindle and Prime membership, public libraries still offer a much wider selection of e-books for the Kindle and other e-readers than Amazon’s “library,” which offers just over 5,000 titles.  And, none of the Big Six – the six largest U.S. publishers – have jumped on the bandwagon yet, so although some bestsellers are available, many are not.

This isn’t a ploy to compete with libraries; it’s a ploy to sell more Kindle devices. The one advantage Amazon has is that it can lend any title instantly; there’s no wait time, unlike libraries, where – even with e-books – the library has a limited number of copies and only one patron can borrow any given copy at a time (i.e., library owns 10 copies of The Hunger Games, 10 patrons can borrow The Hunger Games at a time – just like print). However, Amazon pays publishers for this privilege – mostly a flat fee, but sometimes per item, as it’s borrowed. So Amazon isn’t making money on lending content – they’re just trying to make Kindle ownership and Prime membership as appealing as possible.

Further reading:

Wall Street Journal
Huffington Post
New York Times
Amazon (press release)

A Balanced Information Diet

This evening I went to a screening of some TED talks at MIT, sponsored by the New England chapter of ASIS&T. We watched five TED talks, with a little bit of discussion between each one.

1. Raghava KK, “Shake up your story” – the artist/father talked about how looking at multiple perspectives could lead to the development of empathy and increase creativity.

2. Wael Ghonim, “Inside the Egyptian Revolution” – Ghonim described how the Internet allowed Egyptians to connect, to realize they were not alone and had shared dreams, to collaborate and speak out. He described how the “psychological barrier of fear” led to silence, but because of the Internet, “the fear is no longer fear, it’s strength. It’s power….The power of the people is much stronger than the people in power.” (After the talk, we discussed the flip side of technology: in the case of Egypt, technology allowed people to overcome their isolation, but what about when the government controls the technology?)

3. Eli Pariser, “Beware online filter bubbles” – This was the talk I found most interesting. Pariser, an online organizer and author, talked about the invisible shift in the flow of information online; search engines show us what they think we want – but what we want to see might not be what we need to see. Although the “personalization” due to algorithmic editing can sometimes be helpful, most people don’t realize that results are being filtered or tailored in this way – and we don’t decide what gets included or what gets left out.

Left to their own devices, people tend to read sources that re-confirm their existing points of view, and this was true long before the Internet (some people read the New York Times, some read the Wall Street Journal). Editors used to be our “human gatekeepers,” but now there are algorithmic gatekeepers, and they have no concept of journalistic integrity or ethics: they just want to show us what we want to see. Eventually, we may end up with a diet of “information dessert” and no “information vegetables. The information might be “relevant,” but we won’t be presented with information that is uncomfortable, challenging, important, or that presents other points of view – and we may become less and less aware that this information exists.

This addresses only a small piece of this issue, but check out the Google Transparency Report.

4. Sunni Brown, “Doodlers, Unite!” – According to Brown, doodling during a meeting isn’t a waste of time, and it doesn’t mean you aren’t paying attention – in fact, it may be helping you process information better. (After all, don’t many group brainstorming sessions end up using a whiteboard or pen and paper to sketch out ideas?)

5. Hans Rosling and the magic washing machine – This talk certainly had the best title, and was arguably the most entertaining. Swedish professor of global health Hans Rosling described the direct connection between the washing machine and reading: when his mother got a washing machine and no longer to do the washing by hand, she had time to take him to the library instead. “Thank you industrialization…that gave us time to read books!” The middle part of his talk concentrated on the developing world, climate change, and the use of resources (1/7 of the world population uses 1/2 of the resources – washing machines included).

One of the discussion questions (offered somewhat tongue-in-cheek, I believe) after this last talk was, “Do you think the invention of washing machines has increased library circulation?” In a roundabout way, it probably has: in the industrialized world, washing machines and other time-saving devices allow us to have more leisure time, which some of us do spend reading. 🙂

Many, many more TED talks are available “free to the world.” Explore, and enjoy!