Louise Ferguson's website
home
blog
 
       

photo of Louise Ferguson

contact

location: London, UK

email: louise.ferguson -at- gmail.com

mobile: +44 (0)7810 260 637




Grab my RSS feed:

rss feed

or subscribe with Bloglines:

Subscribe with Bloglines





archives


 
City of Bits Blog
Usability, user experience, technology, ethnography, design, the workplace, e-government and public policy, from a UK perspective


Friday, April 30, 2004  

Ireland abandons e-voting...for now

Margaret McGaley has been in touch to say that the Irish government has abandoned plans to use e-voting equipment in the upcoming local and European elections. The decision comes in the wake of an adverse report from the Irish Independent Commission on Electronic Voting.

"The commission emphasises that its conclusion is not based on any finding that the system will not work, but on the finding that it has not been proven at this time to the satisfaction of the commission that it will work," says the report.

News report on RTE News site.
Statement by Martin Cullen, Minister for the Environment
Extensive coverage on Politics.ie

There's a large and growing collection of material on e-voting on this site, as of today divided into six more manageable pages.

2:56 PM| link to this item


Thursday, April 29, 2004  

Another report about why IT projects fail

A few days ago, the Royal Academy of Engineering and the British Computer Society published 'The Challenges of Complex IT Projects'. There's considerable criticism of current practice: in general, those in the sector know what best practice is, but fail to follow it, according to the report.

Usability gets a few mentions (2 to be precise), as do the poor old users. Though user-centred design is not explicitly mentioned, there is some criticism of the 'waterfall', or sequential approach to projects, and support for iterative development.

Fred Brooks' Mythical Man-Month, originally published in 1975, gets quite a few supportive mentions. As the report states, "Despite its age it contains observations and advice of great relevance to current projects, which in itself is telling."

By the way, there's an improved anniversary edition of MMM, containing a number of later essays, including the widely cited 'No Silver Bullet: Essence and accidents of software engineering'.

All too often, a major problem is the decision: what to design? I feel the issue of requirements gathering gets inadequate treatment in the report. It was, after all, Fred Brooks himself who wrote, "The hardest single part of building a software system is deciding what to build...No other part of the work so cripples the resulting system if done wrong. No other part is more difficult to rectify later".

One recent UK example of failing to research user requirements was the Criminal Records Bureau system, designed to provide obligatory criminal record checks for prospective teachers, social workers and many more employment groups. Designed by the contractor as a call centre-and-website to deal with individual applications, only as implementation was imminent - and the marketing roadshow in full swing - did developers talk to potential users of the system...and accidentally discover that the vast majority planned to apply for checks in writing (probably to cover their backs in this legal minefield). Nor had developers figured out that applications from user locations would be submitted not individually, but in groups (mostly because every applicant or interviewee for a particular job would need to be screened at precisely the same time - say, by the headteacher or other hirer). Some things seem so obvious when you find out about them...

4:03 PM| link to this item


Wednesday, April 28, 2004  

Learning: not all about content delivery;
Courses: not all about learning


Another subject I've intended blogging about, but probably never got around to, was UKeU, or UK eUniversity. A few articles over the last month have described the sudden demise of this institution, which received significant government funding (£62m, I believe) to develop a UK university-level offering for online learning.

So what went wrong? The nail in the coffin was an article in The Observer last year concerning expenditure and student numbers (fewer than 1,000). This led to investigation by the relevant government department, and all went downhill from there.

But more seriously, UKeU spent large sums on a technology 'platform' (supplied by Sun), but seemingly failed to investigate the real need for online learning at tertiary level, or the dynamics of e-learning, and was perhaps overly naive concerning the attributes of face-to-face learning that could be readily transferred to the online environment. The expenditure figures reveal much marketing but no research.

So why do people go to classes? I live in London, and it attracts a considerable share of face-to-face students. Why do foreign students sign up for courses at London universities? Partly for the prestige of London University or another of the capital's institutions, but partly because they want to be *in London*, because they and their families want to be able to say 'She's at a university in London, she's living in London'. It's cool, it's fun, it contributes status to the individual *and* the family in their own community, and all this is intimately connected to the experience of being in London: new ways of living, going to the theatre and to concerts, going to trendy bars, being in a happening place... How does online address this status, experiencing, sharing, boasting.....?

Furthermore, online learning also requires considerable discipline on the part of students. With no weekly lectures and seminars, students need considerable self-discipline to be able to make the most of it and not give up. More so when younger students are concerned.

While living in southern Europe, I learned a lot about the computer education game. Southern Europe has for some time been packed with private language schools catering for toddlers, schoolchildren, young adults and professionals. Not to mention in-company language classes. It's a major industry, driven by the need to learn English: to get a job, to get promotion, to get into the civil service.....

In the early-mid 90s, half a dozen enterprises opened up across southern Europe and elsewhere across the non-English speaking world, offering computer language training through thousands of high-street outlets. Wall Street Institute (owned by US learning major Sylvan Learning Systems) was one of them. Opening English School was another. All had very expensive marketing operations. The deal was up-front payment by students, giving unlimited 'flexible' access to computer-based materials, and occasional sessions with badly paid gap-year tutors.

In the last few years, all of these enterprises have contracted, branched out into other - face-to-face - areas, or failed. It was clear early on to those on the ground that this would happen, and why. Yes, everyone wants to learn English - these organisations' main sales vehicle - but few people have the self-discipline to be able to pursue a course of study without turning up at an appointed hour twice a week, homework in hand. The sense of obligation, of commitment, of guilt, of 'owing the teacher', had gone.

Give people ultimate flexibility, and they generally fail to do anything. A bit like failing to go to the gym for which you pay a subscription (which you then stop when you come to your senses).

Usability, in this context, is almost irrelevant. If the student never makes it to the computer, the student is never even going to get to see the interface, the interaction, the learning programme you have developed. As an educator, you are not competing with another, better interface, interaction or learning programme. You are competing with the bar, the family, friends, a club, a concert, frequent dinners out, the - cheap - cinema. And, perhaps, the beach.

Spanish, Italian and Portuguese face-to-face language schools - and no doubt many more elsewhere with which I'm less familiar - are full of people who expensively 'failed' the computer-based learning way. Luckily for the owners of the computer-based learning academies - and unluckily for their students - fees were invariably paid up front. The old-time face-to-face schools have now picked up the students they lost during the 90s.

At the other end of the spectrum, face-to-face language and other after-school private classes for youngsters in non-English speaking countries - amazingly popular around the Med - are often little more than child-care operations, making sure that kids are not run over before their parents get home. Learning is not the issue for most parents: if their children pick up a dozen words of another language, parents regard this as a bonus. Many children attend a class on most days after school.

And a final example: many adults attend adult education classes in the UK not so much to learn, but rather to meet new people, occupy their time, get out of the house. Queues for registration each term are full of people coming back to do yet another course in yet another subject, which can carry on for decades.

In summary, face-to-face tuition may fulfil many functions beyond pure content delivery and knowledge acquisition, something that the e-learning community seems not to have taken on board. A number of these functions cannot be so easily replicated in the online environment. Why should an online university pretend to break the mould of human behaviour? As someone said to me the other day, "when I hear the words 'paradigm shift', the alarm bells start ringing".

A little e-learning is a dangerous thing (21 March)

E-university set to be dismantled (27 April)

11:17 AM| link to this item


Tuesday, April 27, 2004  

Patients' patience reaches breaking point

I've been meaning to write about Patientline for a while. In fact, I suspect I blogged about it around a year or so ago (when there was an ESRC workshop on accessibility at the University of Reading, at which I raised the matter of its poor user interface). Or maybe it was one of those blogs that never got written.

Anyway. Patientline - a bedside unit that allows hospital in-patients to access phone, radio, TV and Internet - finally hit the headlines this month.

"Hospital patients forced to watch TV they can't switch off", roared The Guardian.
"NHS patients forced to watch all-day TV," stormed The Times.
And in a Guardian follow-up, "Letters flood in over NHS TV set row."

In summary, Patientline 1.0 has no off switch, so patients had to resort to turning the screen to face the wall to get away from the thing.

This is one of many issues with Patientline. Another is the high cost to patients - recent hospital visitors will have noticed the large vending units in ward blocks, selling Patientline access cards for significant amounts of money - and the consequent digital divide issues: only the wealthy can watch TV, surf the Internet or make phone calls? Incoming calls are apparently charged at premium rates too.

An alternative system developed at Brunel University - research council funded and using user-centred design principles, whose designers spoke at the above-mentioned workshop - finds it hard to compete with the likes of Patientline. Why? Because outfits like Patientline provide NHS trusts with a turnkey 'solution': no monetary commitment, everything paid for by the company. You can almost hear the Trust chairman breathing a sigh of relief at the knowledge that his cheque book can stay firmly in his pocket.

We still don't have any standard that says systems in public hospitals have to jump through a usability or accessibility hoop, more's the pity.

As one commentator put it, "On several occasions I was minded to rip the device from the wall and throw it out of the window. I now wish I had."

6:30 PM| link to this item


Friday, April 23, 2004  

Calfornia investigates dodgy voting machines

The US press has this week been covering the California state investigation into Diebold voting machines. Local officials have recommended banning certain machines manufactured by the company, and may pursue civil and criminal sanctions too. Diebold is reported to have installed "uncertified software without notifying the Secretary of State as required by law." In addition, battery failures prevented some people from voting.

Court proceedings hardly seem a sufficient response to non-compliance and failing machines. In the case of machine failure, what compensation can be appropriate when people lose the right to vote as a consequence?

As more sloppy development practices come to light in this field, it strikes me that what are in effect mission-critical systems are being developed and managed in a similar way to administrative batch processing systems of thirty years ago. Only with election systems, you can't have run another election tomorrow after the problems have been sorted out.

3:17 PM| link to this item


Tuesday, April 20, 2004  

Benefits of improved design

There's a new case study on the Design Council website, detailing how Lambeth Council (London) managed to reap significant financial returns from the redesign of its Council Tax bills and related material.

10:37 AM| link to this item


Monday, April 19, 2004  

Indian elections

With the Indian elections due to start tomorrow, there's some news coverage of the country's voting machines and reactions to them.

Some 675m voters are expected to visit the polling stations over a three-week period. Apparently there are more than one million machines in place in 700,000 polling stations, with 15-20% "expected to fail".

BBC Radio 4 this afternoon reported from villages where the local population does not yet have electricity, let alone digital technology. Some voters quoted by Radio 4 said they wanted to vote, but didn't know how.

One Indian commentator, Dr Leo Rebello of the All India Voter Panchayat, said the system had been introduced too quickly, the electorate were not prepared and have not been shown how to use the machines, and called the system "a recipe for corruption". Another stated "we have no faith in these voting machines".

Images of the voting machines can be seen in this slide series on the Election Commission of India website. The feature that allows permanent closure of the device "in the case of booth capture" is perhaps the most unusual. There's more information about the system on this EU site.

Bharat Electronics, one of the two manufacturers, now has its eyes set on other Asian countries, and US and European markets too, according to this Silicon India report. A company spokesman elsewhere describes the machines as "foolproof" and "mistake-proof". The machines do not have a voter-verifiable audit trail.

8:17 PM| link to this item
 

NotCon 04

Nice to see that NotCon '04 is planning to address 'not-tech' subjects too, such as politcs on - and of - the Web. The call for proposals is now out. Get writing!

6:33 PM| link to this item
 

Queuing to vote

Over at Re.engage, Jonathan Briggs highlights the queuing at polling stations in South Africa.

5:43 PM| link to this item


Sunday, April 18, 2004  

Accessibility: carrots or sticks?

I went along to the Disability Rights Commission's launch of the report The Web: Access and Inclusion for Disabled People this week. Billed as the largest ever survey of websites, the DRC's research - in co-operation with Helen Petrie at City University - included a survey of 1,000 UK home pages, 100 more in-depth website studies, interviews with stakeholder groups, a questionnaire, a comparison of accessiblity and usability, and an assessment of results provided by automated testing tools.

The results were not althogether surprising: only 19% of website home pages (192) complied with Web Accessibility Initiative (WAI) Guidelines 1.0 level A, only 0.6% (6) complied with WAI level double-A, and none with triple-A. Government websites fared somewhat better than the private sector, with 32% of home pages level A compliant.

Blind users were found to be the group most disadvantaged by inaccessible websites. For most disabled groups - using assistive technologies - the main effect was the long time taken to complete tasks, rather than failure to complete. The major problem reported by most groups was 'unclear and confusing page layout of pages', with 'confusing and disorienting navigation mechanisms' also making a significant appearance among the main barriers identified.

The DRC also reported that automated testing tools only found around 55% of real user problems. In other words, almost half the real problems reported would not have been uncovered through use of a testing tool. Reliance on tools, or a tick-box approach to accessibility, will not address many real-world accessibility problems, it concludes.

Survey questionnaires revealed that while there is a reasonable awareness of accessibility among website commissioners, especially among larger firms. But taking accessibility into account when developing websites, and conducting testing, both lagged behind awareness. Firms reported a low level of knowledge about how to implement accessibility measures. Website development agencies also reported low levels of in-house expertise in this field, with a high reliance placed on automated testing tools (only 9% had included disabled users in user testing).

The DRC has come out with recommedations that include a kite mark system, and "accreditation and registration of Web developers" (in the words of DRC chairman Bert Massie), and in this I believe it is jumping the gun. In any case, if guideline tick boxes are not the answer in making websites accessible, why should developer tick boxes be expected to do the trick?

Developers certainly show some awareness and a willingness to work towards accessibility. What seems to be lacking is turning that willingness into practical skills.

According to the report, UK government guidelines fared poorly when it came to getting developers up to speed: 5% of developers said they had used them, compared to the 65% who reported referring to WAI Guidelines.

While the research did not assess the level of training in this area provided in educational institutions, it's clear from reviewing today's course programmes that few courses at any level or in any specialist area - digital media, multimedia, computing, Internet managment, e-commerce etc. - incorporate accessibility concerns.

It's small, voluntary efforts, such as Ian Lloyd's Accessify, that are perhaps most effective at present in spreading the word and indicating practical approaches.

Without usable guidelines and adequate training, and without corporate policies and practices that support the acquisition and application of that knowledge, it's difficult to see how developers are to achieve what's now being expected of them. Meanwhile user testing, while necessary, will only be productive when developers have the knowledge to make the best use of findings. Let's see some reasonable carrots put into place before hitting developers over the head with regulatory sticks.

8:23 PM| link to this item
 

Unlikely parallels

An article by Quentin Letts in today's Observer comment section discusses whether the head of the UK Electoral Commission, Sam Younger, may be more powerful than we had previously thought.

Suggesting that Younger may be called upon to approve or otherwise an array of initiatives, from a TV show called Vote for Me (intended to produce a candidate for a parliamentary seat) to setting referendum questions, Letts wonders whether Parliament has unwittingly "created a monster".

As far as I'm aware, in many areas the Commission's powers are limited to making recommendations, which the Government may accept or reject. In the recent case of all-postal voting, for example, the Commission's recommendation to limit the exercise to certain regions - pointing out that no others were organisationally ready to take part - was overturned.

Lord Rennard stated in the House of Lords "The Commission says that the risks of fraud outweigh the benefits if there are four experiments. It says that the north-west is not suitable. It says in its most recent letter that the position has not changed since December," - a position attacked by Tony Blair as "absolutely extraordinary". Election officals and the electorate itself have to live with the consequences of seemingly uninformed decisions on the part of the Government, while the Commission is all too aware of the limits on its power.

Letts (whose main day job seems to be Dail Mail sketch writer) asks whether Younger is to be Britain's Katherine Harris. You may remember Harris from the 2000 presidential elections in Florida: she was the Secretary of State and county elections supervisor who implemented policies widely regarded as amounting to vote rigging.

Hardly. Harris, to my eyes and to those of others, had a strongly party political agenda (she's now a Republican member of Congress), and her many actions before, during and after that election displayed a complete disregard for equity.

The UK Electoral Commission is attempting to provide a professional and expert service to UK statutory election administration, free of any loyalties to parties or interest groups. Its recommendations are based on extensive work, which can be seen in the reports it produces, and it has in certain contexts commissioned independent research (available on its website).

Letts makes the accusation of "institutional modernism" against the Commission. I feel this is hardly fair. While I and others may argue with the exact position taken by the Commission on matters such as electronic voting, I'd be the first to point out that the yearning to be modern - such as the push for electronic voting - is in fact rife within the Labour party: the Commission seems merely to be attempting to contain these strong pressures within sensible bounds, and is concerned with vital issues such as voter confidence in systems and technology, a factor that political parties ignore at their peril.

1:18 PM| link to this item


Tuesday, April 13, 2004  

Something in the heavens?

Ravensbourne College of Design will next month be playing host to both Cory Doctorow (Boing Boing etc etc) and Richard Stillman (founder of the Gnu project etc etc), at the same event. The subject of the day's discussion is copyright vs community. As Ian Forrester from Ravensbourne says, it's going to be one great day. See the events page for more details.

8:14 PM| link to this item
 

Signs of blogging life in UK academia?

Is this the first blog on HCI from a UK academic department, I wonder? Interestingly, it's not from one of the main UK HCI research departments...

2:41 PM| link to this item
 

Design for Patient Safety

I've only just come upon an interesting report co-commissioned by the Design Council and the Department of Health entitled Design for Patient Safety (launched February 2004).

It contains plenty of messages which are not new ("too many helthcare solutions have been designed based upon a paucity of knowledge of the system into which they will be placed or the needs of the people who will use them" and so on) but which unfortunately continue to be true.

I like the way the text explicitly ranges across both medical devices and information systems. While the former have become more computerised, the latter have increasingly become clinical (and therefore safety-critical) rather than purely administrative. In other words, medical devices and information systems are converging. However, the institutional division in healthcare between 'computing' and 'medical devices' has continued, and does not help the safety agenda for either staff or patients.

The report's point that design for safety will only be taken on board - and perhaps used as a competitive edge - by healthcare systems providers when the market is subject to strict usability criteria, and when the NHS uses its collective purchasing power to push for usable designs, is well made. The splintered market we've had to date has only served to put all the power into the hands of niche providers who then seem to hold individual Trusts by the short 'n' curlies.

The words 'usability' and 'ease of use' are mentioned (once or twice each??), but I can't seem to find any reference in the report to user-centered design, or to accepted industry process standards, such as ISO 13407 (Human-centred design processes for interactive systems). And the report speaks of 'developing criteria for usability' - in packaging, information, equipment - but makes no reference to the existence of considerable work in this area, such as in information design for pharmaceutical packaging. Is this deliberate? Or a consequence of the various sub-professions in experience design not talking to each other?

Unless this industry starts to standardise what it is promoting and what it calls things, its message will continue to be confused and lack impact. Information design, interaction design, technical communication, interface design, experience design, product design, service design, ergonomics (the report was largely written by ergonomists I believe)....- we are all dealing with the same material and the same issues and perhaps need to start talking the same language, especially to clients.

And unless we as an industy start to build on what we already know, rather than constantly reinventing the wheel, we're going to waste an awful lot of time and money.

I suspect this will only happen when we all start talking to each other instead of amongst ourselves.

Right now, though, there just seem to be too many similar but different hymn sheets.

11:57 AM| link to this item


Thursday, April 08, 2004  

Ethnography in organisations

Last month, The Economist briefly addressed the use of anthropologists in business. The article rightly states that the use of anthropology approaches in industry goes back to the 1920s, but does not mention that the early Cicero, Illinois, studies are more commonly known as the Hawthorne Studies, well-known for the discovery of the so-called Hawthorne effect (in simple terms, people respond to being studied). The Hawthorne series (Hawthorne was a plant for the Western Electric Company) moved away from psychological laboratory-style approaches towards qualitative field techniques to find answers for the increasingly bizarre results emerging from the psychology lab. Nor does the article mention the early history of anthropology in British organisations, at around the same time.

I'd question the article's assertion that 'corporate anthropology is now mainstream'. Yes, it's out there, and there seems to be a resurgence of corporate interest as boards find that number crunching fails to provide all the answers. But most corporates have still not heard of it, and many of the rest still regard ethnographic research as marginal, expensive and optional. I'd be surprised if more than a couple of dozen companies in the UK employ in-house anthropologists, and most firms still believe that everything they need to know can be uncovered 'in the lab', so perhaps business has yet to learn the lessons of Hawthorne.

For coverage of the Hawthorne studies, as well as later developments in ethnography in organisations, see Helen Schwartzman's excellent monograph Ethnography in Organizations (Sage Qualitative Research Methods series, Vol 27)

5:45 PM| link to this item
 

Creativity and computers

Several people from the former COGS at Sussex University will be presenting research on creativity and computers at the British Psychological Society annual conference in London next week, including Margaret Boden and Rose Luckin.

http://www.bps.org.uk/events/ac2004/index.cfm

11:05 AM| link to this item

 
© louise ferguson 1999-2004