Using a sensor attached to the child's wheelchair which tracks and records where they go during their school day. Teachers or carers who interact with the child use swipe cards to tell the system what they have been doing. They can also use a microphone to record more detailed information. The software  "How was school today?" (HWST) then uses the data to generate simple sentences about the events, using natural language generation, to convert the data into English.

Dr Ehud Reiter, University of Aberdeen's school of natural and computing sciences, explained: HWST uses sensors, swipe cards, and a recording device to gather information on what was experienced at school. "This can then be turned into a story by the computer" using natural language generation which  pupils can share when they get home.

Currently children with severe motor disabilities and limited speech are often limited to one or two word answers. Rolf Black, University of Dundee's school of computing, said: "For a child with severe motor disabilities and limited or no speech, holding a conversation is often very difficult and limited to short one to two word answers.

"To tell a longer story a communication device is often needed to form sentences ..This can be very time consuming, putting a lot of strain on holding and controlling the conversation."

Dr Annalu Waller  from the University of Dundee's School of Computing, said: "We are trying to use the power of artificial intelligence to support these children in communicating more fluently."

She said the technology could help develop children's conversational skills, adding: "By giving these children a positive experience of story telling they are actually developing the skills they need to tell stories when they eventually develop literacy abilities or abilities to do things on their own."

The technology has been tested in a week-long trial by two pupils, who attend Capability Scotland's Corseford School in Renfrewshire. Sue Williams, headteacher at Corseford School said: "In the week we used the system we found it very useful. It allows children to take control of the conversation."

Nicole Vallery 11, with  cerebral palsy, said: "I was happy to take part.. It made me feel good about myself." Also taking part in the trials was Rebecca Clelland.

Sue Williams, head teacher at Capability Scotland's Corseford School in Kilbarchan, said: " We found it very useful to pupils, teachers, therapists and parents alike. It allows children to take control of the conversation without having to rely on help from us."

Galloway Gazette
BBC