Search This Blog

Showing posts with label keyboard. Show all posts
Showing posts with label keyboard. Show all posts

Tuesday, July 17, 2012

Disciplinary Issues versus Self-Expression

This week Lawrence will be away on Wednesday, so he came on Monday instead. That was yesterday. Lawrence kept the computer on and available to Bow through the grid throughout the day, but the transcript is mostly blanks, with one possible contribution by Bow for the whole day: the single letter "E".

I can't force Bow to type. Neither can Lawrence. We have to wait for him to want to.

Some people are not convinced. They notice that Bow is potty trained, and there are rules for his behavior with people,  and there are rules about not wasting food, so they don't understand why I can't make him write in a way that demonstrates consistently that he is literate, if indeed he is literate.

"Obviously, the potty training was important to you," one person said to me once, "so you worked hard at it. If getting him to cooperate on testing were equally important to you, you might have gotten him trained to do that."

There is a certain amount of truth to this. If my goal were to have him type preset responses to preset questions perhaps I would have achieved that goal, as many others have working with non-humans and developmentally delayed humans. That was never my goal. My goal was for him to have language, and I believe the goal has been achieved.

My policy in raising Bow was similar to the way I was raised in early childhood. Nobody forced me to talk.  That came naturally. Nobody made me answer questions they already knew the answers to. I wasn't punished or rewarded for my linguistic achievements. Language is its own reward.

On the other hand, I was disciplined, but discipline was about what not to do: don't pee on the floor, don't walk and eat, don't make a mess and expect someone else to clean it up. I mean, I did make messes and other people did clean them up, but as soon as it was practically possible for me to minimize the amount of work others had to do to clean up after me, I was expected to cooperate in this regard, and there were consequences if I didn't.

Non-negotiable demands that I make on Bow are disciplinary. Don't bite people. Don't pee on the floor. Don't waste food. I enforce these rules because they make our living together possible. Bow isn't independent yet, and it makes sense that to the extent that he can, he help to make it easier for those who take care of his needs to do so with the greatest of ease.

Every once in a while, Bow tries to get around one of the rules. This morning, he left about three half eaten grapes on his plate and asked for cereal. I said: "Bow, finish the grapes."

He wouldn't, and, of course. I couldn't make him, so I just refused to serve him the cereal until he did eat them. I also explained the reason for the rule: "You've ruined those grapes for anyone else. No one is going to want to eat them. That's wasteful."

Did he understand? It doesn't really matter. He saw that I was not going to serve the cereal until he finished the grapes, so eventually he did finish them. And he got the cereal. And then he asked for a peach, and he got the peach. So everything turned out okay, and Bow did not starve, and yet the rule about not wasting food stood.

But how could I insist that he type something, if I didn't actually tell him what to type? And if I told I told him what to type, in what way would that be language? Wouldn't it be more like a dictation class?

Of course, he was spelling out words the whole time he was asking for food, but not on the computer. Why don't I just take down the letters from the glass and make the computer the only way to communicate? In my case, I have a good excuse: we would lose Hebrew. But what about Lawrence? Why don't we take the English letters off the glass and just leave Bow with the computer for talking? I asked Lawrence about that once, and he thought it was a bad idea.

Why? Because Lawrence comes once a week and has to wait for Bow to let him into his good graces. Because the current communication system works so well, and there is going to be a lot of frustration and anger on Bow's part if we deny him the security of holding our hands. But most of all, because we hope that Bow will want to use the computer in the same way that he wants to spell with us, so that he will use it as a mode of self-expression and not as a system of tasks and rewards.

This afternoon, Bow asked to go outside. I agreed, and I opened the door for him, but he changed his mind and would not go out. When I asked him why, he replied:

סתם חם שם

That means "It's just hot there." But it was an odd sounding phrase because all three words rhymed. A moment after spelling this, Bow added:

חרוז

"Rhyme." He was making a comment on the linguistic form of his earlier utterance.

This is the kind of thing that distinguishes rote training from spontaneous language use. I want Bow to do it on the computer, too. I just don't think I can force him.




Thursday, July 12, 2012

New Developments in the Text-to-Speech Keyboard

Recently my brother, Nets Hawk Katz, sent me a new keyboard program for Bow to use on his touchscreen computer. He was learning a new programming language called GameMaker and so he used it to create a new program to put on Bow's touchscreen. Nets has made the different versions of the program available for download on his site. The source code is also available in case you are interested in modifying the program yourself, but to do so you would need to get GameMaker.

The first version of the program that Nets sent me was keyboard1.exe. I downloaded the program, installed it on Bow's computer, and then I said to Bow: "Uncle Nets has sent you a new program to use on your computer. Would you like to try it?"

Bow did not answer the question directly. Instead he spelled: "Uncle Nets is good."

I took this as a positive response, and I let Bow play with the program. Here is some footage of that:
This was on July 8. Though Bow was pleased to be able to play with the program, his use of it was not especially productive. I was not able to open it for him in full screen, so it was a small window superimposed on the desktop. Bow could close the window and open other programs, and this disrupted any communicative use of the program. He had fun playing with his computer, but it was not being used as intended. Other issues were that the delay between writing and then hearing what was written pronounced seemed too long.

Nets then sent us the next version of the program: Keyboard2.exe. The delay was changed, noises were made every time a key was pressed and a transcript file was added. Nets wrote: "The keyboard writes a transcript in a file transcript.txt in the same directory where you place the executable. (This transcript contains blank lines every time the timer runs out when nothing has been written.) You don't have to remove the transcript file every time you use the keyboard. The program simply appends additional lines to the end. "


I went and installed the new version of the program as soon as I received it, but Bow did not want to try it because it was late afternoon and nearly dinner time, and after dinner he was too content and exhausted to do anything more than lie around and chew his cud. Here is some footage of me playing with second version of the keyboard, without Bow:



Nets told me I was confusing "maximize" with "full screen." I would normally get full screen by pressing F4, but that was hard to do with a touchscreen and no keyboard. I had a keyboard I could attach, but it was not in the pen. There is also a virtual keyboard as part of the operating system of the touchscreen, but I had trouble finding it. Before I found another way to resolve this issue, Nets had already written another version of the keyboard to take care of it: Keyboard3.exe. It allows for an irrevocable full screen option. Once in full screen, no way back out, other than closing the window.

Here is some footage of our use of Keyboard3.


Under Keyboard3, here are some things that Bow typed:


IJ
EKFEKUP PO



UUU


NNNNNUZ

Arguably, the last one could have been a reference to Nets, as his name is spelled NZ in Hebrew. But that might be stretching things. Bow did not seem to be using the keyboard to communicate. He was just playing. 

The keyboard is for English words. Bow and I do not speak English with each other. Hebrew text to speech is very complicated, so this keyboard is meant to be used by Bow to communicate with English speakers, such as Lawrence. By the time Lawrence came over on Wednesday to spend the day with Bow, Nets had created a new version of the keyboard: Keyboard4.exe. There was no more x for closing the window. 

I was going to leave Bow and Lawrence with the keyboard, and I was hoping that any interactions would be recorded on the transcript, but I also went out and got a cheap camera from Wal*Mart for Lawrence to film Bow using the keyboard. The transcript shows everything that is typed, but it does not show who typed it. So I wanted footage of Bow typing and a transcript to show what he typed.

However, at the end of the day, Lawrence reported that Bow would not type anything when he, Lawrence, was in the room. But when Lawrence went to empty the potty, Bow took the opportunity to use the keyboard.

This morning I looked at the transcript. Here is what I found from yesterday:

B
O

BOW

BO



WHHAT



SAY
BO


DO

U

WA
N
TO



I'm pretty sure most of that was written by Lawrence. Was any part of it by Bow? I have to find a better protocol in order to distinguish what each contributed to the text. There's no video footage, because Lawrence was charging the new camera most of the day. Pretty inconclusive...

Meanwhile, now that I have a new camera, I tried taking some still shots of Bow.

This is Bow's evening face from last night, when he was chewing his cud after dinner. Here is a shot of Bow outside this morning: