Survey Automation Report and Workshop Proceedings (2003) / Chapter Skim
Currently Skimming:
Model-Based Testing in Survey Automation
Model-Based Testing in Survey Automation
Pages 137-152
The Chapter Skim interface presents what we've algorithmically identified as the most significant single chunk of text within every page in the chapter.
Select key terms on the right to highlight them within pages of the chapter.
From page 137... ...
We're about a half-hour off schedule so hopefully we'll malce up a little bit of time. But we're doing allay.
|
From page 138... ...
I lcnow of a project before my time at Microsoft where if you're familiar with software bug trends usually the bug trend towards the early part of a project starts up here and then comes down here, and you lcind of say, here's where we're going to release. There was a project where it was essentially a big bowl of mud and every time you fixed something you brolce more things.
|
From page 139... ...
It sounds lilac it's good, but actually it is a bit of fool's gold to you, because what it does is you are doing scripted automation, picking your way through the questionnaire. You're actually looking for bugs, but by the time yol1 get that automation path working, that automation path has pretty much found all the bugs you're going to find.
|
From page 140... ...
And it's actually lcind of hard to test because, for instance, it's hard to tell what time it is for your automation. 40This refers to the NT Clock, a Microsoft Windows accessory program that displays the current time in digital or analog format.
|
From page 141... ...
SOURCE: Worlcshop presentation by Harry Robinson. 141 Married Separated Divorced Spouse's Age?
|
From page 142... ...
By the time you've checked it in to your test case manager, it is not of much use to you anymore. And it's even worse because once you've started migrating over to different systems, different test environments, then you're porting code that isn't much use to you anymore.
|
From page 143... ...
is a set of conventions and protocols by which a software application program can interact with the computer's operating system and other services. It provides the building blocks by which programmers can construct software that is consistent with the operating system but in a manner which can facilitate portability of code.
|
From page 144... ...
curves back onto itself you can say, "if I have an invalid input, then I will process the invalid input and come right back to the question." So you would end up having little loops along there. One thing there that I thought you were going to ask is what if they were something lilce, "OIC, I'm on Imarital status)
|
From page 145... ...
SO, for instance, I'd be interested in the correspondence between a postman walk and the basis paths; it seems lilac a there's a strict correlation going on. What if you just delivered a questionnaire to me and we need a reallyfast thing that just says: are the questions right?
|
From page 146... ...
People can be hands-on for other stuff. SO, for instance, if you lcnow that you don't want a spouse to have an age excuse me, divorced spouse if you don't want a divorced spouse to have an age, you could actually put into your model checker something that says, "if I have divorce and an age, then something has gone wrong; I've gone down a wrong path to an invalid statement.
|
From page 147... ...
You need not model it that way, though; you can model it as a finite state machine. It would be a big one, but you are doing a different sort of implementation than they are .
|
From page 148... ...
ROBINSON: OIC, so what's the comparison of the effort levels? I have a quote on this; it's about 10 percent, because what you're doing is modelling the fairly straightforward parts, and you're not doing stuff lilac database accesses, and you're not doing communications.
|
From page 149... ...
So you begin to evolve for instance, if you have 5 on the thin ones and 1 on the thick blue ones, that would weight 4. That would weight 18, another 18, 2O, 2O, and so what you end up doing is lcind of generating this cocoon of regression tests around the area where yol1 found the bug.
|
From page 150... ...
Because nobody cares how many bugs you found; they want to lcnow how many bugs you didn't and left in. Number of test cases if you can generate test cases, then the member of test cases gets a little bit iffy.
|
From page 151... ...
One of the reasons I ended up in the position I'm in is partly because more people need to hear about this lcind of testing. Right now, what they're doing is pulling in people from the street to test, and those aren't the people we need.
|
From page 152... ...
PARTICIPANT: Do yolk rephrase it? ROBINSON: No; what I'm doing is putting together a talk about how liberal arts majors malce the best testers .
|
Key Terms
This material may be derived from roughly machine-read images, and so is provided only to facilitate research.
More
information on Chapter Skim is available.