Thursday, December 16, 2010

Before we begin

"Many arguments appear to be about conclusions, when they're almost always about premises."

Before I begin, I think it's important to lay out exactly what I mean when I use certain words and phrases. Then if you disagree with me, you can decide if we're arguing about conclusions or premises. :)



Testing - I use Cem Kaner's definition of testing:
Testing is an empirical investigation conducted to provide stakeholders with information about the quality of the product or service under test.

To me, testing is more of a social science than a computer science. So what does that definition above actually mean? Let's break it down:

Empirical Investigation: "Based on, concerned with, or verifiable by observation or experience" (Oxford English Dictionary)

Let's look at Adriaan de Groot's empirical cycle:
from Wikipedia: http://en.wikipedia.org/wiki/File:Empirical_Cycle.svg
 
Observation: Observe some attribute of the application: "I observe a screen with two text input fields.  One has "username" next to it, and the other has "password" next to it. There is a "login" button and there is a "register" hyperlink.
Induction: Formulating hypothesis: In my experience, screens that have these fields in them are called "login screens" and allow registered users to access content and restrict non-registered from accessing the content.
Deduction: Creating a testable prediction based on your hypothesis:  I have not registered for this site, therefore, if I enter my login details, I should be denied access.
Testing: Test the hypothesis:  I enter "aaronhodder" in the username field, and "password" in the password field.  "Access Denied" displays.
Evaluation: Evaluate the outcome of the testing: It behaved how I expected it to behave. I have evidence that this screen may be working in a way that is consistent with other web applications.

But we're not finished

Observation: "Access denied" displays
Induction: "Access denied" displays when any user, registered or not, enters their login details
Deduction: If I enter the details of a registered user, then "Access denied" will display
Testing: Obtain the details of a known registered user and enter them in the text fields.  I am allowed access to the restricted part of the site
Evaluation: Hypothesis was incorrect, and I have further evidence that the screen may be working in a way that is consistent with other web applications
etc
etc
and so the cycle continues.

Note that the definition I use puts the tester's skills at evaluation and judgement at the centre of the testing process, not tools, or scripts.  Context over process.  Requirements over requirements documents.

Stakeholders: Developers, project managers, customers, clients, the business.  Anyone who holds a stake in the project.  It is important to know who your stakeholders are, and what is important to them to ensure that the information you are providing is useful.
Information: Examples of information: Does it do what we claim it does? Does it do what the customer wants it to do?  What defects have we found?
Quality: Here I use Gerald Weinberg's definition: Quality is value to some person with Cem Kaner's addendum: ...that matters.  Quality is value to some person that matters.  Part of the tester's role is to discover who the people are that matter, and what they value.

So that's the sum of its parts. The whole is of course much larger, and that is that testing is an active investigative process to discover and report important information about the product or service to the people that ought to know it.


I hope this makes future posts easier to understand and debate by framing it in the above context.


21 comments:

  1. Good post and good luck for the many many post to come.

    ReplyDelete
  2. Awesome post Aaron - welcome to the blogsphere and looking forward to more posts especially after such an excellent start!

    ReplyDelete

  3. I found this one pretty fascinating and it should go into my collection. Very good work! I am Impressed. We appreciate that please keep going to write more content. We are the assignment helper, we provide services all over the globe. We are best in these :- services
    Essay writing
    Essay Writer
    Article rewriter
    Essay writing service
    Essay writing help
    Write My Essay
    Write My Article
    hire writer
    Write my essay cheap
    hire article writer

    ReplyDelete
  4. Thank you for sharing this informative post.MyAssignmenthelp.co.uk is giving assignment help to students.we are already trusted by thousands of students who struggle to write their academic papers and also by those students who simply want Accounting Dissertation UK to save their time and make life easy.

    ReplyDelete
  5. Search our best SEO Services in India. Provide professional SEO Services increase Visibility of your Website on the Search Engine. Hire best SEO Company in India here.

    ReplyDelete
  6. Our Android app development company in India has worked with global clients, organizations, ISVs, businesses to create unique and excellent Android applications in cost-effective ways with a 100% money-back guarantee.

    ReplyDelete
  7. Top Native App Development Company in India, We offer Native Android & iOS App development services. Get Native App Development Services in India in the economical price range.

    ReplyDelete
  8. We offer a wide range of all types of data conversion services in India to customers across the World. We are the best virtual assistance company in India to outsource data conversion.

    Online Bookkeeping Services in India

    ReplyDelete
  9. Get the best online Pharmacy Store at superpharmacyusa.cim where you can buy affordable & best online medicines at lowest cost with full satisfaction. We offer multiple products delivery at your doorstep. You can Reach out to our experts for more details on how to buy online medicines.

    ReplyDelete
  10. Tapentadol also called Nucynta which is the best medication to get rid from chronic and acute agony. Buy Tapentadol 100mg online USA from online pharmacy to dominate from your soreness.

    Buy Modalert 200mg Online

    ReplyDelete
  11. Thanks for sharing such information!

    Before buy Tramadol 100mg online one needs to keep in mind that this is a prescription medicine. You must take this medicine only if the doctor prescribes it. You can get the medicine from the local pharmacy. But for the patient will have to go to the pharmacy. This can be a tough thing when the one is suffering from pain. Also in the case of local pharmacy one will face issues like stock-outs, strike etc. The patient also cannot choose the brand of his choice in the case of a local pharmacy.

    Buy Tapentadol 100mg Online

    ReplyDelete
  12. Very Nice Blog! Thanks For Sharing!

    If you want to buy online Medicines then visit superpharmacyusa, here we deliver best quality of online Medicines at your doorstep. You can buy Tapentadol Online or Tapetadol Cash on Delivery.

    Order Tapentadol Online
    Buy Tapentadol 100mg online
    Buy Tapentadol Online
    Tapentadol
    Buy Tapentadol
    Tapentadol 100mg
    Buy Tapentadol Online
    Tapentadol Cash on Delivery
    Tapentadol

    ReplyDelete
  13. Thanks so much for the article. It is full of great stuff that is worth reading again and again. Check out https://www.nursingggeks.com/ for excellent nursing paper writing services.
    Nursing Paper Help
    college papers for sale

    ReplyDelete
  14. The blog written is extremely impressive, with a great topic. However, a bit more research could have strengthened it even further. You can explore the services as offered by essaycorp.com, a premium academic writing services platform offering the best oman assignment with knowledge and experience.
    finance assignment
    law assignment
    programming assignment
    material assignment

    ReplyDelete
  15. This is a very educative and helpful blog post, I really learnt a lot going through it, and I must commend you for this great piece which I considered very useful to me and other readers, keep it up, thanks.federal university of agric, makurdi cut off mark

    ReplyDelete
  16. Glamyo Health is multi-speciality healthcare solution delivering Hassle free experience for all elective surgeries and cosmetic procedures with personalized care.


    remedies to treat gynecomastia
    gynecomastia surgery in india
    scarless gynecomastia treatment
    Piles Treatment in Pune
    Piles Treatment in Delhi
    Piles Treatment in Mumbai

    ReplyDelete
  17. This is a great post. I was even surprised to find it over while I was reading it. The CPs tool can be used not only to monitor your clicking speed but also as a motivating game. This article provides more information on click-through speed.Click here CPS test.

    ReplyDelete
  18. Company have highly skilled Engineering academic writers from Australia who will assist you throughout the process. Get high quality Engineering Assignment Help and outlay article writing services from our qualified academic experts that ensure quality and timely delivery of work. Our Engineering assignment writers provide students with high-quality assignment effort.

    ReplyDelete