Sunday, December 7, 2008

Measuring the Value of Testing

One of the best and most obvious ways to excel in any company is to show how your work is making the company money, or providing value that directly leads to making the company money. The more directly you can show your connection to how much money is being made, the better position you're in. For instance, if you can easily show that the feature you developed, or the feature you designed and brought to market, made the company $X over a time frame of Y years, you're doing well. If you can optimize the function such that X is large and Y is small, you're on a fast track to upper-management.

Showing this sort of result in testing is a much harder proposition. It's easy to say that you tested a feature or product that made $X over a time frame of Y years, but lets be honest here: being the product manager or lead developer and making the same statement definitely carries more weight when attached to a resume. The person generating the idea and the person originally implementing the idea will always be seen as being closer to the end result and positive cash flow than the person ensuring the value of the idea, and ensuring that the mass market can actually use your idea as expected. I'm not saying that this is "the way things should be", I'm just stating it's the way things are.

That being said, here's why I think demonstrating the value you've directly provided to a product is harder for testers: you can't show the diff between what the product would have made had the bugs you found been released to the public. That is an alternate reality we don't have access to; it's an A-B test that can't be run.
If it were possible to conclusively show that the company made $Z more because of the bugs that had been found, I think testing would be taken more seriously across the industry.

52 comments:

CyndyMW said...

Hi Ryan,

Interesting post, and I completely agree. As a Business Intelligence architect, I still struggle with how we can prove value to the company, and we're supposed to be the people in the organization with both the data and the analytical tools at hand.

Here's something to think about. When you identify a bug, there are risks associated with that bug having gone to market. Losses of revenue, possibly for a customer that could have been a long-term client. If you take a risk analysis approach, you may find that there are some decent risk models already developed by someone for measuring things that aren't unique to your business, like loss of customers.

In the end, it's all still a guessing game. I think you either work for a company that values QA, or you don't. Since I think Xobni is great (I found your blog through their web site), I'm pretty sure you're in the first group. In that case, you don't have to prove your value. It's understood, and it's priceless.

Anonymous said...

Can anyone recommend the well-priced IT automation software for a small IT service company like mine? Does anyone use Kaseya.com or GFI.com? How do they compare to these guys I found recently: N-able N-central system management
? What is your best take in cost vs performance among those three? I need a good advice please... Thanks in advance!

Anonymous said...

Your blog keeps getting better and better! Your older articles are not as good as newer ones you have a lot more creativity and originality now keep it up!

Anonymous said...

[url=http://www.kfarbair.com][img]http://www.kfarbair.com/_images/_photos/photo_big8.jpg[/img][/url]

מלון [url=http://www.kfarbair.com]כפר בעיר[/url] - אווירה כפרית, [url=http://www.kfarbair.com/about.html]חדרים[/url] מרווחים, שירות חדרים, אינטימיות, שלווה, [url=http://kfarbair.com/services.html]שקט[/url] . אנחנו מספקים שירותי אירוח מגוונים כמו כן ישנו במקום שירות חדרים המכיל [url=http://www.kfarbair.com/eng/index.html]אחרוחות רומנטיות[/url] במחירים מפתיעים אשר יוגשו ישירות לחדרכם!

לפרטים אנא גשו לעמוד המלון - [url=http://kfarbair.com]כפר בעיר[/url] [url=http://www.kfarbair.com/contact.html][img]http://www.kfarbair.com/_images/apixel.gif[/img][/url]

Anonymous said...

Advance America Cash Advance middot Bookmark and Share of Arizona families make. Our hassle free payday loan service is here to help you with all of your urgent.

Anonymous said...

[u][b]Xrumer[/b][/u]

[b]Xrumer SEO Professionals

As Xrumer experts, we secure been using [url=http://www.xrumer-seo.com]Xrumer[/url] fitted a sustained leisure for the time being and remember how to harness the titanic power of Xrumer and turn it into a Banknotes machine.

We also provide the cheapest prices on the market. Diverse competitors desire cost 2x or temperate 3x and a destiny of the time 5x what we debt you. But we feel in providing enormous help at a small affordable rate. The unbroken incidental of purchasing Xrumer blasts is because it is a cheaper variant to buying Xrumer. So we aim to stifle that thought in recollection and afford you with the cheapest rate possible.

Not only do we be suffering with the best prices but our turnaround heyday for the treatment of your Xrumer posting is super fast. We compel have your posting done before you certain it.

We also outfit you with a ample log of successful posts on different forums. So that you can notice also in behalf of yourself the power of Xrumer and how we get harnessed it to gain your site.[/b]


[b]Search Engine Optimization

Using Xrumer you can think to distinguish thousands upon thousands of backlinks over the extent of your site. Many of the forums that your Install you intent be posted on oblige high PageRank. Having your association on these sites can categorically expropriate build up some crown grade recoil from links and as a matter of fact riding-boot your Alexa Rating and Google PageRank rating utterly the roof.

This is making your position more and more popular. And with this increase in celebrity as superbly as PageRank you can expect to lead your milieu really filthy high-pitched in those Search Engine Results.
Transport

The amount of traffic that can be obtained by harnessing the power of Xrumer is enormous. You are publishing your plat to tens of thousands of forums. With our higher packages you may even be publishing your site to HUNDREDS of THOUSANDS of forums. Imagine 1 post on a stylish forum last will and testament almost always rig out 1000 or so views, with announce ' 100 of those people visiting your site. Now imagine tens of thousands of posts on celebrated forums all getting 1000 views each. Your see trade liking withdraw because of the roof.

These are all targeted visitors that are interested or curious far your site. Imagine how innumerable sales or leads you can fulfil with this colossal loads of targeted visitors. You are literally stumbling upon a goldmine primed to be picked and profited from.

Reminisce over, Traffic is Money.
[/b]

GO YOUR CHEAPLY DEFAME TODAY:


http://www.xrumer-seo.com

Anonymous said...

Nice fill someone in on and this enter helped me alot in my college assignement. Thanks you on your information.

Anonymous said...

Infatuation casinos? junkets invariable of this girlish [url=http://www.realcazinoz.com]casino[/url] commander and appropriate up online casino games like slots, blackjack, roulette, baccarat and more at www.realcazinoz.com .
you can also receive document to our additional [url=http://freecasinogames2010.webs.com]casino[/url] orientate at http://freecasinogames2010.webs.com and revive primeval bucks !
another board [url=http://www.ttittancasino.com]casino spiele[/url] allure is www.ttittancasino.com , because german gamblers, flyover unconstrained online casino bonus.

Anonymous said...

Well I agree but I think the list inform should secure more info then it has.

Anonymous said...

Genial dispatch and this fill someone in on helped me alot in my college assignement. Say thank you you as your information.

Anonymous said...

I really like when people are expressing their opinion and thought. So I like the way you are writing

Anonymous said...

Amiable post and this mail helped me alot in my college assignement. Thanks you for your information.

Anonymous said...

Dear Peter,

For long time I use this freeware: [url=http://www.freeflvtomp3converter.com]FLV to MP3 free converter[/url].

FLV to MP3 free converter is a free YouTube, MegaVideo, Yikers and similar video sites to MP3 Converter and allows you to convert a video to MP3 file.

This software is fast, free, and requires no signup. All you need is a FLV Video file, and this software will extract the MP3, and give you an audio file.

So you are able to listen to your favorite YouTube tracks on every MP3 player.

You can download it for free at [url=http://www.freeflvtomp3converter.com]www.freeflvtomp3converter.com[/url].

This may be useful to you.

Anonymous said...

good afternoon people. I'm honestly into shoes and I was searching for the sake of that exact brand. The prices for the boots are all over 240 pounds on every page. But completely I base this area selling them someone is concerned half price. I in reality like those [url=http://www.shoesempire.com]prada sneakers[/url]. I will absolutely purchase those. what is your opinion?

Anonymous said...

hi ppl. I'm actually into shoes and I have been digging for the sake of that exact brand. The prices seeking the shoes were around 250 bucks on every page. But completely I set this locate selling them as a remedy for half price. I really love these [url=http://www.shoesempire.com]prada sneakers[/url]. I will probably buy these. what can you tell me about these?

Anonymous said...

Hello. And Bye.

Anonymous said...

Good post and this fill someone in on helped me alot in my college assignement. Gratefulness you for your information.

Anonymous said...

Nice brief and this mail helped me alot in my college assignement. Thanks you on your information.

Anonymous said...

good afternoon bros. I'm actually into shoes and I have been looking for that exact make. The prices as regards the shoes are about 310 dollars on every page. But finally I set this area selling them for the benefit of half price. I really want those [url=http://www.shoesempire.com]gucci sneakers[/url]. I will probably order them. what do you think?

Anonymous said...

hi dudes. I'm actually into shoes and I had been looking allowing for regarding that particular make. The prices for the shoes were about 220 pounds everwhere. But completely I found this locate selling them for the benefit of half price. I absolutely like these [url=http://www.shoesempire.com]gucci sneakers[/url]. I will definetly buy these. what can you tell me about these?

Anonymous said...

i easily adore your own posting way, very exciting.
don't quit as well as keep creating as a result it just good worth to follow it.
looking forward to find out way more of your content pieces, have a great day :)

Anonymous said...

Correctly your article helped me altogether much in my college assignment. Hats incorrect to you post, choice look forward in behalf of more cognate articles in a jiffy as its united of my pet issue to read.

Anonymous said...

i without a doubt enjoy your own writing kind, very remarkable.
don't give up and also keep writing in all honesty , because it just simply very well worth to read it.
looking forward to look at more of your web content, have a great day ;)

Anonymous said...

http://www.pornvideoonline.info

http://www.pornvideodownload.info

www.pornvideotorrent.info

http://www.gaypornonline.info/

www.teenpornonline.info

www.freepornvideosonline.info

http://www.bestpornvideo.info

[url=http://www.pornvideoonline.info]Porn video online[/url]
[url=http://www.pornvideodownload.info]Porn video download[/url]
[url=http://www.pornvideotorrent.info]Porn video torrent[/url]
[url=http://www.gaypornonline.info]Gay porn online[/url]
[url=http://www.teenpornonline.info]Teen porn online[/url]
[url=http://www.freepornvideosonline.info]Free porn videos online[/url]
[url=http://www.bestpornvideo.info]Best porn video[/url]

Anonymous said...

vimax pills - good blog friends! Post your article which is also useful for readers and to share information or experiences you have. I will visit your blog again. penis enlargement pills - http://www.male-sexual.com

Anonymous said...

hello, quality content
in what way to create blog posts which smash in all:
http://tinyurl.com/ygoucz2

Anonymous said...

i came across, lovely web site
the way to create blog posts who smash in visitors:
http://tinyurl.com/yjn5wad

Anonymous said...

Sorry for my bad english. Thank you so much for your good post. Your post helped me in my college assignment, If you can provide me more details please email me.

Anonymous said...

Hi
Very nice and intrestingss story.

Anonymous said...

address for [b]download software for windows[/b] are available here:

download software for windows
[url=http://www.downloadsoftwareforwindows]download software for windows[/url]

[url=http://www.downloadsoftwareforwindows/products/download-dvd-ripper/productpage.php]download dvd ripper[/url]

download dvd to ipod converter

Anonymous said...

Pretty interesting place you've got here. Thank you for it. I like such topics and anything connected to this matter. I would like to read more soon.

Avril Simpson

Anonymous said...

Rather nice place you've got here. Thanx for it. I like such themes and everything that is connected to this matter. I would like to read more soon.

Julia Simpson

Anonymous said...

It is rather interesting for me to read the article. Thanx for it. I like such themes and everything connected to this matter. I definitely want to read more on that blog soon.

Bella Kuree
escort girls suisse romande

Anonymous said...

ugg cozy ugg size 9 ugg infant booties http://www.vtallboots.org.uk [url=http://www.vtallboots.org.uk][img]http://www.vtallboots.org.uk/images/ugg-boots.jpg alt="ugg boots" title="ugg"[/img][/url]
[url=http://www.vtallboots.org.uk/#a6z46q05u][b]http://www.vtallboots.org.uk[/b][/url]
[url=http://www.bootssecher.co.uk/#x6j15g21k][b]www.bootssecher.co.uk[/b][/url]
[url=http://www.fdidboots.co.uk/#v3h63h29y][b]ugg boots[/b][/url]

Anonymous said...

http://chameleon17095.soup.io/post/296433551/Kopi-Luwak-The-Most-Expensive-Which-Ones Upon further study, it has beenfound that the flavonoids in dark chocolate are scientificallyproven to act as antioxidants, preventing bad cholesterol LDLin the blood from oxidizing and clogging arteries. [url=http://saltheesfeldonlinestation.beeplog.com/303811_1591635.htm]pure green coffee bean extract reviews[/url] The latest study, by experts at the World Cancer Research Fund, is the biggest- ever review of research. It updates the fund's cancer prevention report in 2007, which looked at many different types of the disease. http://dwightbran.insanejournal.com/645.html

Anonymous said...

I do not even know how I ended up here, but I thought this post was good.

I don't know who you are but definitely you are going to a famous blogger if you aren't already ;
) Cheers!

Also visit my site: homepage

Anonymous said...

you must read YerYGNyQ [URL=http://www.cheapguccireplica.tumblr.com/]gucci outlet online[/URL] for less cYNJbpVR [URL=http://www.cheapguccireplica.tumblr.com/ ] http://www.cheapguccireplica.tumblr.com/ [/URL]

Anonymous said...

cheap APgWNCGn [URL=http://www.cheapguccireplica.tumblr.com/]outlet gucci[/URL] to your friends pkQjYnVM [URL=http://www.cheapguccireplica.tumblr.com/ ] http://www.cheapguccireplica.tumblr.com/ [/URL]

Anonymous said...

order an DrKEvBDV [URL=http://www.cheapdesigner--handbags.weebly.com/]designer handbags outlet[/URL] to get new coupon TnOCwdff [URL=http://www.cheapdesigner--handbags.weebly.com/ ] http://www.cheapdesigner--handbags.weebly.com/ [/URL]

Anonymous said...

you definitely love CNyHyxVB [URL=http://www.cheapdesigner--handbags.weebly.com/]designer handbags for less[/URL] for more detail ErwvVHrw [URL=http://www.cheapdesigner--handbags.weebly.com/ ] http://www.cheapdesigner--handbags.weebly.com/ [/URL]

Anonymous said...

[url=http://www.g-wang.com/forum.php?mod=viewthread&tid=31668]beats dr dre[/url] connection 50: ultimate 22 video recovery (Blu-ray)attach video range from ultra campy in order to really dark colored and desirable, he then located allows you to bless the 007 nut that you simply with they all together. start quarrelling across regardless of if Daniel Craig is just too big durable to the purpose in 3. 2.


[url=http://www.soogay.tk/viewthread.php?tid=107053&extra=]dre beats solo[/url] poker casino chips, on the other hand poker tokens, are experienced at keep a record during gambling and so get new moolah the actual game. regardless of whether internet poker casino chips are clay-based, holdem poker food sets aren't entirely constructed clay. often clay surfaces is commonly employed for the reason that filler, But number of washes combined with some man-made ingredients materials when staying power.


http://www.beatsbydrevogue.com self tanning creams might be among the many which you can purchase from Sun laboratories, the best vendors for greater-higher quality tanning units. they are estimated to be secure and efficient the actual active component within these products could be described as DHA gives a browning interaction on the epidermis. possible eliminate hasty growing older because sun's uv sun merely considering people makeup possess which drink plenty of water and hydrate your skin,

Anonymous said...

It's an amazing paragraph designed for all the online visitors; they will obtain benefit from it I am sure.

Also visit my blog :: http://teengangbangs.net

Anonymous said...

[b][url=http://luohe.douanju.com/bbs/forum.php?mod=viewthread&tid=399361]hermès birkin handbag[/url][/b] "The standard buyer merely in the rooms, excepting personal needs, stated morals wish that Consolo, Chairman within merchandising rental and as well,as well as the marketing strategies at their Prudential Douglas Elliman. Penney, Wal-Mart combined with interior-more attention retailer Lowe's Cos. All considered they will be realizing their have become merging hunting events to reduce unwanted gas considering the frequent selling price tag moves just by the $4 a gallon,


[b][url=http://nccx.hbut.edu.cn/bbs/forum.php?mod=viewthread&tid=344201]hermes online shop[/url][/b] Gabon. Gambia. Gazy. Mongolija. Montserrat. Marokas. price needed auto are really a first-rate substitute in can't afford to purchase brand new ones. it is always largely appropriative for assorted reasons and thus web users. here vehicles can be found virtually some coupled with well liked assuming you have poorer using instruments moderately is lower.


[b][url=http://www.23hq.com/shr7imp1nerve/story/10282599]leather bags for women[/url][/b] 9: rules to break choice to disobey. concert tours: Jenny Mitchell this audacious and consequently superb living your life venue/dining. device, sense, make up specimens caused by my own, personal space on creating a phenomenal vignette and consequently ensuring that your favorite plans will definitely be good to a person's eye.

Anonymous said...

here in this web site you can see a large collection of interesting articles about [url=http://www.rk-37.ru/]уход за кожей 25 лет[/url].

Anonymous said...

thanks ar ar condicionado automotivo, de, ar condicionado automotivo ar,ar condicionado automotivo, ar condicionado automotivo, -,ar condicionado automotivo,- ar condicionado automotivo, carro ar ar de carro, de ar
thanks ar ar condicionado automotivo, de, ar condicionado automotivo ar,ar condicionado automotivo, ar condicionado automotivo, -,ar condicionado automotivo,- ar condicionado automotivo, carro ar ar de carro, de ar

Anonymous said...

[url=http://www.kellybagsonsale.com]hermes replica[/url] retain and collect you are salt in great, bluish destination, perhaps a showcase or even a pantry. this will be to a degree anticipated Chanel's history and iconography: all of the quilt-making, as an example, as well 'matelasse', is generally effective at your woman's love driving a fresh as gal (Quilted product turned out to be to begin with put on most effective from good-space), because the brand cycle attached to senior alloy plaited accompanying a wash rag power cord gives identical connotations deer but bridles girdles, too as perhaps it is through garb put because of Catholic nuns people who skilled Coco as a thoughtful hermes versand sendungsstatus young woman.


release very important personel webstore, [url=http://www.kellybagsonsale.com]http://www.kellybagsonsale.com[/url] Those superb spend massive ought to think a bit more than these people do you think before any time taking out their precious american platinum eagle or titanium bank cards. A strong feminine needs a brand of dark household leather rucksack that fits her career. it is recommended that you buy numerous art gis, particularly if you expect go to type a few times a week.


[url=http://www.newbagsforwomen.com]hermes bags[/url] but additionally they all got by working with Jenna Welch, Laura Bush's mother, internal security and safety adviser Condie rice and in addition white wines new home the biggest related with office members visa or mastercardy to achieve drinks for the veranda with a meal. you are able to, really do not obtain just about every advertiser or it may be affiliate ad which experts claim arrives on your website-all of the promotional advertisements will most certainly be presented by just third time promotional makers, Hermes net site


just about allduplicate [url=http://www.prettybirkinbags.com]http://www.prettybirkinbags.com[/url] lunchtime, obtain a serving regarding walnuts, Olives not to mention tomato plants, and something larger blueberry. case study volunteers received conjointly of course hermes while in paris, europe, actual track-united parcel service that listed psychic readings and blood screening intended for cholestrerol levels and other reasons may well harm the hermes gear risks cardiac problems,

Anonymous said...

[url=http://www.bagsml.com/]chanel store[/url] easiest way vigorous designs make a difference blood testing fri, scar 22, 2013 i believe it's an outstanding place when you'll makes a conclusion to take healthy and well balanced habits a priority later on in life. frequent, a person who has produced of which choice makes several things at once. which. get yourself an exercise more 禄


[url=http://www.bagsmik.com/]chanel purses handbags[/url] indiana ladies preferences


This short article may by default lid imitation leather shopping bags. bamboo and plastic-type materil purses are really simple to clean at mild water and soap. designer bags crafted from awesome solutions, comparable to snakeskin, Are not a good at-home build it yourself cleaning it development,

[url=http://www.bagsml.com/]www.bagsml.com[/url]

Related articles:

[url=http://www.cardiar.com/upload/read.php?tid=3067879]fashion fair mall wey596cka
[/url]
[url=http://1msg.mobi/blogs/63733/102249/chanel-black-bag-chanel-bags-for]fashion jackets eyq198xsn
[/url]
[url=http://www.tianyulamp.net/forum.php?mod=viewthread&tid=1478864]boots fashion ntc961hbi
[/url]
[url=http://perfectsoul.com/blogs/entry/chanel-handbag-price-chanel-glasses-jgp605wsq]fashion clothing stores qty299usv
[/url]
[url=http://www.ursecond.com/story.php?title=chanel-suit]catwalk fashion cho362svt
[/url]

Anonymous said...

http://hermessale.finniwolf.com mark it down as a form f financial stock. He distinctly pronounced that if the invaders droped and cannot in pain our team any longer, we make it possible for as well as,while keep these folks, petite replace: or perhaps ever endured the matter that you need to buy something small but successful unfortunately have on appear to provide just about flip.
http://hermessale.finniwolf.com

Anonymous said...

Link exchange is nothing else however it is simply placing
the other person's webpage link on your page at suitable place and other person will also do similar in favor of you.

Also visit my page the full details

Anonymous said...

If you want to take a good deal from this piece of writing then you have to apply these techniques
to your won web site.

my site: 2013 at 12:56 am

Anonymous said...

carbon dating system http://loveepicentre.com/articles/ sugar daddy dating sites
online dating mistakes [url=http://loveepicentre.com]dating a full figured woman[/url] june green dating
maksim dating cheryl burke [url=http://loveepicentre.com]online dating website wellesley harvard mit[/url] online dating websites canada [url=http://loveepicentre.com/user/SkunkliX/]SkunkliX[/url] is kat still dating nikki sixx

Bungalows For Sale Ontario said...

Ryan, your article highlights a critical challenge in the field of software testing: quantifying the value that testers add to a company's bottom line. The comparison you draw between the visibility of a product manager's or developer's contributions and those of testers is both insightful and accurate. It's true that while testers play a crucial role in ensuring product quality and usability, their impact often goes unnoticed because it's difficult to measure the "what-if" scenarios of undetected bugs.

Your discussion about the impossibility of running an A-B test to compare the product with and without the bugs found by testers underscores the unique difficulties in showcasing the tangible benefits of testing. The perspective you offer is a valuable reminder of the hidden yet significant contributions testers make to a company's success. Thank you for shedding light on this often-overlooked aspect of software development and for advocating for the recognition of testers' efforts.