Fig.4.InputsandoutputsofSUTasseenfromm-Test
3.2TestEngine
Thetestexecutionengine,whichexecutestheLTSstatemachine,consistedoffourparts:executionengineTestRunner,statemodelModel,transitionselectorChooser,andkeywordproxySUTAdapter(seeFigure3).TestRunnerwasresponsibleforex-ecutingtransitioneventsselectedbyChooserusingthekeywordfunctionlibraryviaSUTAdapter.Basedontheresultofexecutingakeyword,TestRunnerdeterminesifthetestrunshouldcontinueornot.Iftheruncancontinue,thecyclecontinuesuntilthenumberofexecutedtransitionsexceedsthemaximumnumberofsteps.Thetestdesignerdeterminesthesteplimitthatisprovidedasaparameter.
Modelwasconstructedfromstates(State),transitions(Transition),andtheircon-nectionstoeachother.Thetestmodel(LTS)isreadfromafileandtranslatedtoastateobjectmodel,whichprovidesaccesstothestatesandtransitions.
Chooserselectsatransitiontobeexecutedinthecurrentstate.Theselectionmethodcanberandomorprobabilisticbasedonweightsattachedtothetransitions.Naturally,moreadvancedChoosercouldalsobebasedonanoperationprofile[10]orgametheory[11],forinstance.Sincethescheduleofourcasestudywastight,wechosetherandomselectionalgorithmbecauseitwastheeasiesttoimplement.
Thekeywordfunctionlibrarythatweobtainedservedasourinitialkeywordim-plementation.However,duringtheearlyphasesofthestudyitbecameapparentthatitwasnotsuitableforourpurposes.Thelibraryhadtoomuchbuilt-incontroloverthetestprocedure.Incontrast,ourapproachrequiresthatthetestverdictmustbegivenbythetestengine.ThereasonisthatsometimesafailureofaSUTisactuallythedesired
Table1.Keywordcategories
kwPressKey
kwWriteText
kwVerifyText
kwIsMenuSelected’Move’’Move’ActivatesadevicetoreceivesubsequentcommandsStartanapplicationParam.’keyLeft’’Hello’SelectamenuitemActivatesanapplicationifstarted
result.Inaddition,sincetheflowcontrolwaspartlyembeddedinthelibrary,wedidnothaveanykeywordthatwouldreportthestatusoftheSUT.Forthatreason,wecre-atedakeywordproxy(SUTAdapter).Itspurposewastohideoriginalfunctionlibrarykeywords,useorre-implementthemtofitourpurpose,andtoaddsomenewkeywords.
3.3KeywordCategories
Wediscoveredthattheremustbeatleastfivetypesofkeywords:command,navigate,query,control,andstateverification.Asanexample,somekeywordsfromeachcate-goryareshowninTable1.Thecommandtypekeywordsarethemostobviousones:TheysendinputtotheSUT,forinstance,“presskey”or“writetext”.Navigationkey-words,suchas“selectmenuitem”,areusedtonavigateintheGUI.Querykeywordsareusedtocomparetextsorimagesonthedisplay.ControlkeywordsareusedtomanagethestateoftheSUT.Thesefourkeywordgroupsarewellsuitedformostofthecommontestingsituations.However,ourapproachallowedustocreateseveralsituationswherealsothestateverificationkeywordswereneeded.StateverificationkeywordsverifythattheSUTisinsomeparticularstate(forin-stance,“Ismenutextselected“)orthatsomesporadicevent,likeaphonecall,hasoccurred.Thesekeywordswereessential,becausetheenvironmentdidnotallowustocapturesuchinformationotherwise.ThestateoftheSUTwasonlyavailablethroughindirectcluesthatwereextractedfromthedisplaybitmap.Becauseofthis,thetestmodeloccasionallymisinterpretedthestateoftheSUTormissedanevent.Thismadetestmodelingsomewhatmorecomplicatedthanweanticipated.Thebiggestdifferencebetweenthequeryandstateverificationkeywordsisintheintentoftheiruse.Queriesareusedtodeterminethepresenceoftextsetc.onthedisplay,whereasstateverificationkeywordscheckiftheGUIisinarequiredstate.ThelatterareusedtodetectiftheSUTisinawrongstate,i.e.thefailurehasoccurred.Themissingofaneventwasthemostcommonerrorinthemodel,whichoccurredoftenwhenexacttimingwasrequired(liketestinganalarm).Thisproblemwasprob-ablycausedbytheslowcommunicationbetweenQTPandm-Test.Therewereseveraloccasionswhensomeeventwasmissedjustbecausetheexecutionofakeywordwastooslowortheexecutiontimevariedbetweenruns.
3.4ModelingProcess
Whenwestartedourmodelcreationprocess,wehadthreeconstraints:tightschedule,manyfeaturestotest,andnospecificationswhatsoever.However,weobtainedauserguideofthedeviceandamorematureproductfromthesameproductfamily.Thelatterwasusedasatestoraclewhendevelopingthetestmodel.Usingthetwo,wewereabletocreateamentalmodel3ofthebehavioroftheSUTinvarioussituations.Oneofourobjectiveswastofindconcurrency-relateddefects.Weexploredmanuallythroughseveralapplicationsandtriedseveralbasicexplorationtechniqueslikeopeningthesameapplicationindifferentways.Withindays,wefoundthefirstdefect.Sincewebelievedthat“bugsaresocialcreatures”,weputmoreemphasisontheparticularapplicationinvolvedwiththefirstdefect.Afteracoupleofdays,wefoundseveralminordefectsandonemajordefect.Allthesedefectswherefoundduringthedevelopmentofthemodel.Themodelitselfconsistedofsevencomponents(asshowninFigure2)andmodeledasystemwheretwoapplicationsrunconcurrently.Aftercomposingthecomponentmodels,thefinaltestmodelconsistedof297statesand351transitions,andused17actionwordsand18keywords.Wefoundonlyoneminordefectwhileexecutingthemodel.However,itshouldbenotedthattheSUTwasalreadythoroughlytestedbeforeourcasestudybegan,andthatthemodelwasrelativelysmall.Withalargermodelandtheuseofmoreadvancedheuristics,wehopetofindmoredefects.Thefactthatseveraldefectswerediscoveredbeforethetestmodelwasexecutedismainlyduetotheoverallbenefitsofprecisemod-eling,i.e.itrevealsdefectsveryeffectively.Thisisinlinewiththesimilarobservationin[12].
3.5EvaluationofResults
Initially,ourhypothesiswasthatmodel-basedtestingissuitableforGUItestinganditcanfindmorebugsthanlinearscript-basedtesting.Wealsoacknowledgedthatmodel-basedGUItestingdoesfacethesameproblemsasconventionalGUItesting,forin-stanceindetectingthestateoftheSUT.Inthefollowing,weevaluateourfindingsandreflectthosetoourhypothesis.
Defects.Wefoundsixdefectsintotal:tworelatedtotheGalleryapplication,threetotheco-operationofGalleryandotherapplications(RealPlayerandVoiceRecorder),andonetoVoiceRecorderonly.InTable2,thedefectsaredescribedinmoredetail.Theonlycriticaldefectwas#4,whichmadeitalmostimpossibletousethedeviceafterthefailure.Thedefectwastheonlyonethathadbeotherswerepreviouslyunreported.Defects#2and#3canbeconsideredmoderatesincetheyallowcontinuingthenormaluseofthedevice.TheyonlyinterferewiththeuseoftheGalleryapplication.Defects#1,#5,and#6areminorsincetheydonoteveninterferewiththeuseoftheapplications.
猜你喜欢的内容。。。
…… model-based testing through a gui abstract. so far, model-based testing approaches have mostly been used in testing through various kinds of apis. in ......
…… automated model-based testing of communitydriven open-source gui applications zheng-wen shen
reference ? “automated model-based testing of ......
…… gui testing checklist 暂无评价 19页 免费 model-based testing thro... 16页 免费 english is difficult 7页 免费 a gui and testing tool f... 12页 ......
……index terms—gui testing, automated testing, model-based testing, guitar testing system. ? 1 introduction number of reasons. first, existing fully automatic......
……研究者们对被测gui软件建立了各种不同的 模型,即所谓基于模型的测试(model—basedtesting,mbt interface,gui)电脑xerox8010以来,通过gui操纵软件,已经成为 人们使用......
……keywords gui testing, model-based testing, test case, automated testing, event testing.
introduction graphical user interface (gui) is a program ......
……keywords gui testing, model-based testing, test case, automated testing, event testing.
introduction graphical user interface (gui) is a program ......
……gui 软件输入空间 , 以便找出更多的软件缺陷 , 研究者们对被测 gui 软件建立 了各种不同的 模型 ,即所谓基于模型的测试 (model—based testing,mbt) o对被测......
……”model-based gui testing: case smartphone camera and messaging development (unpublished manuscript)”, original figures based on utting & legeard 2007 and......
…… model‐ased?testing?with?nmodel model based testing with nmodel juhan?ernits inst.?of?cybernetics??dept.?of?comp?sci.? tallinn?university?of?......
……o pascoal faria , nikolai tillmann , and raul moreira vidal,a model-to-implementation mapping tool for automated model-based gui testing, icfem 2005 (......
…… model based testing(takahashi)model based testing(takahashi)隐藏>> reliability engineering association of japan(reaj) nii-electronic library service reliability......
……harty, “experiences of system-level model-based gui testing of an android application,” proc. int’l conf. software testing, verification and validation......
…… automated model based so... 暂无评价 5页 免费 automated test data gene.... designing and comparing automated test oracles for gui-based software ......
…… a model based testing te... 暂无评价 6页 免费 data flow analysis and ...
test strategy 1 functional testing 2 gui testing 3 ......
……it enabled driving testing processes at higher abstraction levels and demonstrating code to model compliance by means of model-based testing (mbt). models ......
…… testing evolving softwar... 暂无评价 12页 免费 model-based software tes.... rapid crash testing for continuously evolving gui-based software applications ......
…… imtc 2007 - instrumentation and measurement technology conference warsaw, poland 1-3 may 2007 (submitted) model-based test for analog integrated circuits ......
…… model-based testing of access control s...
……scaleofbasedbasedon cases cases,thispaperproposes newgui test modelnamedehg event handler function.usingthemodelandthefeaturesoftestcase event handierfunctions,......
看过本文章的还看过。。。
您可能感兴趣。。。
最新浏览记录资源分类：
简介：助学政策助我成才来自一个平凡的农村家,面对巨大的经济压力,如果没有 国家助学金的帮助,仅靠我自己,完成大学学业将困难重重, 也正因为有了国家助学金的帮助才使......
简介：助学政策_助我成才!_演讲/主持_工作范文_实用文档。助学金助学政策,助我成才 学校: 南京交通学院 学院: 建筑工程技术 班级:
姓名: 卢士清 落叶飞扬的乐......
简介：助学政策助我成才来自一个平凡的农村家,面对巨大的经济压力, 来自一个平凡的农村家,面对巨大的经济压力,如果没有 国家助学金的帮助,仅靠我自己,完成大学学业将......
简介：助学政策助我成才_其它_总结/汇报_实用文档。助学政策助我成才 助学政策助我成才 尊敬的校领导: 你们好! 我是***电气信息系 09gb 电气 1 班的 x*, 我怀......
简介：助学政策 助我成才_营销/活动策划_计划/解决方案_实用文档。助学政策 助我成才 首先,感谢国家助学金对我们贫困大学生的关怀和关爱。 作为一个来自农村的孩子,我......
简介：助学政策 助我成才助学金感谢信 敬爱的校领导,老师们,敬爱的同学们: 大家好,首先我很感谢学校为贫困生设立的助学金制度,这是我 们贫困生学习上的一种肯定,更......
简介：助学政策 助我成才”征文汇总 [来源:本站 | 作者:原创 | 日期:2010 年 1 月 22 日 | 浏览 12719 次] 【大中小】 潍坊市教育局“助学政策序 号 1 2 ......
简介：助学政策助我成才 时光飞逝, 绿树常青,定下神来想想自己已经在外语系里生活有一年多的光 景了。在这一年的学习生活中,我收获了知识,享受着快乐,仿佛校园中的每......
简介：的帮助下自己对国家生源地贷款政策有 了一个详细的了解后,通过家乡的农村信用社办理了国家助学贷款,随后学校 为我提供了勤工助学的岗位,之后我又享受到了国家助学......
简介：助学政策助我成才范文 2页 2财富值如要投诉违规内容,请到百度文库投诉中心;如要提出功能问题或意见建议,请点击此处进行反馈。 助学政策助我成才 隐藏&& “助学政策......
copyright@ 2013- Inc. All Rights Reserved 果果文库 版权所有 联系站长: ; 经营许可证编号:浙ICP备号Table2.Defectsandtheirresultingstates
TopbardisappearsfromGallery
GallerycrashesII
GUIinbusyloop
6TheselectioninGallery’smenuchangeseitherupor
downNoplaybackwithRealPlayerandnoaccesstoGalleryGallerydieswhileCamerastaysalive
basedtestingmethodologywouldfitintothenormalwayofworking.Themethodologyseemstobeanever-growingpromiseasatestingapproach,buttherehasnotbeensomanyindustrialexperiencespublished,especiallyintheGUIsetting.
4.1TheFirstStep
Onestartinggoalwastoevaluatehowexistingtestassetscouldbeusedintransitiontomodel-basedtesting.Itseemsthatthesteptowardsitmightnotbeassteepasassumed.Naturally,model-basedtestingisanewconcepttomosttesters.However,withsomereal-lifetestingscenariosanddemonstrationsitwaspossibletodisseminateinformationwhilekeepingapracticalpointofview.
Afterinitialphase,thelift-offwasrapidandwecouldgetsomeresultsquitefast.Be-causeoftheselectedapproach,themodelwasgeneratedmanually.Naturally,itwouldbemoreinterestingtobeabletotakeitintousedirectlyfromamodelingtoolusedbydesignersorgenerateitsemi-automatically.Creationofthetestmodelwasquitestraightforwardandthemodelcreatedinthebeginningkeptitsoriginalbasiccontentquitewell,i.e.maintenanceeffortassociatedwiththemodelwasnotanissuehere.ThetoolsselectedasanunderlyingGUItestautomationhavebeenusedfortestingtheactualproducts.Therewerecertainfunctionalityandperformanceproblems,butotherwisethetoolssuitedquitewellforthenewapproach.However,VisualBasicScriptwasfoundtobequitelimitedwithregardtoprogrammingcapabilities.
Itwouldhavebeeninterestingtoseehowthepracticaldeploymentoftheapproachwouldhavesucceeded.Thecommercialtoolsusedinthestudyarefamiliartotestersoftheproducts,buttheTVTtoolsetisanunsupporteduniversityprototype,anditsdeploymentwouldhavetakensomeeffort.
4.2TheNextStep
Fromapracticaltestmanagementpointofview,model-basedtestingrequiresamind-setchangefromtestsuitesandtestcasestotestmodels.Reportingthetestresultsisdifferentfromthetraditionaltestcases.Withagoodmodel,youcancovermanytestcasesandmore,butitisnoteasytomapfullythecoverageofthemodeltothecoverageoftheconventionaltestcases.Thetestmanagementaspectwouldalsorequirefurtherstudiesonhowtotacklethesituationfromthepointofviewofmetricscollectingandtestdesign.ThishasalsobeennoticedearlierbyRobinson[13].Additionalquestionswouldalsoincludewhethermodel-basedtestingismetrics-wisemoreeffectivethanconventionaltechniquesasApfelbaumandDoyle[14]suggest.Itisalsounclearhowmuchtimeandmoneythedeploymentofmodel-basedtestingwouldtake,andhowthecompetencesofthetestingpersonnelshouldbedeveloped.
Anotherinterestingstudytopicwouldbetoinvestigatewheretoobtainthemodel.Ifwewouldobtainadesignmodel,howitshouldbemodifiedtobeusedasatestmodel?Moreresearchisalsoneeededonhowwellmodel-basedtestingrespondstothechangesintheproductfamily,i.e.howportabletheactionwordandkeywordarchitectureiswhenaSUTundergoeschangesatdifferentlevels(operatingsystemvs.applicationsoftware,GUIlanguagesandlocales),whichallcreatenewproductvariants.
Reusabilityandportabilityarepromisesofmodel-basedtesting.Thus,itshouldbeinvestigatedhowthetestingofrelativelysimilarkindsofproductswithinoneproductfamilywouldbenefitfromamodel-basedapproach.Infurtherstudies,model-basedtechniquesshouldbeusedinareal-lifetestingprojectalreadyfromthebeginning.Thiswouldallowustoobservewhatkindsofdefectsitwouldreveal.Theproductdevelop-mentcyclewouldbeenhancedifwecouldfindthemostcriticalonesfirst.
5RelatedWork
Therehasbeensomeresearchintheareaofmodel-basedtestingofGUIsystems.TheideaofusinggeneralpurposeGUItestautomationtoolsformodel-basedtestingorigi-natesfromRobinson[15].Ostrandet.al.[16]proposedavisualtestdesignenvironmenttocreate,edit,andmaintaintestscripts.TheyusedcommercialtesttooltocaptureGUIinformationandreplaythatinformationbacktotheSUT.MemonproposedinhisPh.D.thesis[17]aframeworkfortestingGUIapplications.TheframeworkisbasedontheknowledgeofGUIcomponents.TheauthorderivestestcasesfromGUIstructureandusage,measurestestcoverageanddeterminesthecorrectactionsoftheGUIusinganoraclebasedonpreviouslygeneratedtestcasesandrun-timeexecutioninformation.Belli[18]extendedstatemachinestoshownotonlycorrectGUIactionsbutalsoincorrecttransitions.However,inthiscontext,theauthorprefersregularexpressiontostatemachines.IntheSymbiansetting,therearesomefundamentalrestrictionscomparedtocon-ventionalGUItesting.Unlikeusually,thereisnoaccesstotheGUIresources,whichmakescomparisonsmuchharder.Insteadofcomparingvaluesoftextfields,forin-paredtoBuwalda’swork[3],insteadofdefiningfinitestatemachinesusingspreadsheets,weuseLTSs,whichisprobablythesimplestvisualformalismforthepurpose.Toavoidtheusualproblemofvisualmodelsbeingcluttered,werestricttosmallcomponentmodelsthatarecomposedautomatically.WemapactionwordstokeywordsusingseparaterefinementmachinesthatarealsodefinedasLTSs.Further-more,aseparateheuristiccomponentisusedtowalkthroughthemodel.Anexampleofarelatedindustrialtoolformodel-basedtestingisConformiqTestGenerator[19].paredtoLTSs,obviously,UMLstatema-chinesaremuchmoreexpressive.Naturally,thishelpsintestmodelingandintroducespossibilitiesfordatavariation,forinstance,bygeneratingrandomdataforinputfields.However,makingmistakesbecomeseasierwithaformalismthatismoreexpressive,especiallywhenthemodelersarenotUMLexperts.
6Conclusions
Wehavedemonstratedhowtoleveragemodel-basedtestingpracticesinsystemtestingthroughaGUI.Fortestmodeling,weproposecombiningLabeledTransitionSystems(LTSs)withactionwords,aprovenmethodforGUItesting.Suchactionmachinesarecomposedinparallelwithrefinementmachinesthatmaptheactionwordstokeywords
猜你喜欢的内容。。。
…… model-based testing through a gui abstract. so far, model-based testing approaches have mostly been used in testing through various kinds of apis. in ......
…… automated model-based testing of communitydriven open-source gui applications zheng-wen shen
reference ? “automated model-based testing of ......
…… gui testing checklist 暂无评价 19页 免费 model-based testing thro... 16页 免费 english is difficult 7页 免费 a gui and testing tool f... 12页 ......
……index terms—gui testing, automated testing, model-based testing, guitar testing system. ? 1 introduction number of reasons. first, existing fully automatic......
……研究者们对被测gui软件建立了各种不同的 模型,即所谓基于模型的测试(model—basedtesting,mbt interface,gui)电脑xerox8010以来,通过gui操纵软件,已经成为 人们使用......
……keywords gui testing, model-based testing, test case, automated testing, event testing.
introduction graphical user interface (gui) is a program ......
……keywords gui testing, model-based testing, test case, automated testing, event testing.
introduction graphical user interface (gui) is a program ......
……gui 软件输入空间 , 以便找出更多的软件缺陷 , 研究者们对被测 gui 软件建立 了各种不同的 模型 ,即所谓基于模型的测试 (model—based testing,mbt) o对被测......
……”model-based gui testing: case smartphone camera and messaging development (unpublished manuscript)”, original figures based on utting & legeard 2007 and......
…… model‐ased?testing?with?nmodel model based testing with nmodel juhan?ernits inst.?of?cybernetics??dept.?of?comp?sci.? tallinn?university?of?......
……o pascoal faria , nikolai tillmann , and raul moreira vidal,a model-to-implementation mapping tool for automated model-based gui testing, icfem 2005 (......
…… model based testing(takahashi)model based testing(takahashi)隐藏>> reliability engineering association of japan(reaj) nii-electronic library service reliability......
……harty, “experiences of system-level model-based gui testing of an android application,” proc. int’l conf. software testing, verification and validation......
…… automated model based so... 暂无评价 5页 免费 automated test data gene.... designing and comparing automated test oracles for gui-based software ......
…… a model based testing te... 暂无评价 6页 免费 data flow analysis and ...
test strategy 1 functional testing 2 gui testing 3 ......
……it enabled driving testing processes at higher abstraction levels and demonstrating code to model compliance by means of model-based testing (mbt). models ......
…… testing evolving softwar... 暂无评价 12页 免费 model-based software tes.... rapid crash testing for continuously evolving gui-based software applications ......
…… imtc 2007 - instrumentation and measurement technology conference warsaw, poland 1-3 may 2007 (submitted) model-based test for analog integrated circuits ......
…… model-based testing of access control s...
……scaleofbasedbasedon cases cases,thispaperproposes newgui test modelnamedehg event handler function.usingthemodelandthefeaturesoftestcase event handierfunctions,......
看过本文章的还看过。。。
您可能感兴趣。。。
最新浏览记录资源分类：
简介：一、保护区自然概况 自然概况一般性描述:黑龙江老爷岭东北虎国家级自然保护区位于绥阳林业局施业区南 部,地处黑龙江省牡丹江林区东宁市境内,保护区内含有三岔河林场......
简介：以保护野生东北虎栖息 地为主的珲春东北虎保护区, 一直是野生东北虎出没次数最...老爷岭南部分布区,行政区划主 要为黑龙江省的绥芬河、 东宁、 宁安等县市和......
简介：珲春-汪清-绥阳-东宁-豹地 公园跨国界保护区网络是中俄之间存在的四条生态廊道中最重要的一条, 这一生态廊道的有 效保护,将在保持东北虎和东北豹栖息地连通和......
简介：如今, 中国有野生东北虎分布的地区, 都至少靠近于边境线上。 例如, 珲春东北虎国家自然保护区位于中、朝、俄边界,汪清国家级自然保 护区隔着珲春、东宁与朝鲜、......
简介：月在珲春自然保护区开展了东北虎的监测, 分析了保护区内东北虎的活动频次、...老爷岭北部的凤凰山、鸟青山林 区和老爷岭南部、大龙岭的珲春、汪清、东宁、......
简介：北起漠河以北的黑龙江主航道(北纬 53°33 ' ) ,南至东宁 县的南端(北纬 ...二类保护动物 11 种 C 三类保护动物 10 种 D 尤其是东北虎、豹、驼鹿、猎......
简介：牡丹江市有绥芬河、东宁公路、绥芬 河铁路和牡丹江...在我们牡丹江广阔的山林中栖息着东北虎、梅花鹿、紫貂...和莲花湖省级自然保护区;有世界最大的猫科动物饲养......
简介：东安区、阳 明区、西安区、绥芬市、宁安市、海林市、穆棱市、林口县、东宁县...国家自然保护区、牡丹峰滑雪场、八女投江纪念 雕像、横道河子东北虎饲养场、......
简介：牡丹江市建成区 Ⅳb、牡丹江市域 Ⅳb-1 Ⅳb-2 Ⅳb-3 Ⅳb-4 东宁、...(2)保护建成区现有人工植被 (3)加强哈尔滨动物园、东北虎林园的管理,改善饲养......
简介：“中俄东宁—波尔塔夫卡互市贸易区”,牡丹江已经成为...在我们牡丹江广阔的山林中栖息着东北虎、梅花鹿、紫貂...下日趋吃紧,刚成立一个多月的航校向牡丹江搬迁。......
copyright@ 2013- Inc. All Rights Reserved 果果文库 版权所有 联系站长: ; 经营许可证编号:浙ICP备号