Iridium Consulting: Determining the Optimal Test Coverage

“Software testing is the most critical but often least successful or unsatisfied phase of a project,” begins Ziad Chammaa, Managing Director, Iridium Consulting. Financial institutions continuously undertake major transformations that require tremendous testing efforts before releasing their new products. Along the process, testing turns out to be unsatisfactory, causing project delays, end-user frustration and eventually production issues. “It can be extremely difficult to decide on the amount of testing to be done; project managers often end up using best judgement to drive decisions,” says Chammaa. Being very subjective, the exact results of testing are not clear in spite of spending a lot of money. In the financial industry, trading software is extremely complex with numerous products, functionalities and analytical models, “This led us to build our testing methodology called ART (Application Release Testing), which is geared to test sophisticated applications that are complex from both functional and technical perspective,” asserts Chammaa. Based in New York, Iridium Consulting brings in a “risk” oriented methodology that answers 4 questions: What needs to be tested? How much should we test? Is the project risk properly mitigated? Is the testing process transparent and meaningful to users?

Iridium Consulting’s ART methodology is fully implemented within its flagship software BackStage—a robust application framework for data transformation, validation, reconciliation, analytics, scripting, automation and testing. These capabilities of Backstage have proven to be efficient to implement automated test cases. “We have a powerful multi-threaded scheduler that allows executing the multiple steps of a test scenario—ingesting and transforming data, calculating intermediate results and comparing them with the reference, and finally deciding if it’s a pass or a fail on the testing front,” explains Chammaa. Chammaa also adds, “What differentiates BackStage from other products, is the innovative qualitative and quantitative model for deciding what to test, and this is what determines the success of a project”.