CHALLENGE
Wells Fargo, a 150-year old bank with assets over $1 trillion was using a legacy tool to monitor the resource impact and veracity of online transactions alongside identifying impact of different jobs on CUI transaction timings.
The test setup could not analyze a test result & compare them with other results. Legacy application was also unable to pinpoint issues and took 3-5 days for completion, a cardinal sin in the highly regulated banking industry.
Excessive alerts were being generated by the legacy tool that was also utilizing a high number of resources to generate the required load on Wells Fargo’s test setup. The legacy solution was running fixed concurrent user model, a far cry from imitating real-world traffic.
PERFORMANCE TESTING PLATFORM TO IDENTIFY ISSUES BY REPLICATING REAL-WORLD SCENARIOS
To ensure their fraud management application system is able to accommodate high volume transaction, banks need to have a proper test and implementation strategy and supporting tools to ensure they are able to cater to millions of transactions every day. Thankfully with Cavisson we do not have to look around anywhere. Their consultants know their job and their technology is way more efficient and superior.
– Piyush Thakkar, VP
SOLUTION
Using NetStorm, Well Fargo was able to use a single box for performance testing, achieving the following milestones:
• Complete test result analysis for all jobs was achieved including automated partitioning of test run for each batch job on the basis of imported Autosys output.
• Production logs were ingested by our platform to replicate frauds in the test setup, increasing the bank’s capacity to handle these untoward instances.
• The overall traffic in the test setup started resembling the production data, a critical requirement for Wells Fargo.
• As mentioned earlier, the legacy tool was unable to detect issues via their fixed concurrent load model, an issue resolved by using NetStorm’s in-built arrival rate model.
• Further analysis carried out by using NetStorm’s powerful capabilities were drilldown instrumental in identifying a large concurrency issue caused by arrival rate and thereby increasing the response time.
• The underlying SQL query, the original culprit, was zeroed on and optimized thereby limiting any further damage to the customer experience.
ABOUT WELLS FARGO
Industry: Banking
Location: United States
Challenge: Legacy System unable to identify issues with online transactions resulting in excessively high MTTR.
Product Used: NetStorm
Result(s):
1) Automation of test case execution leads to reduced MTTR
2) Previously unknown issues identified using powerful drill down capabilities.
BENEFITS
NetStorm’s implementation resulted in major optimization(s) across Wells Fargo’s application ecosystem, not only in terms of the product’s ability to detect issues and replicate real-world load but also in reducing resource utilization when compared with the legacy tool. Some of the benefits derived after deploying NetStorm were as follows:
• Drastic reduction in server resource utilization as test run time reduced by over 1000%.
• Human errors were eliminated as automation was achieved for importing critical data and executing test runs in pre-prod environments.
• From using 7 performance boxes to only 1 with NetStorm, Wells Fargo witnessed 85% infrastructure cost. reduction in infrastructure cost.
• MTTR & MTTD, the two all-important metrics in terms of handling issues were reduced on the back of early issue identification in test environment.
