For high-tech giants like Google and Amazon, using top-notch technology for software automation testing to help ensure product quality is routine. But for many startups in growth mode, this aspect of product development is either never considered or simply seen as aspirational.
Although we are a startup, product quality is a top priority at Bitcasa so QA automation is a requirement. For example, automation allows us to test application layers to make sure our APIs are working as designed. There is no other way to test the application layer effectively. If we only test from the UI level, it’s partial testing which is not an option for us.
Our QA Automation Team writes programs that simulate user behavior directly on the API layer. User interfacing software connects to a huge application later that users don’t see. By plugging requests into the APIs, we’re able to mimic user actions without touching the UI. This is a critical step to ensure Bitcasa partners and their customers get a high-quality user experience.
Performance, load and stress testing are part of our automation. Together, they help us to determine the health of our platform builds.
It’s always a challenge to know precisely how many users simultaneously connect to Bitcasa and call APIs. To solve for this, we’ve created a program that simulates thousands of calls at the same time. The automation software generates thousands of calls coming from the UI to the application layer to measure speed of our traffic when we’re loaded. This helps us discover when the system slows down.
The load test makes sure our system can handle a certain amount of traffic. The number is determined from PRD. But rather than just running those numbers, our QA Automation Team might double or triple that number.
Where does the system break? How many users can call in before there’s real trouble? The stress test is critical to complete the automation software testing. This is a different approach from the prior tests, so the goals are different and the results of the testing are different.
The success of our partners and the satisfaction level of their customers ultimately drives our business. That’s why we’ve committed to state-of-the-art automation testing. And also why we hire QA engineers who are multi-skilled and understand all different platforms and productions, including iOS, Windows and mobile products. With our focus on recruiting top-notch engineers and product quality, our partners reap the benefits.