The path to a successful service is made up of evaluations and new attempts. In order to improve the performance constantly, it is necessary to test, analyze and make choices based on the results and the data collected. This optimization process is the key to growing users and sales.
In the first part of this first in-depth analysis dedicated to the conversion rate optimization, we have focused on the first three elements of the process (the definition of the objectives, the formulation of hypotheses on the problems of UX and the design of the changes that can have a positive impact), now we move the attention on the remaining three actions to be included in our iterative cycle.
To understand if our hypothesis is founded and if our new design is able to generate a higher number of conversions, we need to test it. To compare the effectiveness of layouts that differ for a single element (for example, the appearance or the label of a button) or a page component (for example, the footer) we can use an A/B test.
This type of test helps to measure and compare the conversion rate of the original version with a variation that incorporates the improvements identified with our research hypothesis.
Thanks to the diffusion of the online tools that allow to put it into practice even at zero cost and without the need to intervene in the page code, the A / B test has become an indispensable tool for optimizing the conversion rate. Services like Optimizely, Google Optimize and VWO help to create variations of the original page of a site or an app by simply selecting the element to be modified and making changes to the text or the design of the page. Once the test is started, the system randomly redirects the incoming traffic, making sure that new users are distributed to the two-page layouts to be tested.
The A / B test has a lot of potentials. One of the most interesting ones is the possibility of the testing changes only for certain segments of the public: returning users, those using a particular browser or device, users who have already purchased, and so on. However, the A / B test is not exempt from some critical issues. It is often impractical from very small websites because it requires a sufficient volume of traffic to guarantee the statistical significance of the results obtained.
It also has an impact on the SEO that must be considered: if it is true that search engines are tolerant to A / B tests and multivariate tests and do not normally penalize the websites that practice them, some steps must be taken to do so that Google does not believe that it is realizing the so-called “cloaking”, that is the technical one that helps to show the search engines a different content than the one actually present in the page with the aim of obtaining a better positioning in the SERP.
