Which cloud SMS service is better? Borui Data released a cloud SMS evaluation report

Introduction

Beijing Borui Hongyuan Data Technology Co., Ltd. has been focusing on the APM field for more than ten years and has provided professional data services to more than 2,000 large enterprises.

For a long time, the enterprise SMS market has lacked objective and quantifiable service quality monitoring methods to measure the real user experience of SMS services, such as whether SMS messages are received, whether SMS messages can be received in a relatively short time, etc. In order to solve this problem, Borei Data, relying on advanced evaluation technology and rich industry experience, will build a neutral, objective, open and transparent cloud SMS ranking list for monitoring SMS service quality starting from August 2021, helping enterprises to easily control SMS service quality and improve user experience.

This ranking is based on the monitoring data of Bonree Net's SMS gateway monitoring products, and regularly outputs evaluation reports. It is committed to solving the current pain points of enterprises, such as the inability to quickly select many SMS suppliers, and the lack of effective monitoring methods for the arrival rate, overall performance, arrival delay and other data of existing suppliers' SMS services. It helps enterprises to pre-perceive + monitor the quality of SMS services in real time, and helps to transform the solution to SMS service problems from passive notification to active perception, timely optimize SMS strategies, and to ensure the accurate quantification of enterprise SMS service quality and user experience to the greatest extent.

Evaluation Description

[Evaluation Tool] Bonree Net SMS gateway monitoring product, based on the WAP membership capabilities of Bonree Data, provides 10,000+ stable online real-machine SMS monitoring nodes across provinces and cities across the country. It creates SMS monitoring tasks in the same test environment and perceives the business application experience from the perspective of real users.

[Evaluation Objects] This report selected the SMS services of 7 domestic mainstream cloud providers, and finally determined 6 mainstream cloud vendors that provide SMS services: Alibaba Cloud, Huawei Cloud, Tencent Cloud, Baidu Smart Cloud, Kingsoft Cloud, and UCloud. Among them, JD Cloud SMS service was not included in the evaluation this time because its API calling method is more complicated than that of other cloud vendors and the adaptation is more difficult.

【Evaluation period】 August 2021

[Evaluation Scope] It integrates the dimensional data of the three major operators, China Mobile, China Unicom, and China Telecom, as well as 29 provincial-level administrative regions including Qinghai, Shandong, Inner Mongolia, Ningxia, Fujian, Jiangxi, Xinjiang, Shanghai, Tianjin, Guangdong, Gansu, Liaoning, Yunnan, Zhejiang, Hainan, Guangxi, Hebei, Jilin, Jiangsu, Shanxi, Beijing, Sichuan, Shaanxi, Hubei, Anhui, Henan, Heilongjiang, Guizhou, and Hunan.

[Evaluation Content] The evaluation is based on two major aspects: reach rate and overall performance.

Note: In this evaluation, Bonree Net and other cloud vendors have different definitions of SMS arrival. Cloud vendors define SMS arrival as SMS gateway receiving SMS arrival receipt, while Bonree Net, from the perspective of end users, defines SMS arrival as SMS actually received at the real mobile phone monitoring point. If the SMS gateway shows that the SMS is sent successfully, but the mobile phone has not received it or the mobile phone has blocked the received SMS for harassment, it is defined as SMS not received in the Bonree data report.

The following is the "August 2021 Cloud SMS Ranking Evaluation Report" released by the Bonree Data Research Center:

This report integrates data from 18,166 real mobile phone SMS monitoring nodes, reflecting the ranking of various SMS operators in terms of SMS delivery rate and overall performance strength.

SMS delivery rate ranking

In the SMS delivery rate ranking in August 2021, the overall average delivery rate was 92.59%, among which Tencent Cloud, Huawei Cloud, and Kingsoft Cloud ranked in the top three.

SMS Overall Performance Ranking

1. Overall performance

In the SMS overall performance rankings in August 2021, the overall performance average was 12.937s, with UCloud, Tencent Cloud, and Huawei Cloud ranking in the top three. It is worth mentioning that although UCloud did not perform well in the arrival rate rankings, its overall performance was outstanding. Among more than 3,000 sample data, its overall performance average could reach 10.482s.

1. Gateway processing time In the SMS gateway processing time ranking list in August 2021, the average gateway processing time was 0.109s, among which Baidu Smart Cloud, Kingsoft Cloud, and UCloud ranked in the top three, and the gateway processing time of Baidu Smart Cloud and Kingsoft Cloud were both within 0.05s, and the SMS service response was very fast.

2. SMS delivery takes time

In the SMS delivery time ranking list in August 2021, the average SMS delivery time was 12.288s, with UCloud, Tencent Cloud, and Huawei Cloud ranking in the top three.

Summarize

Overall, in the August 2021 cloud SMS evaluation, Tencent Cloud and Huawei Cloud performed excellently in cloud SMS services as a whole, ranking among the best in both delivery rate and overall performance; although UCloud's performance in delivery rate was not satisfactory, its overall performance was outstanding.

【Ranking of each list】

The list is sorted based on the reach rate as the key indicator. Ranks with the same reach rate will be sorted based on the overall performance indicator.

Want to see more rankings released by the Bonree Data Research Center? Please check the official website at https://www.bonree.com/index.html.

Indicator Explanation

Overall performance: The total time from when Bonree Net (SMS task service) sends a request to the SMS gateway to when the real mobile phone monitoring point receives the SMS.

SMS delivery time: The time from when the SMS gateway sends the SMS to when the real mobile phone monitoring point receives the SMS.

Gateway processing time: The time from when Bonree Net (SMS task service) sends a request to the SMS gateway to when Bonree Net (SMS task service) receives a response from the SMS gateway.

Arrival rate: The success rate of receiving SMS messages by real mobile phones that perform monitoring tasks. Arrival rate = effective monitoring times/total monitoring times*100%.
Total monitoring times: Bonree Net (SMS task service) sends one SMS sending request to the SMS gateway, which is counted as one monitoring.

Valid monitoring times: Bonree Net (SMS task service) sends a SMS request to the SMS gateway. Within 600 seconds, the real mobile phone monitoring point receives the SMS, which is recorded as 1 valid monitoring.