APXOR iOS SDK - Performance
Mechanism
- Tools Used: XCode Instruments
- Benchmarking candidate: Firebase SDK
- Duration of each run: 10 minutes
- Total no. of runs: 10
Functionalities Tested
- Event Logging
- Logging User Attributes
Plugins List
Below is the list of plugins of Apxor SDK that were subjected to performance benchmarking test:
- Apxor Core
- Crash Plugin
- Push Plugin
- Surveys Plugin
- RTM (Real Time Messaging)
- Query Engine Plugin
Test Matrix
| S.No. | Device Name | OS Version |
|---|---|---|
| 1 | iphone 5s | ios 10.0.1 |
| 2 | iPhone 7 | ios 13.4 |
| 3 | iPhone 8 Plus | ios 11 |
Impact on App Size
| S.No. | Description | App Size |
|---|---|---|
| 1 | Basic App | 12.7 MB |
| 2 | Basic App + Apxor Core SDK | 12.8 MB (+76 KB) |
| 3 | Basic App + Core SDK + All Plugins | 13.7 MB (+960 KB) |
| 4 | Basic App + Firebase SDK | 14.3 MB |
Performance Results
CPU Bechmarking (Device vs %CPU)
| Device | Basic App | Basic App + Apxor Core | Basic App + Apxor All Plugins | Basic App + Firebase |
|---|---|---|---|---|
| iPhone 5s (ios 10.0.1) | 5-6% | 7-8% | 8-10% | 6-10% |
| iPhone 8 Plus (ios 11) | 5-6% | 8-10% | 8-10% | 8-10% |
| iPhone 7 (ios 13.4) | 5-6% | 7-10% | 7-10% | 8-11% |
- There is no significant difference between Apxor SDK and Firebase SDK in terms of CPU usage.
Memory Bechmarking (Device vs Memory Usage in MB)
| Device | Basic App + Apxor Core | Basic App + Apxor All Plugins | Basic App + Firebase |
|---|---|---|---|
| iPhone 5s (ios 10.0.1) | 45 | 51 | 70 |
| iPhone 7 (ios 13.4) | 63 | 80 | 88 |
| iPhone 8 Plus (ios 11) | 82 | 80-85 | 90 |
- On an Average there is an increase in 15-25% increase in memory with Apxor Sdk while there is 40-45% increase in Firebase Sdk in memory usage.
Battery Usage
Below are the Battery usage matrices when tested with iPhone 5s
| Basic App With Core | Min Absolute Power | Average Absolute Power | Max Absolute Power |
|---|---|---|---|
| 10.46 Minutes | 1/20 | 3/20 | 20/20 |
| 10.13 Minutes | 3/20 | 5/20 | 20/20 |
| 10.50 Minutes | 1/20 | 3/20 | 20/20 |
| 13.3 Minutes | 3/20 | 5/20 | 19/20 |
| 11.86 Minutes | 8/20 | 6/20 | 19/20 |
| Basic App With Core + All Plugins | Min Absolute Power | Average Absolute Power | Max Absolute Power |
|---|---|---|---|
| 9.12 Minutes | 8/20 | 11/20 | 20/20 |
| 11.58 Minutes | 10/20 | 13/20 | 19/20 |
| 10.47 Minutes | 10/20 | 12/20 | 19/20 |
| 10.51 Minutes | 5/20 | 9/20 | 19/20 |
| 11.4 Minutes | 5/20 | 9/20 | 19/20 |
| Firebase SDK | Min Absolute Power | Average Absolute Power | Max Absolute Power |
|---|---|---|---|
| 11 Minutes | 14/20 | 16/20 | 19/20 |
| 10.05 Minutes | 14/20 | 16/20 | 19/20 |
| 10.63 Minutes | 14/20 | 18/20 | 20/20 |
| 9.96 Minutes | 12/20 | 16/20 | 20/20 |
| 10.48 Minutes | 12/20 | 17/20 | 20/20 |
- The Energy Usage instrument shows a level from 0 to 20, indicating how much energy your app is using at a given time. close to 0 is less power usage, close to 20 high power usage. With Firebase the numbers are closer to 20 more often which indicates more power is being used.