APXOR Android SDK - Performance
Mechanism
- Tools Used: PACT (Apxor’s in-house performance monitoring tool)
- Benchmarking candidate: Firebase SDK
- Duration of each run: 10 minutes
- Total no. of runs: 10
Functionalities Tested
- Event Logging
- Logging User Attributes
Plugins List
Below is the list of plugins of Apxor SDK that were subjected to performance benchmarking test:
- Apxor Core
- Crash Plugin
- Push Plugin
- Surveys Plugin
- RTM (Real Time Messaging)
- Query Engine Plugin
Test Matrix
| S.No. | Device Name | OS Version |
|---|---|---|
| 1 | OnePlus 3 | Android 9 |
| 2 | OnePlus 7 | Android 10 |
| 3 | Xiaomi Mi A1 | Android 9 |
| 4 | Xiaomi Mi A3 | Android 10 |
Impact on App Size
| S.No. | Description | App Size |
|---|---|---|
| 1 | Basic App | 3.8 MB |
| 2 | Basic App + Apxor Core SDK | 3.9 MB (+172 KB) |
| 3 | Basic App + Core SDK + Behavioural Cues | 5.4 MB (+1.58 MB) |
| 4 | Basic App + Core SDK + All Plugins | 5.5 MB (+1.61 MB) |
| 5 | Basic App + Firebase SDK | 5.5 MB |
Performance Results
CPU Bechmarking (Device vs %CPU)
| Device | Basic App | Basic App + Apxor Core | Basic App + Core + Behaviour Cues | Basic App + Apxor All Plugins | Basic App + Firebase |
|---|---|---|---|---|---|
| OnePlus 3 (Android 9) | 23.12 | 31.1 | 31.6 | 31.8 | 49.08 |
| OnePlus 7 (Android 10) | 8.62 | 10.59 | 10.70 | 10.77 | 12.43 |
| Xiaomi Mi A1 (Android 9) | 24.23 | 29.98 | 30.40 | 30.44 | 35.94 |
| Xiaomi Mi A3 (Android 10) | 6.69 | 7.9 | 8.25 | 8.29 | 7.52 |
- On an average, for the high end devices (OnePlus 5 and above) with Apxor SDK integrated, CPU usage would increase by 2%. For low end devices with Apxor SDK integrated, CPU usage would increase by 8%.
- When compared the same with Firebase SDK, CPU usage would increase by 4-5% in high end devices and 20% in low end devices.
Memory Bechmarking (Device vs Memory Usage in KB)
| Device | Basic App + Apxor Core | Basic App + Core + Behaviour Cues | Basic App + Apxor All Plugins | Basic App + Firebase |
|---|---|---|---|---|
| OnePlus 3 (Android 9) | 14.97 | 24.84 | 30.26 | 28.92 |
| OnePlus 7 (Android 10) | 14.72 | 24.62 | 30.26 | 29.38 |
| Xiaomi Mi A1 (Android 9) | 15.20 | 18.10 | 19.62 | 24.18 |
| Xiaomi Mi A3 (Android 10) | 14.5 | 20.11 | 24.3 | 26.90 |
- On an average, with Apxor Core SDK, memory increases by 14 KB and for Apxor SDK with all the plugins installed, the memory increases by 30 KB.
- With the Firebase SDK installed, on an average the memory increases by 29 KB.
Battery Usage Bechmarking (Device vs %Battery Drain)
| Device | Basic App | Basic App + Apxor Core | Basic App + Core + Behaviour Cues | Basic App + Apxor All Plugins | Basic App + Firebase |
|---|---|---|---|---|---|
| OnePlus 3 (Android 9) | 0.15 | 0.19 | 0.19 | 0.19 | 0.29 |
| OnePlus 7 (Android 10) | 0.03 | 0.05 | 0.05 | 0.05 | 0.05 |
| Xiaomi Mi A1 (Android 9) | 0.18 | 0.23 | 0.23 | 0.24 | 0.32 |
| Xiaomi Mi A3 (Android 10) | 0.12 | 0.13 | 0.13 | 0.13 | 0.13 |
- On an average, with the Apxor Core SDK and all plugins installed, the battery drain % would be 0.03% and the battery drain % with the Firebase SDK installed would be around 0.06%.