Analysis of CQI Traces From LTE MIMO Deployments and Impact On Classical Schedulers
Analysis of CQI Traces From LTE MIMO Deployments and Impact On Classical Schedulers
University of the Basque Country (UPV/EHU), ETSI Bilbao, Alameda Urquijo s/n,
48013 Bilbao, Spain,
{joseoscar.fajardo, ianire.taboada, fidel.liberal}@ehu.es
1 Introduction
Nowadays, Long Term Evolution (LTE) technology has widespread support
through all the continents. According to the Global mobile Suppliers
Association (GSA), as for January 2015 there are 360 commercial LTE
networks deployed in 124 countries [1]. From the five different LTE device
categories defined in 3GPP TS 36.306 (until Release 9) [2], actual
deployments only support up to Category
4. This feature implies a peak downlink bitrate in LTE networks of 75Mbps
when single-input single-output (SISO) is used, and 150Mbps in multiple-
input and multiple-output (MIMO) transmission mode. Additionally, 49 of
these networks support LTE-Advanced (LTE-A) (3GPP Release 10 and on)
with Carrier Ag- gregation (CA) and peak data rates of 300 Mbps for MIMO-
enabled Category 6 devices.
Jointly with these worldwide deployments, there is an increasing interest
from the research community to study the performance of different proposals
(e.g., channel-aware schedulers, channel-aware application servers, etc.) in
real- world conditions (e.g., [3]). Although well-known LTE simulators [4–6]
have been
widely used in the past years, it is important to analyze and characterize the
real-world radio performance in different conditions and mobility patterns.
The quality of the radio channel may be estimated through a series of radio
parameters, i.e.: Received Signal Strength Indicator (RSSI), Reference Signal
Received Power (RSRP), Reference Signal Receive Quality (RSRQ) and Signal-
to-Noise Ratio (SNR). Most of these radio parameters can be monitored in
reg- ular LTE smartphones though dedicated software (e,g, [7]). Beyond all
these power-related measurements, the key parameter to determine the
performance of User Equipments (UE) in LTE is the Channel Quality
Information (CQI). This parameter determines the coding efficiency [8]
supported to meet the tar- get Block Error Rate (BLER) of 10%. Under good
radio channel conditions, the CQI value reported by the UE to the E-UTRAN
Node B (eNodeB) would be high, resulting in a high Modulation and Coding
Scheme (MCS) index and better radio efficiency.
UEs may be requested to report CQI values in a periodic basis and to send
aperiodic CQI reports upon request by the eNodeB. Reported CQI values can
be configured to a unique value for the whole bandwidth (wideband CQI) or
different CQI values for determined frequencies (sub-band CQI). In addition
to CQIs, UEs are requested to report the Rank Indicator (RI) parameter in
MIMO transmissions. This parameter is critical to understand if UEs estimate
that two spatially multiplexed layers shall be used (RI=2) or if it is better to
receive the same information from different antennas (RI=1). When reported
periodically, the CQI Reporting Rate (CRR) determines the frequency for
sending quality feedbacks in the uplink [9]. The frequency for reporting RI
values is usually configured as a multiple of CRR value.
Unfortunately, CQI values cannot be generally accessed though
commercial LTE devices and UEs specifically enabled for drive testing are
required. Few studies provide detailed information concerning CQI values. In
[10], authors illustrate the temporal evolution of CQI values in stationary and
mobility con- ditions in one LTE network with 10MHz of bandwidth. However,
no information is provided about the RI value and consequently the specific
MIMO mode at each moment is unknown. In [11], an almost linear
relationship between CQI and RSRP values is depicted. However, these
experiments are performed in an experimental testbed and not in real-world
commercial LTE networks. Addition- ally, the experiments are based on SISO
transmissions and the applied fading channels are not detailed.
Most of LTE performance studies are based on other radio parameters.
Gen- erally speaking, measured SNR is used to estimate the expected BLER in
dif- ferent coding schemes, and thus to generate the most accurate CQI value
for the current conditions. However, this relationship may be complex in
MIMO scenarios [12] and its actual implementation is up to device vendors.
Thus, SNR values are not always an accurate estimator of the reported
channel quality and CQI traces are generally preferred to analyze the
experienced performance. As shown in [10], the relationship between SNR
and CQI at different antennas de- pends on the experienced channel
variability at each antenna. Additionally, SNR
values are not always accessible from LTE devices. In [13], authors propose a
method to estimate SNR values from RSRP and RSSI measurements. Finally,
some other authors try to analyze the experienced performance and its root
causes by profiling application-level data [14–16].
In summary, it is evidenced that analyzing and characterizing the behavior
of CQI values in modern LTE networks is a very challenging but appealing
prob- lem. This paper is intended to provide some evidence about the
expected radio channel characteristics, focusing on the downlink of LTE
MIMO transmissions. In Section 2, beyond providing raw CQI traces, we
identify several specific effects and limitations that we found when performing
drive tests, and we discuss the main causes of these issues. Additionally, in
Section 3 we show a basic perfor- mance study concerning classical radio
resource schedulers under the identified propagation conditions. Finally,
Section 4 provides the conclusions to the paper.
This section deals with the first objective of the paper, namely the
characteriza- tion of downlink radio channels in deployed LTE MIMO
networks. As explained before, instead of using radio parameters such as
RSSI, RSRP, RSRQ or SNR, we analyze the behavior of CQI traces obtained
from real-world measurements in commercial networks. Regular LTE devices
do not provide these CQI values to drive test tools, and thus specialized
equipment must be used to gather CQI traces from outside the operator. As we
will discuss in this section, mapping lower level radio parameters (even SNR
values) to CQI is not always a direct relationship. First, specific mapping
schemes are open to vendors implementa- tions. Second, the values for radio
parameters that can be gathered by different drive test tools only provide
limited information in LTE MIMO scenarios.
As a result, we make use of a specialized drive test toolset that allows us to
gather CQI values and analyze their relationship to other parameters.
However, even this kind of specialized equipment imposes a series of
limitations to the collected CQI traces that need to be studied and addressed.
As a step forward, we use an LTE emulator to run a series of experiments
taking into account different LTE Test Points used by the 3GPP in TS 37.901
[17]. This way, we are able to compare the coarse-grain characteristics of the
drive test traces with the experimental traces, and to detect some behavioral
patterns. Finally, we infer a series of fine-grain characteristics that could be
used to derive CQI models useful for realistic LTE MIMO simulations.
−90 20
RSRP
−100 SNR 15
SNR
RSRP
−110 10
−120 5
−130 0
0 50 100 150 200 250 300
Time (s)
15
RI=2 CQI−1
CQI−2
10
C
RI=1
5
0
0 50 100 150 200 250 300
Time (s)
In the first subplot, we show RSRP and SNR values reported by the device.
Ideally, SNR is used to calculate CQI values in the two available antennas, al-
though the actual mapping is open to device manufacturers. As can be
observed, UEs mobility implies high variability and wide range of SNR
values.
In the second subplot, we show the collected CQI values reported by the
two antennas. First, it must be noted that reported SNR values are aggregated
for the two antennas, being difficult to infer the contribution of each antenna
and
the expected individual CQI values. Second, it can be observed that the second
CQI value is either zero or the same as the first CQI value.
This effect must be understood by taking into account the Transmission
Mode of the LTE cell [8]. The monitored networks are mainly based on
Transmission Mode 3, which allows one of the following transmission
schemes at each moment:
– Transmit Diversity or Space Frequency Block Codes (SFBC). In this MIMO
scheme, the eNodeB transmits the same information through two
antennas. CQI values reported by UEs are associated to the best channel
condition from the two antennas and RI values are set to one.
– Large delay CDD or Open Loop Spatial Multiplexing (OLSM). In this MIMO
scheme, the eNodeB transmits different information through two
antennas and higher bitrates can be achieved. CQI values reported by UEs
are asso- ciated to the best condition achievable at the two antennas
simultaneously, which is the worst of the two channel conditions.
Reported RI values are set to two in this case.
As a result, based on the radio performance experienced by two different
re- ception antennas, the MIMO scheme varies along time as illustrated in
Figure 1. UEs are in charge of generating both CQI values and estimating the
most be- neficial transmission scheme that maximizes the downlink bitrate.
From that estimation, UEs report a single CQI value together with the
preferred RI.
The main implication of this effect is the complexity to characterize the
behavior of CQI values directly from CQI traces. Since different fading
conditions may affect to different antennas, similar SNR values may result on
higher or lower CQI-1 values if SFBC or OLSM is preferred. Thus, it must be
noted that CQI-1 and CQI-2 values reported by the drive test tool are not
directly those estimated for the two antennas. Instead, those CQI traces would
include some periods of individual CQI values and some periods of the
maximum CQI achievable at both antennas at the same time.
As a step forward, we processed the captured traces isolating the different
transmission schemes. Figure 2 illustrates these results for a series of traces in
similar mobility conditions at 20 km/h.
The left plot in Figure 2 illustrates the Empirical Cumulative Distribution
Function (ECDF) of CQI values. As can be observed, OLSM periods provide
lower CQI values than SFBC periods. Although this fact is observed in most
of the performed drive tests, several scenarios provide high CQI values also for
OLSM, when both antennas experience good channel conditions at the same
time.
In order to provide some further evidence of the different characteristics
experienced by CQI in both transmission schemes, the right plot in Figure 2
shows the ECDF of monitored CQI burstlengths. In this paper, CQI
burstlengths are considered as periods of time with non-variable CQI value. At
this time scale, CQI values seem to be less variable for OLSM periods than
SFBC periods although for both of them maximum burstlengths are around
15 s.
Figure 2 also provides evidence of another limitation of the drive test
toolset concerning the granularity of the samples. As can be observed, CQI
burstlengths
1 1
RI=1
0.8 RI=2 0.8
0.6 0.6
EC
EC
0.4 0.4
RI=1
RI=2
0.2 0.2
0
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 0
CQI 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
CQI burstlength (s)
Fig. 2. Different characteristics of CQI traces in SFBC (RI=1) and OLSM (RI=2)
periods.
start with a lower value of 1 s and this fact is not caused by either the network
configuration or the drive test software.
Monitored LTE networks are configured to operate with Transmission
Mode 3, requesting UEs to send wideband CQI reports every 5 ms and RI
feedbacks every 80 ms. The former value determines the granularity of CQI
measurements at the eNodeB, while the latter value limits the frequency for
switching between transmission schemes. Likewise, the drive test software is
configured to gather test data every 200 ms from the UE. Therefore, the
limitation seems to be related to the granularity used by the LTE device to
report radio parameters to the drive test software. In this sense, it is not clear
how these values are generated from the whole set of values in the last
period.
In summary, we state that specialized drive test tools, as used in this paper,
provide significant information to understand the experienced performance of
radio channels in LTE MIMO through the analysis of CQI values. However, in
order to characterize its temporal evolution, we must identify the transmission
scheme at each moment. Additionally, although useful for coarse-grain
estima- tions, the granularity of CQI traces is too low and invalidates the
results to generate fine-grain CQI traces aimed to feed further LTE simulation
studies.
Coarse-grain
field test
radio conditions
TEMS
Investigation
Fading
Samsung
GT-B3730
Aeroflex 7100
LTE emulator
Post-processing
Fine-grain Coarse-grain
experimental experimental
log file log file
0.8 RI=1
RI=2
0.6 EVA5
EC
EVA70 EVA200
0.4
0.2
0
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
CQI
0.8
RI=1
0.6
RI=2
EC
0.4 EVA5
0.2
0
0 1 2
10 10 10
CQI burstlength (s)
– CQI traces in MIMO Transmit Diversity periods are closer to EVA5 fading
condition in both CQI and CQI burstlength first order statistics.
– CQI traces in MIMO OLSM periods are closer to EVA70 and EVA200
fading conditions in both statistics.
EVA70 7100
0.4
EVA200 TEMS
0.2 EVA200 7100
0
2 4 6 8 10 12 14 16
CQI
0.8
0.6
EC
Parameter Value
Transmission Time Interval (TTI) 1 ms
Number of Resource Blocks (RB) 100
LTE Transmission Mode MIMO OLSM
Scheduling algorithms BC, RR, PF
CQI Reporting Rate 2, 5, 10, 20, 40, 80, 160 ms
CQI delay 3 ms
Number of UEs 20 UEs, in two classes
Channel model EVA5, EVA200
Traffic model Greedy sources
Simulation length 1000 s
Table 1. Simulation parameters.
RR BC
70 70 PF
60 60
50 50
Retransmissions
Throughput
40 40
30 30
20 20
RR BC
10 PF 10
0
2 5 10 20 40 80 160 0
2 5 10 20 40 80 160
CRR (ms)
CRR (ms)
EVA5 EVA200
70 16
60 14
50 12
RR BC
PF
10
Throughput
Throughput
40
8
30
6
20
4
RR BC
10 PF 2
0 0
2 5 10 20 40 80 160 2 5 10 20 40 80 160
CRR (ms) CRR (ms)
4 Conclusions
The main contribution of this work is the characterization of downlink radio
channels in deployed LTE MIMO by means of CQI traces obtained from real-
world measurements in commercial networks. We state that, although
specialized
drive test tools provide useful information to understand the achieved perfor-
mance of LTE MIMO channels, the granularity of CQI traces is not enough for
characterize its temporal evolution. For that purpose, we achieve to obtain CQI
samples each 2 ms by means of Aeroflex 7100 LTE emulator for different
fading conditions. We conclude that CQI traces in MIMO Transmit Diversity
are closer to less severe fading conditions (such as EVA5), and that OLSM CQI
traces are associated to more severe fading conditions (such as EVA70 and
EVA200).
Although this is not an intrinsic feature to the different MIMO
transmission modes, it has to do with the fact that MIMO OLSM uses the
lower of the different CQI values. In the scenarios analyzed in this paper, it is
hardly probable that all the antennas are in good channel conditions. Anyway,
the results obtained in this paper do not preclude the possibility of
experiencing high CQI values in MIMO OLSM in other scenarios.
Furthermore, we briefly depict the performance of classical schedulers
under the obtained LTE MIMO CQI traces for different channel quality
reporting pe- riods. We consider a simulation scenario with two classes of
users that differ in channel characteristics, EVA5 (good conditions) and
EVA200 (bad conditions), driven in both cases by the coarse-grain SNR
values. As main conclusion, we state that for CRR values lower than 20 ms BC
exhibits the best performance in terms of throughput, even though it causes a
notable number of retransmissions. As future work, we identify two main
areas for study. First, obtained CQI traces could be used to derive a
parametrized LTE channel model that pro- vides accurate
statistical/temporal LTE channel information. Second, in order to avoid the
excessive wasted throughput due to retransmissions, channel-aware
scheduling policies that cope with partially observable channels should be
stud- ied/proposed. Therefore, a future CQI-based channel model will be
useful to
feed up channel-aware schedulers employed in LTE networks.
Acknowledgement
This work has been partially funded by the Spanish Ministerio de Economa y
Competitividad (MINECO) under grant TEC2013-46766-R: QoEverage - QoE-
aware optimization mechanisms for next generation networks and services.
References
1. Global mobile Suppliers Association (GSA): MAP: Global LTE net-
work deployments, 360 commercially launched in 124 countries.
http://www.gsacom.com/downloads/pdf/LTE World map 360 LTE networks
launched 070115.php4 (2015)
2. 3rd Generation Partnership Project.: TS 36.306: Evolved Universal Terrestrial
Radio Access (E-UTRA); User Equipment (UE) radio access capabilities.
(Release 12). http://www.3gpp.org/DynaReport/36306.htm. (2014)
3. Rivas, F.J., Daz, A., Merino, P.: Obtaining More Realistic Cross-Layer QoS Mea-
surements: A VoIP over LTE Use Case. Journal of Computer Networks and Com-
munications, Volume 2013 (2013), Article ID 405858. (2013)
4. Mehlfuhrer, C., Ikuno, J.C., Simko, M., Schwarz, S., Wrulich, M., Rupp, M.: The
Vi- enna LTE simulators-Enabling reproducibility in wireless communications
research. EURASIP J. Adv. Sig. Proc. 2011:29. (2011)
5. Piro, G., Grieco, L.A., Boggia, G., Capozzi, F., Camarda P.: Simulating LTE Cel-
lular Systems: an Open Source Framework. IEEE Trans. Veh. Technol., vol. 60, no.
2. (2011)
6. Piro, G., Baldo, N., Miozzo, M.: An LTE module for the ns-3 network simulator.
In: Proc. 4th International ICST Conference on Simulation Tools and Techniques
(SIMUTools ’11), pp 415-422. (2011)
7. Alvarez, A., Diaz, A., Merino, P., Rivas, F.J.: Field measurements of mobile
services with Android smartphones. In: Proc. 2012 IEEE Consumer
Communications and Networking Conference (CCNC). (2012)
8. 3rd Generation Partnership Project.: TS. 36.213: Evolved Universal Ter-
restrial Radio Access (E-UTRA); Physical layer procedures (Release 12).
http://www.3gpp.org/dynareport/36213.htm. (2014)
9. Basukala, R., Ramli, HAM., Sandrasegaran, K., Lu Chen: Impact of CQI feedback
rate/delay on scheduling video streaming services in LTE downlink. In: Proc. 2010
12th IEEE International Conference on Communication Technology (ICCT). (2010)
10. Sevindik, V., Jiao Wang, Bayat, O., Sevindik, V., Weitzen, J.: Performance eval-
uation of a real long term evolution (LTE) network. In: Proc. 2012 IEEE 37th
Conference on Local Computer Networks Workshops (LCN Workshops). (2012)
11. Slanina, M., Klozar, L., Hanus, S.: Practical measurement of data throughput in
LTE network depending on physical layer parameters. In: Proc. 2014 24th Interna-
tional Conference Radioelektronika (RADIOELEKTRONIKA). (2014)
12. Ikuno, J.C., Pendl, S., Simko, M., Rupp, M.: Accurate SINR estimation model for
system level simulation of LTE networks. In: Proc. 2012 IEEE International
Conference on Communications (ICC). (2012)
13. Landre, J.B., Rawas, Z.E., Visoz, R.: LTE performance assessment Prediction ver-
sus field measurements. In: Proc. 2013 IEEE 24th International Symposium on
Personal Indoor and Mobile Radio Communications (PIMRC). (2013)
14. Laner, M., Svoboda, P., Romirer-Maierhofer, P., Nikaein, N., Ricciato, F., Rupp,
M.: A comparison between one-way delays in operating HSPA and LTE networks.
In: Proc. 2012 10th International Symposium on Modeling and Optimization in
Mobile, Ad Hoc and Wireless Networks (WiOpt). (2012)
15. Bayer, J., Belschner, J., Jieyan Chen, Klein, O., Linz, R., Muller, J., Yanlei Xiang,
Xinyu Zhao: Performance Measurement Results Obtained in a Heterogeneous LTE
Field Trial Network. In: Proc. 2013 IEEE 77th Vehicular Technology Conference
(VTC Spring). (2013)
16. Becker, N., Rizk, A., Fidler, M.: A measurement study on the application-level
performance of LTE. In: Proc. 2014 IFIP Networking Conference. (2014)
17. 3rd Generation Partnership Project.: TR. 37.901: Technical Specification Group
Radio Access Network; User Equipment (UE) application layer data throughput
performance (Release 11). http://www.3gpp.org/DynaReport/37901.htm. (2014)
18. Dai, Huiling, et al.: The Evaluation of CQI Delay Compensation Schemes Based on
Jakes Model and ITU Scenarios. In: Proc. 2012 IEEE Vehicular Technology
Conference (VTC Fall). (2012)