Machine Learning Based Hybrid Precoding for MmWave MIMO-OFDM with Dynamic Subarray
Abstract
Hybrid precoding design can be challenging for broadband millimeter-wave (mmWave) massive MIMO due to the frequency-flat analog precoder in radio frequency (RF). Prior broadband hybrid precoding work usually focuses on fully-connected array (FCA), while seldom considers the energy-efficient partially-connected subarray (PCS) including the fixed subarray (FS) and dynamic subarray (DS). Against this background, this paper proposes a machine learning based broadband hybrid precoding for mmWave massive MIMO with DS. Specifically, we first propose an optimal hybrid precoder based on principal component analysis (PCA) for the FS, whereby the frequency-flat RF precoder for each subarray is extracted from the principle component of the optimal frequency-selective precoders for fully-digital MIMO. Moreover, we extend the PCA-based hybrid precoding to DS, where a shared agglomerative hierarchical clustering (AHC) algorithm developed from machine learning is proposed to group the DS for improved spectral efficiency (SE). Finally, we investigate the energy efficiency (EE) of the proposed scheme for both passive and active antennas. Simulations have confirmed that the proposed scheme outperforms conventional schemes in both SE and EE.
Index Terms:
Hybrid precoding, MIMO-OFDM, millimeter wave, machine learning, dynamic subarray, energy efficiency.I Introduction
In the fifth generation mobile communications, the application of millimeter-wave (mmWave) is vital by the virtue of providing high data rate and large bandwidth [1, 2, 3]. However, mmWave channel suffers from a severe path loss, and the traditional fully-digital precoding with massive antennas to mitigate this issue is extremely power consuming [4]. Therefore, hybrid precoding has been proposed to achieve the large array gains with the reduced hardware cost and power consumption [5, 6, 7, 8]. By far, existing broadband hybrid precoding schemes usually focus on fully-connected array (FCA), while seldom consider partially-connected subarray (PCS) like fixed subarray (FS) and dynamic subarray (DS). Therefore, hybrid precoding with PCS in broadband channel is an interesting topic to explore.
Most prior work is based on narrowband mmWave channels [11, 10, 9]. Specifically, a compressive sensing-based hybrid precoding has been proposed in [11], where the channel sparsity is ingeniously exploited to design hybrid precoding with the aid of orthogonal matching pursuit (OMP) algorithm. Moreover, a constant envelope hybrid precoding scheme is proposed, where two cost-efficient sub-connected hybrid architectures are considered to optimize the hybrid precoding under per-antenna constant envelope constraints [10]. To improve bit-error-rate, an over-sampling codebook-based hybrid minimum sum-mean-square-error precoding is designed [9]. On the other hand, mmWave channels appear to have the frequency-selective fading, where OFDM is usually adopted to combat the time dispersion channels [12, 13, 14]. Specifically, an insightful broadband hybrid precoder based on limited-feedback codebook has been proposed for FCA [12]. By exploiting the channel correlation information among different subcarriers, a broadband hybrid precoding is proposed for FS and DS [13]. Finally, [14] has theoretically shown the optimality of frequency flat precoding by proving that dominant subspaces of the frequency domain channel matrices of different subcarriers are equivalent. However, this conclusion is based on the purely sparse channels with discrete angles of arrival (AoA) and angles of departure (AoD), while the explicit precoder solution is not provided.
In this paper, we propose a machine learning based hybrid precoding scheme for mmWave MIMO-OFDM systems with DS, where a shared agglomerative hierarchical clustering (shared-AHC) algorithm is proposed for DS grouping to improve SE performance. First, we propose a PCA-based analog precoder scheme for FS by abstracting the low-dimensional signal space of frequency-flat precoder for given subarray from the high-dimensional signal space of optimal frequency-selective fully-digital precoders using PCA. Besides, the optimality of the proposed PCA-based hybrid precoder design is theoretically proven and verified by simulations. Second, we propose the shared-AHC algorithm inspired by cluster analysis in the field of machine learning for antenna grouping. By implementing shared-AHC algorithm, the SE performance of PCS can be further enhanced for effective antenna grouping adapting to the spatial features of the frequency-selective channels. Finally, we consider the practical passive/active antennas for EE performance analysis. Simulation results confirm the better spectral efficiency (SE) and energy efficiency (EE) performance achieved by the proposed scheme than existing schemes. Meanwhile, DS has the overwhelming advantage for both active and passive antennas.
Notations: Following notations are used throughout this paper. is a matrix, is a vector, is a scalar, and is a set. Conjugate transpose and transpose of are and , respectively. The th entry of is , and () denotes the th row (th column) of . Frobenius norm is denoted by . , , , and are the determinant of a square matrix , cardinality of a set , -norm of a vector , and modulus of a number , respectively. The th largest singular value of a matrix is defined as . Additionally, is a block diagonal matrix with () on its diagonal blocks.
II System Model
We consider an mmWave massive 3-dimensional (3D) MIMO system, where both the BS and user employ the uniform planar array (UPA), and OFDM is adopted to combat the frequency-selective fading channels. The BS is equipped with antennas and chains, where and are the numbers of vertical and horizontal transmit antennas, respectively. The user is equipped with antennas, where and are the numbers of vertical and horizontal receive antennas, respectively. We consider the downlink transmission, and the received symbols at the user can be written as [11]
| (1) |
where with being the number of subcarriers, , , , , , and are the digital precoder, analog precoder, fully-digital combiner, channel matrix, transmitted signal, and noise associated with the th subcarrier, respectively, and is the number of data streams for each subcarrier. Noise satisfies , and transmitted signal satisfies , where is average total transmit power.
The frequency-domain channel can be expressed as [12], where is the maximum delay spread of the discretized channels, and is the delay- channel matrix. We consider the clustered channel model [11], where the channel is composed by clusters of multipaths with rays in each cluster. Thus the delay- channel matrix can be written as
| (2) |
where is the delay-domain channel coefficient, , , and are the delay, the complex path gain, and the pulse shaping filter for -spaced signaling, respectively. Thus the relationship between the frequency-domain channel coefficiency and the delay-domain channel coefficiency is . In (2), and are the steering vectors of the th path in the th cluster at the transmitter and receiver, respectively. In the steering vectors, and are the azimuth and elevation angles of the th ray in the th cluster for AoDs, and and are the azimuth and elevation angles of the th ray in the th cluster for AoAs. Therefore, the transmit steering vectors for the UPA at the BS can be expressed as [11], where is the carrier wavelength, and and are the distances between adjacent antenna elements in vertical and horizontal direction, respectively. Similarly, we can also obtain with the same form.
The achievable rate of the mmWave MIMO heavily depends on the transmit hybrid precoder, which can be obtained by solving the following optimization problem [12]
| (3) | ||||
where is a set of feasible RF precoder satisfying constant-modulus constraint. The coupling between and and the constant-modulus constraint of lead to the challenging hybrid precoder design.
III PCA-Based Hybrid Precoder Design for FS
In this section, we derive hybrid precoders for the PCS, in which only a subset of antennas are connected to each RF chain. Our goal is to design the optimal frequency-flat RF precoder from the fully-digital frequency-selective precoder.
III-A Digital Precoder Design
We first design the digital precoder by fixing the RF precoder. Solving (3) can be difficult due to the coupling of the baseband and RF precoders[12]. Therefore, considering to be the equivalent baseband precoder, the equivalent problem of (3) can be expressed as follows
| (4) | ||||
For the optimization problem (4), we first consider the optimal solution of . Specifically, consider the singular value decomposition (SVD) of associated with the th subcarrier as , and the SVD of the matrix . Therefore, the optimal , and thus the optimal baseband precoder can be expressed as
| (5) | ||||
where (, ) is a water-filling solution matrix, in which satisfies . Then the problem reduces to obtain the optimal solution of to (4).
III-B PCA-Based Precoder Design
Regarding the transmit hybrid precoder for FS, there are antennas and RF chains. For simplicity, we consider the numbers of antennas for different RF chains are identical, and the cardinality of each subset for every antenna group is . We define the set of antenna indexes as , and as the subset of the antennas associated with the th RF chain, where , for . For the FS, the analog precoder can be written as a block diagonal matrix , where is the analog beamforming vector associated with the th subarray for the th RF chain. Defining optimal digital precoder for , the optimal digital precoder can be expressed as
| (6) |
where . Moreover, we regard the matrix consisting of the optimal precoder of all subcarriers in the th subarray as the data set in the PCA problem [16]. Additionally, to achieve the stable solution with low complexity for PCA, SVD is applied to the data set matrix . This process is detailed in Proposition 1, where its optimality is also verified as follows.
Proposition 1.
For FS, considering , the RF precoder solving problem (10) with the subarray analog/digital architecture is given by , with , for , where and is the right singular vector corresponding with the largest singular value of the matrix .
Proof.
Following the similar steps of the equations (12)-(14) in [11] and defining , the objective function in problem (3) can be approximate as
| (7) | ||||
Therefore, the optimization problem (3) is equivalent to the following optimization problem
| (8) | ||||
where is a set of feasible RF precoder satisfying constant-modulus constraint. The objective function in (8) is
| (9) | ||||
According to previous work [17], unitary constraints offer a close performance to the total power constraint while providing a relatively simple form of solution. To simplify the problem, we consider condition under unitary power constraints instead. Therefore, water-filling power allocation coefficients can be ignored. In detail, the equivalent baseband precoder , which means that is a unitary or simi-unitary matrix depending on the relationship between and . When , is . When , denoting the SVD of , thus . Therefore, the solution to the condition when will also suffice the condition when . Therefore, the objective function of (8) goes down to
| (10) | ||||
For simplicity, we denote as . Therefore, can be written into following block diagram matrix
| (11) |
By substituting (11) and (6) into (10), the objective function of the optimization problem can be further expressed as
| (12) | ||||
Therefore, the solution to the optimization problem (10) is . The maximum value can only be obtained when , where is an arbitrary complex value, and is the largest singular value of the matrix . ∎
Taking the constraint of RF precoder into account, we can design the RF precoder by solving
| (13) | ||||
With the constant-modulus constraint, the set of possible is actually a hypersphere in the space of , and is a known point in the space of . Therefore, the optimization problem in (13) is actually a distance minimization problem. Therefore, the solution is the point on this hypersphere sharing same direction of the know point .
When the quantization of phase shifters is considered, we assume the quantization bits are . Therefore, the phase shifters can only be chosen from the following quantized phase set . Specifically, after obtaining the RF precoder , the quantization process can be realized by searching for the minimum Euclidean distance between and quantized phase from .
IV Shared-AHC Algorithm for DS Grouping
In Section III, we have found the SE performance of FS heavily depends on . This observation motivates us to optimize the antenna grouping to further improve the SE performance when DS is considered.
The DS problem can be formulated as follows
| (14) | ||||
This optimization problem is a combinational optimization problem, which requires an exhaustive search to reach the optimal solution. To obtain the optimal solution, the number of all possible combinations for exhaustive search can be according to [18], which is a very large number. To illustrate, when and , the number of all possible combinations can be up to .
Therefore, a low-complexity algorithm need to be develop to solve problem (14). Specifically, we use the Minkowski -norm [19] to estimate the square of the singular value of the matrix by , where and .
To reduce the complexity while achieve the good SE performance, we consider the antenna grouping from the viewpoint of clustering analysis in machine learning. To be specific, we propose a shared-AHC algorithm as listed in Algorithm 1, which is developed from the AHC algorithm in machine learning to group the antennas into different subarrays associated with different RF chains. Traditional AHC algorithm is a clustering algorithm that builds a cluster hierarchy from the bottom up. It starts by adding all data to multiple clusters, followed by iteratively pair-wise merging these clusters until only one cluster is left at the top of the hierarchy. The shared-AHC algorithm is different from the traditional AHC algorithm [15] in two distinguished aspects. First, the aim of clustering in our antenna grouping problem is to build clusters instead of only one cluster in conventional AHC algorithm. Second, the pair-wise merging criterion in the proposed algorithm is “shared”, while the conventional AHC algorithm only considers the target cluster. To further illustrate the “shared” mechanism, we introduce the metric of mutual correlation between the cluster and
| (15) |
In each clustering iteration, we first focus on a cluster , and find a cluster maximizes among all possible . If the cluster also maximizes among all possible , we merge and . Otherwise, the cluster and cluster are not merged and algorithm goes into the next iteration. Therefore, our proposed algorithm is featured as “shared”, since two clusters mutually share the maximum correlation in the sense of (15). This process is realized in Algorithm 1.
V Energy Efficiency Analysis
The implementation of PCS not only reduces the hardware complexity, but also improves the EE. In this section, we analyze the EE of the designs. Define the EE as , where is the bandwidth of the channel, and is the total power consumption of the system.
Different connection patterns between the phase shifters and antennas can influence the power consumption. Because the number of phase shifters is different in different connection patterns. In this system, FCA use up to phase shifter for each RF chain connecting to every antennas. While the PCS use phase shifters.
Furthermore, the different antenna architectures should also be taken into account regarding the total power. Specifically, we consider the hybrid MIMO system using passive antennas and active antennas as shown in Fig. 10 of [20]. Both of them consist electronic components such as digital-analog convertors (DAC), power amplifiers (PA), local oscillators (LO), and mixers etc. The main difference between active and passive antenna architecture lies in the number of the PAs. In passive antennas, the number of PAs is the same as that of the RF chains. While for active antennas, the number of PAs is the same as that of antennas. This difference can lead to different power consumption because the PAs are heavily power-consuming. Thus we will analyze the power consumption of the two different antenna architectures, respectively.
Given the above antenna architecture, the power consumption for FCA and PCS are respectively and . By contrast, the power consumption for FCA and PCS with active antenna architecture are and . Moreover, according to the antenna architecture for fully-digital (FD), the power consumption is . Additionally, the power consumption of electronic components in the three architectures are phase shifter mW [21], DAC mW [21], mixer mW [22], LO mW [21], and PA mW [23].
VI Simulations
In this section, we investigate the SE and EE performance for the hybrid precoder design. For the channel model, we adopt Dirac delta function as the pulse shaping filter and a cyclic prefix with the length of . The number of subcarriers is . The transmission bandwidth is MHz. We consider that the path delay is uniformly distributed in ( is the symbol period). The number of the clusters is , and azimuth/elevation AoAs and AoDs follow the uniform distribution with angle spread of . Within each cluster, there are rays. As for the antennas, we consider transmitter adopt UPA with hybrid precoder, the receiver adopt UPA with fully-digital combiner, and the distance between each adjacent antennas is half wavelength. Moreover, we consider the number of RF chains at transmitter is and the data stream is . Additionally, we consider 4 types of classical FS patterns shown in Fig. 1, where antenna elements with the same color share the same RF chain.
Throughout this part, following baselines will be considered for performance benchmarks: Optimal fully-digital scheme considers the fully-digital MIMO system, where the SVD-based precoder/combiner is adopted as the performance upper bound. Simultaneous OMP (SOMP) scheme is an extension version of the narrow-band OMP-based spatially sparse precoding in [11]. In broadband, SOMP-based hybrid precoding scheme can simultaneously design the RF precoder/combiner for all subcarriers. Discrete Fourier transform (DFT) codebook scheme designs the RF precoder/combiner from the DFT codebook instead of steering vectors codebook in SOMP scheme [9]. Covariance eigenvalue decomposition (EVD) scheme estimates the covariance matrix of the channels using the mean of auto-correlation matrices at each subcarrier [13]. The RF precoder is designed based on the EVD of the covariance matrix of the channels.
In Fig. 2, we compare the SE performance of the proposed hybrid precoding scheme with the baselines, where both FCA and PCS are investigated. In Fig. 2 (a), for FCA, our proposed PCA-based hybrid precoding scheme outperforms conventional DFT codebook-based hybrid precoding scheme and SOMP-based hybrid precoding scheme. Both the proposed PCA-based hybrid precoding scheme and covariance EVD-based hybrid precoding scheme have the very similar performance, and they suffer from negligible performance loss when compared to the optimal fully-digital scheme. This is because mmWave MIMO channels associated with different subcarriers share the same row space due to the common scatterers. Meanwhile, our proposed algorithm can exploit the principal components of the common row space to establish the hybrid precoder. The SOMP-based and DFT codebook-based hybrid precoding schemes work poorly, since their analog codebooks are limited to the steering vector forms. Finally, it can also be observed that the influence of quantization in phase shifters is negligible for our scheme. As for the PCS, Fig. 2 (b) shows that our scheme outperforms conventional covariance EVD-based hybrid precoding scheme with different FS patterns and DS. The antenna grouping scheme in [13] considers a greedy approach, which may lead to the imbalance antenna grouping by acquiring local optimal solution. By contrast, the shared-AHC algorithm for DS grouping introduces the mutually correlation metric (15), which can efficiently avoid this issue. Therefore, the proposed shared-AHC algorithm for DS grouping outperforms it counterpart in [13].
In Fig. 3, we compare the EE performance of the proposed PCA-based hybrid precoding scheme and the baselines with FCA and PCS, where both passive and active antenna architectures are investigated. Note that the power values of key electronic components can refer to Section V. In Fig. 3 (a), for passive antenna architecture, the EE performance of PCS by using the proposed PCA-based hybrid precoding scheme outperforms that of FCA by using the SOMP-based and DFT codebook-based hybrid precoding schemes. The reason is that PCS adopts a much smaller number of phase shifters than FCA. Moreover, DS outperforms the other FS patterns in SE, and it consumes the same power with the other FS patterns. Therefore, DS outperforms other four types of FS patterns. It is worth mentioning that the optimal fully-digital scheme has the worst EE performance, since the numbers of power-consuming PAs, DACs, and mixers are proportional to that of antennas. In Fig. 3 (b), for active antenna architecture, the advantage of EE performance for different FS patterns by using the proposed hybrid precoding scheme over the FCA with several typical hybrid precoding schemes and optimal fully-digital precoding scheme is not considerable. This is because active antenna architecture requires the power-hungry PAs for each antenna. Meanwhile, the advantage of the reduced power consumption of FS structure is greatly weakened by its disadvantage in SE performance when compared to FCA. Finally, the EE performance of DS with the proposed hybrid precoding scheme still has the obvious advantage over the baselines and four typical types of FS with the proposed scheme. This reveals the appealing advantage of DS in practical situation when both the power consumption and SE should be well balanced.
VII Conclusions
This paper has proposed a hybrid precoding scheme based on machine learning for broadband mmWave MIMO systems with DS. We first acquire the low-dimensional frequency flat precoder from the optimal frequency-selective precoders based on PCA for FS. Then, we extend the proposed PCA-based hybrid precoder design to the DS. We propose the shared-AHC algorithm inspired by cluster analysis in machine learning for antenna grouping to further improve the SE performance. Additionally, we analyze the EE performance for FCA, FS, and DS with passive and active antennas. Simulations further verify the proposed PCA-based hybrid precoding scheme has the better SE and EE performance than conventional schemes.
Acknowledgment
This work was supported by the National Natural Science Foundation of China (Grant Nos. 61471037, 61701027, and 61201181), the Beijing Natural Science Foundation (Grant No. 4182055), Huawei Innovation Research Program (HIRP), and Youth Project of China Academy of Information and Communications Technology.
References
- [1] Z. Xiao, P. Xia, and X. G. Xia, “Codebook design for millimeter-wave channel estimation with hybrid precoding structure,” IEEE Trans. Wireless Commun., vol. 16, no. 1, pp. 141-153, Jan. 2017.
- [2] Y. Sun and C. Qi, “Weighted sum-rate maximization for analog beamforming and combining in millimeter wave massive MIMO communications,” IEEE Wireless Commun. Lett., vol. 21, no. 8, pp. 1883-1886, Oct. 2017
- [3] Z. Gao et al., “MmWave massive-MIMO-based wireless backhaul for the 5G ultra-dense network,” IEEE Wireless Commun., vol. 22, no. 5, pp. 13-21, Oct. 2015.
- [4] Z. Gao et al., “Compressive sensing techniques for next-generation wireless communications,” IEEE Wireless Commun., vol. 25, no. 3, pp. 144-153, Jun. 2018.
- [5] A. Liao et al., “2D unitary ESPRIT based super-resolution channel estimation for millimeter-wave massive MIMO with hybrid precoding,” IEEE Access, vol. 5, pp. 24747-24757, 2017.
- [6] S. He et al., “Codebook-based hybrid precoding for millimeter wave multiuser systems,” IEEE Trans. Signal Process., vol. 65, no. 20, pp. 5289-5304, Oct. 2017.
- [7] A. Liu and V. K. N. Lau, “Impact of CSI knowledge on the codebook-based hybrid beamforming in massive MIMO,” IEEE Trans. Signal Process., vol. 64, no. 24, pp. 6545-6556, Dec. 2016.
- [8] S. He, C. Qi, Y. Wu, and Y. Huang, “Energy-efficient transceiver design for hybrid sub-array architecture MIMO systems,” IEEE Access, vol. 4, pp. 9895-9905, 2016.
- [9] J. Mao et al., “Over-sampling codebook-based hybrid minimum sum-mean-square-error precoding for millimeter-wave 3D-MIMO,” IEEE Wireless Commun. Lett., vol. PP, no. PP, pp. 1-1, May 2018.
- [10] Y. Huang, J. Zhang, and M. Xiao, “Constant envelope hybrid precoding for directional millimeter-wave communications,” IEEE J. Sel. Areas Commun., vol. PP, no. PP, pp. 1-1, Apr. 2018.
- [11] O. E. Ayach et al., “Spatially sparse precoding in millimeter wave MIMO systems,” IEEE Trans. Wireless Commun., vol. 13, no. 3, pp. 1499-1513, Mar. 2014.
- [12] A. Alkhateeb and R. W. Heath Jr., “Frequency selective hybrid precoding for limited feedback millimeter wave systems,” IEEE Trans. Commun., vol. 64, no. 5, pp. 1801-1818, May 2016.
- [13] S. Park, A. Alkhateeb, and R. W. Heath Jr., “Dynamic subarrays for hybrid precoding in wideband mmWave MIMO system,” IEEE Trans. Wireless Commun., vol. 16, no. 5, pp 2907-2920, May 2017.
- [14] K. Venugopal, N. G. Prelcic, and R. W. Heath Jr., “Optimality of frequency flat precoding in frequency selective millimeter wave channels,” IEEE Wireless Commun. Lett., vol. 6, no. 3, pp. 330-333, Jun. 2017.
- [15] S. Zhou, Z. Xu, and F. Liu, “Method for determining the optimal number of clusters based on agglomerative hierarchical clustering,” IEEE Trans. Neural Netw. Learn. Syst., vol. 28, no. 12, pp. 3007-3017, Dec. 2017.
- [16] C. M. Bishop, Pattern Recognition and Machine Learning. New York, NY, USA: Springer, 2006.
- [17] D. J. Love et al., “An overview of limited feedback in wireless communication systems,” IEEE J. Sel. Areas Commun., vol. 26, no. 8, pp. 1341-1365, Oct. 2008.
- [18] R. Graham, D. Knuth, and O. Patashnik, Concrete Mathematics. Reading, MA, USA: Addison-Wesley, 1988.
- [19] H. Lütkepohl, Handbook Matrics. Hoboken, NJ, USA: Wiley, 1996.
- [20] W. Hong et al., “Multibeam antenna technologies for 5G wireless communications,” IEEE Trans. Antennas Propag., vol. 65, no. 12, pp. 6231-6249, Dec. 2017.
- [21] R. Méndez-Rail et al., “Hybrid MIMO architectures for millimeter wave communications: phase shifters or switches?”, IEEE Access, vol. 4, pp. 247-267, Jan. 2016.
- [22] M. Kraemer, D. Dragomirescu, and R. Plana, “Design of a very low-power, low-cost 60 GHz receiver front-end implemented in 65 nm CMOS technology,” Int. J. Microw. Wireless Technol., vol. 3, pp. 131-138, Apr. 2011.
- [23] Y. Yu et al., “A 60 GHz phase shifter integrated with LNA and PA in 65 nm CMOS for phased array systems,” IEEE J. Solid-State Circuits, vol. 45, no. 9, pp. 1697-1709, Sep. 2010.