Emerging Nonvolatile Memory (NVM) Technologies: An Chen
Emerging Nonvolatile Memory (NVM) Technologies: An Chen
An Chen
TD Research, GLOBALFOUNDRIES
Santa Clara, USA 95054
[email protected]
Abstract — Significant progress has been made recently in NVMs include memories based on novel materials and
emerging nonvolatile memories (NVMs). This paper will discuss mechanisms drastically different from mature memories based
advantages and challenges of several promising NVM devices, as on Si CMOS. They are made of ferroelectric oxides,
well as their potential applications. Changing market trends ferromagnetic metals, chalcogenides, metal oxides, carbon
toward mobile, IoT, and data-centric applications create new materials, etc. Their switching mechanisms extend beyond
opportunities for NVMs. High-performance NVMs may enable classical electronic processes, to quantum mechanical
novel architectures and designs, e.g., more uniform memory phenomena, ionic reactions, phase transition, molecular
hierarchy, co-located logic and memory, and fine-grained power reconfiguration, etc. Many of them also share some common
gating. Storage-class memories based on high-density NVMs
features, e.g., nonvolatile states, two-terminal structures, etc.
could fill the performance and density gap between memory and
storage. Some unique characteristics of emerging NVMs can be
Among these emerging NVMs, four major candidates will be
utilized to extend their applications beyond memory space, e.g., discussed in more details in this section.
synaptic functions, security elements, etc.
Memory
Keywords — nonvolatile memory, storage, memory hierarchy,
architecture, selectors, neuromorphics, security Volatile Nonvolatile
SRAM Baseline Prototypical Emerging
110
Flash but with different data storage (ferroelectric polarization compatible with those of the memory elements. Bipolar
instead of floating gate). FeFET is not a new concept, but its switching memories require bi-directional selectors (e.g.,
development has been hindered by depolarization field and nonlinear devices), while rectifying diodes only work for
gate leakage [18]. Recent discover of ferroelectricity in doped unipolar switching memories. Selector assessment should be
HfOx has reignited interest in FeFET [19]. Ferroelectric HfOx conducted in a comprehensive framework incorporating array
may significantly improve the scalability of FeFET. With full design/operation parameters, memory element characteristics
CMOS-compatibility, simple 1-transistor (1T) structure, and and selector device properties.
the performance close to that of DRAM, HfOx-based FeFET
may provide another promising eNVM candidate. Both RRAM and STTRAM provide promising NVM
solutions, but each excels in different application space
(density vs. performance) [21]. The selector devices have
F. Comparison of other emerging NVMs mostly been explored for RRAM in high-density arrays.
Other emerging memory candidates in Fig. 1 will not be STTRAM has large cell size due to access transistors. With
discussed in details in this paper. Fig. 2 provides a comparison suitable two-terminal selectors, it may also be possible to build
of the six NVM candidates in the “emerging” category, based STTRAM in a CBA or a shared-access-transistor structure to
on a critical review conducted by ERD using eight criteria [2]. reduce effective bit size [22]. If successful, a high-density
1
Scalability
STTRAM array enabled by proper selectors may be integrated
CMOS
3 with a high-performance STTRAM array to meet the needs for
Architectural 8
2
2Speed both working memories and data storage.
Compatibility FeFET
111
the performance beyond the capabilities of Flash memories, be kept in on-state to avoid data loss. SRAM can be turned off
e.g., low-voltage switching, fast speed, long endurance, etc. in long standby mode, but only after all the data have been
RRAM has also been experimented for flexible electronics. transferred to permanent storage which takes long time (up to a
few hundred μs). Low-voltage operation also has limitation for
Embedded NVMs (eNVMs) play increasingly important
SRAM due to robustness degradation and therefore larger cell
functions in micro-controller units (MCUs) for industry and
design (e.g., 10-transistor SRAM) may be required. Flash
automotive applications, as well as consumer electronics [23-
memories are not suitable for these applications because of
24]. The real-time code-execution/customization and data
their high writing voltage and power. Emerging NVMs with
management capabilities enabled by eNVM improve system
lower switching power/voltage offer opportunities to design
performance, enhance security, and lower cost. These have so
“normally-off” memory systems to eliminate standby power.
far been fulfilled by OTP, MTP, and eFlash (e.g., 1T NOR,
Nonvolatile cache would significantly accelerate data storage
split-gate flash). Embedded NVM needs to be compatible with
and enable more fine-grained power gating design. The benefit
logic platform, which becomes more challenging in advanced
of standby power saving needs to be balanced with the increase
nodes and may create opportunities for emerging NVMs
of active power, which depends on both activity factors in
typically built in BEOL. Emerging NVMs may even provide
memory hierarchy and NVM characteristics [27]. Reducing
higher performance beyond the capability of eFlash. At the
the active power of STTRAM through material and device
same time, reliability of emerging NVMs has to be further
engineering will determine the feasibility of utilizing STTRAM
improved for embedded applications, especially in automotive
for these low-power designs.
space with stringent thermal stability and zero defect rate
requirements. Optimization for eNVM is very different from Data movement in von Neumann architectures consumes
that for standalone memories, in terms of targeted robustness, high power and slows down system speed. New architectures
stability, power efficiency, and cell size; therefore, different with localized data (at or near computing units) may achieve
development strategies need to be adopted. Emerging NVM better speed and efficiency. Emerging NVMs offers promising
candidates in section II provide a wide range of potential technology options for non-von-Neumann architectures where
performance and scalability, and may fulfill the needs of logic and memory functions are more closely integrated or
different embedded applications. inter-mixed. By inserting simple two-terminal NVM elements
(e.g., MTJ, RRAM) in logic gates (e.g., SRAM, adder, look-
B. Memory hiearchy and storage-class memory (SCM) up-table), it is possible to create “nonvolatile logic” with built-
From high-speed L1 cache to high-density hard disk drive in memory. NV logic reduces data movement to increase
(HDD), access speed varies more than seven orders of throughput and reduce power. The built-in memory may also
magnitude in the memory/storage hierarchy designed to enable novel architecture and designs, e.g., latch-less pipeline
optimize the cost-performance tradeoff. SRAM-based cache design, systolic architectures.
has accounted for a major portion of power consumption in
mobile CPU or SoC. Scalable high-performance NVMs (e.g., V. BEYOND MEMORY SPACE
STTRAM) with speed and endurance close to those of Some unique characteristics of emerging NVMs may
SRAM/DRAM may provide nonvolatile working memory that extend their applications beyond the memory space.
could enable more “uniform” memory systems with
significantly improved performance. A. Brain-inspired computing and synaptic functions
5 6
While DRAM is ~ 100× slower than cache, it is (10 –10 )× Brain achieves very high performance with extremely low
faster than disk drive [25]. Closing this speed gap between power through massive parallelism, in comparison to today’s
memory and storage would have great impact on system computers. In neuro-networks, synapses connect neurons and
performance and cost. SCM defines such a perspective for play key functions in the learning process. One of the well-
emerging NVMs to reach access speed close to DRAM and at known learning rules is the “spike time dependent plasticity”
the same time have the bit-cost close to that of HDD [26]. It (STDP), i.e., synaptic weight modified by the timing difference
combines the benefits of random access of memories and the between pre- and post-synapsis neuron signals [28]. It has
archival capabilities of HDD. SCM requires a solid-state been shown that the analog behavior of some emerging NVMs
NVM with excellent scalability and preferably multi-level cell (e.g., PCM, RRAM) can be utilized to implement synaptic
(MLC) design, as well as extremely effective manufacturing at functions [29]. By fine-tuning the incremental change of NVM
ultra-high areal density. It would greatly simplify the memory resistance with switching pulses, potentiation and depression of
and storage hierarchy, and revolutionize large-scale computing “synaptic weight” (typically coded in the NVM resistance) can
systems. So far, PCM and RRAM have been considered the be imitated. The promising scalability of emerging NVMs
top candidates for SCM. may help solid-state neuro-network to reach the synaptic
density close to that in brains (~1010 cm-2).
C. Enabling novel architectures and low-power design
Wireless sensor network for Internet of Things (IoT) has B. Hardware security
more restrictive power budget than mobile devices. These Variability and stochastic mechanism are major challenges
systems spend much of their lifetime in sleep mode. The for RRAM. Another chaotic behavior frequently observed in
standby power of their memory system dominates total energy RRAM is the Random telegraph noise (RTN) that can be
consumption. Volatile SRAM in short standby state still has to attributed to the charging and discharging of traps in the oxides
112
[30]. Probabilistic switching has been well characterized for [6] H.Y. Cheng, et al, :Atomic-level engineering of phase change material
some NVMs, e.g., STTRAM [24]. These random behaviors of for novel-switching and high-endurance PCM for storage class memory
application,” IEDM Tech. Dig., pp. 758-761, Dec. 2013.
emerging NVMs may provide entropy sources useful for [7] J.M. Slaugher, et al, “High density ST-MRAM technology,” IEDM
hardware security applications. Tech. Dig., pp. 673-676, Dec. 2012.
[8] S. Ikeda, et al, “A perpendicular-anisotropy CoFeB–MgO magnetic
1) Random number generator (RNG): The probabilistic tunnel junction,” Nat. Mater. vol. 9, pp. 721-724, Sep. 2010.
switching of STTRAM allows programing the device at the [9] G. Jan, et al, “Demonstration of fully functional 8Mb perpendicular
voltage or pulse conditions for 50% switching probability, STT-MRAM chips with sub-5ns writing for non-volatile embedded
leading to equal chance of the device falling in “0” or “1” memories,” Sym. VLSI Tech., pp. 50-51, Jun. 2014.
afterwards. This behavior can be utilized to create a RNG, [10] T. Maruyama, et al, “Large voltage-induced magnetic anisotropy change
which has been demonstrated experimentally and shown to in a few atomic layers of iron,” Nat. Nanotech., vol. 4, pp. 158-161, Jan.
2009.
have sufficient randomness for security applications [31]. [11] L. Liu, et al, “Spin-torque switching with the giant spin Hall effect of
Alternatively, the strong signal of RTN in RRAM can also be tantalum,” Science, vol. 336, pp. 555-558, May 2012.
used to generate random numbers in a simple circuit [30]. [12] I.G. Baek, et al, “Highly scalable non-volatile resistive memory using
simple binary oxide driven by asymmetric unipolar voltage pulses,”
2) Physical unclonable function (PUF): PUF utilizes the IEDM Tech. Dig., Dec. 2004.
physical randomness to generate unclonable instance-specific [13] H.Y. Lee, et al, “Low power and high speed bipolar switching with a
security features and can be used as “fingerprint” to identify or thin reactive Ti buffer layer in robust HfO2 based RRAM,” IEDM Tech.
authenticate specific hardwares [32]. Existing PUF solutions Dig., Dec. 2008.
[14] Z. Wei, et al, “Highly reliable TaOx ReRAM and direct evidence of
mostly exploit inevitable IC manufacturing variation. The redox reaction mechanism,” IEDM Tech. Dig., Dec. 2008.
variability of RRAM provides another source of randomness [15] M.J. Kim, et al, “Low power operating bipolar TMO ReRAM for sub 10
for PUF implementation. Unlike manufacturing variation, nm era,” IEDM Tech. Dig., pp. 444-447, Dec. 2010.
RRAM variability is intrinsic in physical mechanisms, which [16] R. Fackenthal, et al, “A 16Gb ReRAM with 200MB/s write and 1GB/s
is less process dependent and potentially reconfigurable [33]. read in 27nm technology,” ISSCC, 19.7, Feb. 2014.
PUF solutions have to satisfy rigorous testing for randomness, [17] A. Fantini, et al, “Intrinsic switching variability in HfO2 RRAM,” IMW,
uniqueness, and robustness to be useful. pp. 30-33, May 2013.
[18] T.P. Ma and J.-P. Han, “Why is nonvolatile ferroelectric memory field-
Hardware security applications exploit the weakness of effect transistor still elusive?” EDL, vol. 23, pp. 386–388, Jul. 2002.
emerging NVMs and turn it into useful functions. While [19] J. Muller, et al, “Ferroelectric hafnium oxide: a CMOS-compatible and
highly scalable approach to future ferroelectric memories, IEDM Tech.
opening more interesting opportunities for emerging NVMs, Dig., pp. 280-283, Dec. 2013.
they also impose different device requirements. The feasibility [20] A. Chen, “Comprehensive methodology for the design and assessment
of the security solutions relies on the proof of true randomness of crossbar memory array with nonlinear and asymmetric selector
of these stochastic characteristics of emerging NVMs. devices,” IEDM Tech. Dig., pp. 746-749, Dec. 2013.
[21] R. Aitken, et al, “Device and technology implications of the internet of
things,” Sym. VLSI Tech., pp. 2-5, Jun. 2015.
VI. SUMMARY [22] A. Chen, “Feasibility analysis of high-density STTRAM designs with
Emerging NVMs offers a wide range of performance, crossbar or shared transistor structures,” DRC, pp. 295-296, Jun. 2014.
maturity, and scaling potential. Great opportunities exist in [23] T. Yamauchi, “Prospect of embedded non-volatile memory in the smart
society,” VLSI-TSA, Apr. 2015.
improving or replacing incumbent memories with emerging
[24] K. Baker, “Embedded nonvolatile memories,” IMW, May 2012.
NVMs, designing novel architectures, and enabling new
[25] R.F. Freitas and W.W. Wilcke, “Storage-class memory: the next storage
functions. Future electronics driven by mobile, IoT, and data- system technology,” IBM J. Res. & Dev., vol. 52, pp. 439-447, Jul./Sep.
centric applications will rely more on NVM solutions to fulfill 2008.
the need for high-density data storage, ultra-low power design, [26] G.W. Burr, et al, “Overview of candidate device technologies for
intelligent hardware functions, and even high-performance storage-class memory,” IBM J. Res. & Dev., vol. 52, pp. 449-464,
Jul./Sep. 2008.
computing systems. Challenges still remain in high-yield
[27] E. Kitagawa, et al, “Impact of ultra low power and fast write operation
NVM manufacturing, material and device optimization, and of advanced perpendicular MTJ on power reduction for high-
down-selection of the most promising emerging NVM solution performance mobile CPU," IEDM Tech. Dig., pp. 677-680, Dec. 2012.
for different applications. [28] Y. Dan and M.M. Poo, “Spike timing-dependent plasticity: from
synapse to perception,” Physiol Rev, vol. 86, pp. 1033–1048, Jul. 2006.
[29] H. Choi, et al, An electrically modifiable synapse array of resistive
REFERENCES switching memory, Nanotech., vol. 20, pp. 345201-1-5, Jul. 2009.
[1] W.A. Wulf and S.A. McKee, “Hitting the memory wall: implications of [30] C.Y. Huang, et al, “A contact-resistive random-access-memory-based
the obvious,” ACM SIGARCH Comp. Arch. News, vol. 23, pp. 20-24, true random number generator,” IEEE EDL, vol. 33, pp. 1108-1110,
Mar. 1995. Aug. 2012.
[2] ITRS Emerging Research Devices Chapter, 2013. [31] W.H. Choi, et al, “A magnetic tunnel junction based true random
[3] G.W. Burr, et al, “Phase change memory technology,” J. Vac. Sci. number generator with conditional perturb and real-time output
Technol. B, vol. 28, pp. 223-262, Mar./Apr. 2010. probability tracking,” IEDM Tech. Dig., pp. 315-318, Dec. 2014.
[4] S. Raoux, F. Xiong, M. Wuttig, and E. Pop, “Phase change materials [32] C. Herder et al, “Physical unclonable functions and applications: A
and phase change memory,” MRS Bulletin, vol. 39, pp. 703-710, Aug. tutorial,” Proc. IEEE, vol. 102, pp. 1126–1141, Aug. 2014.
2014. [33] A. Chen, “Utilizing the variability of resistive random access memory to
[5] C.H. Lam, “Phase change memory and its intended applications,” IEDM implement reconfigurable physical unclonable functions,” IEEE EDL,
Tech. Dig., pp689-692, Dec. 2014. vol. 36, pp. 138-140, Feb. 2015.
113