The Impact of Artificial Intelligence On Communication
The Impact of Artificial Intelligence On Communication
ICT Discoveries
Volume 1, No. 1, March 2018
The impact of
Artificial Intelligence
on communication networks
and services
)LUVWVSHFLDOLVVXHRQ
7KHLPSDFWRI
$UWLILFLDO,QWHOOLJHQFH
RQFRPPXQLFDWLRQQHWZRUNV
DQGVHUYLFHV
The ITU Journal: ICT Discoveries publishes original research on
telecommunication/ICT technical developments and their policy and
regulatory, economic, social and legal dimensions. It builds bridges
between disciplines, connects theory with application, and stimulates
international dialogue. This interdisciplinary approach reflects ITU’s
comprehensive field of interest and explores the convergence of
telecommunication/ICT with other disciplines. It also features review
articles, best practice implementation tutorials and case studies.
Publication rights
© International Telecommunication Union, 2018
Some rights reserved. This work is available under the CC BY-NC-ND 3.0 IGO license:
https://creativecommons.org/licenses/by-nc-nd/3.0/igo/.
SUGGESTED CITATION: ITU Journal: ICT Discoveries, Vol. 1(1), March 2018;
License: CC BY-NC-ND 3.0 IGO
COMMERCIAL USE: Requests for commercial use and licensing should be addressed to ITU
Sales at [email protected]
THIRD-PARTY MATERIALS: If you wish to reuse material from their published articles that
is attributed to a third party, such as tables, figures or images, it is your responsibility to
determine whether permission is needed for that reuse and to obtain permission from the
copyright holder. The risk of claims resulting from infringement of any third-party-owned
component in the work rests solely with the user.
GENERAL DISCLAIMERS: The designations employed and the presentation of the material
in the published articles do not imply the expression of any opinion whatsoever on the part
of ITU concerning the legal status of any country, territory, city or area or of its authorities, or
concerning the delimitation of its frontiers or boundaries. The mention of specific companies
or of certain manufacturers’ products does not imply that they are endorsed or recommended
by ITU in preference to others of a similar nature that are not mentioned.
ADDITIONAL INFORMATION
Please visit the ITU Journal website at:
https://www.itu.int/en/journal/Pages/default.aspx
Foreword
The International Telecommunication Union is proud to
have launched the new, scholarly and professional ITU
Journal: ICT Discoveries, and published its first special
issue.
This Journal was established to encourage the
participation of universities and research institutions
from different fields in the work of ITU. It identifies
emerging technical developments, including their
policy, regulatory, economic, social and legal
dimensions, in information and communication
technologies (ICTs).
The ITU Journal builds bridges between disciplines,
connects theory with application, and promotes the
critical role that ICTs will play in the pursuit of United
Nations’ Sustainable Development Goals.
The interdisciplinary scope of the ITU Journal reflects
the inclusive character of ITU.
ITU is the United Nations specialized agency for ICTs. We are a public-private partnership, given life by a
membership of 193 Member States, over 800 members from industry, international and regional organizations
and academia. Researchers participate alongside industry-leading engineers and policymakers in ITU expert
groups responsible for radiocommunication, standardization and development.
The long-term vision of academia helps ITU to prepare for the future. The ITU Journal matches research on
technical innovation in ICT with analysis of associated transformations in business and society and the related
complexities of governance in the digital era. It will help industry players and policymakers to prepare for the
impacts of major breakthroughs in research.
The ITU Journal is a peer-reviewed, open access, freely available digital publication.
This first special issue of the ITU Journal forecasts how Artificial Intelligence (AI) will improve user
experience by enhancing the performance and efficiency of communication networks. It will assist ITU
members in their preparations for AI’s expected influence on their work, providing the context for this
influence from the perspectives of technology as well as law, ethics, society and regulation.
I express my gratitude to all contributors to the ITU Journal and I would especially like to thank the ITU
Journal’s Editor-in-Chief, Professor Jian Song of Tsinghua University, for the great dedication with which he
has led the curation of this first special issue.
Houlin Zhao
Secretary-General
International Telecommunication Union
– iii –
ITU JOURNAL: ICT Discoveries, Vol. 1(1), March 2018
Foreword
Artificial Intelligence (AI) and Machine Learning (ML) are certain
to influence a broad scope of ITU’s technical work. This first
special issue of the ITU Journal provides the context for this
influence from the perspectives of technology as well as business,
law and ethics.
Standardization experts contributing to ITU-T Study Groups are
accelerating their studies of AI’s potential to assist their
preparations for the 5G era.
These studies are looking to AI to bring more automation and
intelligence to network design, operation and maintenance,
introducing greater efficiency with network self-optimization.
Automated virtual assistants are expected to support the
customization of multimedia services, and learning algorithms are
playing an increasing role in the development of video
compression algorithms and algorithmic tools to monitor quality
of service and user experience. Cities of the future will be built on
the smart use of data, with AI and machine learning delivering
data-driven insight to assist cyber-physical systems in adapting
their behavior autonomously in the interests of efficiency.
A new ITU Focus Group on ML for 5G is offering essential support to these studies by proposing technical
frameworks to assist machine learning in contributing to the efficiency of emerging 5G systems.
Machine Learning is expected to assist the ICT industry in meeting the challenges brought on by 5G and the
Internet of Things, shifts representative of considerable increases in network complexity and the diversity of
device requirements. The new ITU Focus Group on ML for 5G will define the requirements of machine
learning as they relate to technology, network architectures and data formats. Key to this work will be the
definition of required data formats and associated mechanisms to safeguard security and privacy.
The AI for Good Global Summit is the leading United Nations platform for dialogue on AI, aiming to ensure
that AI accelerates progress towards the United Nations' Sustainable Development Goals.
The 2nd AI for Good Global Summit at ITU Headquarters in Geneva, 15-17 May 2018, will continue to
formulate strategies to ensure trusted, safe and inclusive development of AI technologies and equitable access
to their benefits. The action-oriented 2018 summit will identify practical applications of AI and supporting
strategies to improve the quality and sustainability of life on our planet. It builds on the success of the ground-
breaking AI for Good Global Summit in June 2017, the first event to launch inclusive global dialogue on the
actions necessary to ensure that AI benefits humanity.
ITU’s standardization sector will continue to play an important role in ITU’s expanding set of activities on AI.
This first special issue of the ITU Journal, the AI and Machine Learning studies of ITU-T Study Groups and
our new Focus Group – alongside the AI for Good series – will be of great value to ITU standardization experts
in their efforts to determine how their work could be of most value to AI innovation.
Chaesub Lee
Director
ITU Telecommunication Standardization Bureau
– iv –
ITU JOURNAL: ICT Discoveries, Vol. 1(1), March 2018
Editor-in-Chief Message
The research community works in service of the public
interest. We hope to ensure that our work supports social
and economic development on a global scale. We share
these ideals with the United Nations.
The ITU Journal: ICT Discoveries is a prime example of
how ITU and academia are enhancing collaboration to
our mutual benefit. In the ITU Journal, the research
community sees a valuable new opportunity to serve the
public interest. We see a new opportunity to make our
research known to public and private-sector decision-
makers worldwide.
The ITU Journal looks at both technical and social
aspects of ICTs’ influence on business, governance and
society. It will find new connections between technical
and social sciences, as well as new connections between
various industry sectors and public-sector bodies. We are
certain to uncover new opportunities to work together.
This first special issue of the ITU Journal demonstrates the interdisciplinary scope of this publication.
The issue highlights the potential of Artificial Intelligence to support communication networks and services in
fields including cognitive radio, automated driving and the monitoring of our environment. It also explores
design principles for AI systems sensitive to human values as well as the ethical implications of advancing AI
capabilities as they relate to data security.
I would like to thank the ITU Secretary-General, Houlin Zhao, for entrusting me with the role of ITU Journal
Editor-in-Chief. I also thank the Director of the ITU Telecommunication Standardization Bureau, Chaesub
Lee, for the outstanding support that I have received from his bureau.
I would like to express my gratitude to all contributors to this first special issue of the ITU Journal as well as
the Outreach Chairman, Stephen Ibaraki and my Associate Editors-in-Chief: Rajkumar Buyya, University of
Melbourne, Australia; Jun Kyun Choi, Korea Advanced Institute of Science and Technology; Xiaolan Fu,
University of Oxford, UK; Urs Gasser, Harvard University, USA; Alison Gillwald, Research ICT Africa,
South Africa; Terry Kramer, University of California, Los Angeles; and Mostafa Hashem Sherif, AT&T, USA.
For their significant contribution to the review process, my special thanks go to all the reviewers and Guest
Editors: Antoine Bigomokero Bagula, University of Western Cape, South Africa; Loreto Bravo, Universidad
del Desarollo, Chile; Urs Gasser, Harvard University; Larry Holder, Washington State University, USA; Deyi
Li, Chinese Academy of Engineering, China; Kazuo Sugiyama, NTT DOCOMO, Japan; Daniel Zeng,
University of Arizona, USA; Jun Zhu, Tsinghua University, China.
I look forward to feedback from our readers and our continued work together to stimulate this exciting new
direction in ITU-Academia collaboration.
Jian Song
Tsinghua University
China
–v–
ITU JOURNAL: ICT Discoveries, Vol. 1(1), March 2018
– ix –
ITU JOURNAL: ICT Discoveries, Vol. 1(1), March 2018
Gyu Myoung Lee (Liverpool John Moores Kazuo Sugiyama (NTT DOCOMO Inc.,
University, UK) Japan)
Guopeng Li (Tsinghua University, China) Fengxiao Tang (Tohoku University, Japan)
Jun Liao (ChinaUnicom Network Institute, Ikram Ud Din (Universiti Utara
China) Malaysia, Malaysia)
Li Linjing (Institute of Automation, Chinese Haining Wang (China Telecommunications,
Academy of Sciences, China) China)
Hope Mauwa (University of Western Cape, Jintao Wang (Tsinghua University, China)
South Africa)
Guibao Xu (China Academy of Information
Luzango Mfupe (Council for Scientific and and Communication Technology, China)
Industrial Research (CSIR), South Africa)
Daniel Zeng (University of Arizona, USA)
Angelos Michalas (Technological Education
Chao Zhang (Tsinghua University, China)
Institute of Western Macedonia, Greece)
Jun Zhu (Tsinghua University, China)
Yubo Mu (China Academy of Information and
Communication Technology, China)
Tomoyuki Otani (DOCOMO Technology, ITU Editorial Team
inc., Japan)
Alessia Magliarditi, Executive Editor-in-Chief
Jordi Pérez-Romero (Universitat Politècnica
de Catulunya, Spain) Erica Campilongo, Managing Editor
Leah Plunkett (Berkman Klein Center for Nolwandle Simiso Dlodlo, Editorial Assistant
Internet & Society at Harvard & UNH School Emer Windsor, Administrative Assistant
of Law, USA)
Amanda Pauvaday-Rush, Copy Editor
Oriol Sallent (Universitat Politècnica de
Matt Dalais, Communications Officer
Catulunya, Spain)
Rae Paladin, Web Manager
Mostafa Hashem Sherif (AT&T, USA)
Pascal Borde, Promotional Support
David Simmons (University of Oxford, UK)
Chris Clark and Regina Valiullina, Outreach
Zheng Siyi (Chinese Institute of Command
Team
and Control, China)
Jian Song (Tsinghua University, China)
–x–
ITU JOURNAL: ICT Discoveries, Vol. 1(1), March 2018
TABLE OF CONTENTS
Page
Foreword by the ITU Secretary-General .............................................................................................. iii
Foreword by the TSB Director ............................................................................................................. iv
– xi –
ITU JOURNAL: ICT Discoveries, Vol. 1(1), March 2018
14. New Technology Brings New Opportunity for Telecommunication Carriers: Artificial
Intelligent Applications and Practices in Telecom Operators............................................ 121
Wei Liang, Mingjun Sun, Baohong He, Mingchuan Yang, Xiaoou Liu, Bouhan Zhang,
Yunato Wang
15. Correlation and Dependence Analysis on Cyberthreat Alerts ........................................... 129
John M. A. Bothos, Konstantinos-Georgios Thanos, Dimitris M. Kyriazanos, George
Vardoulias, Andreas Zalonis, Eirini Papadopoulou, Yannis Corovesis, Stelios C.A.
Thomopoulos
Index of authors .................................................................................................................................... 138
– xii –
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
Invited Papers
5HVSRQVLEOH$UWLILFLDO,QWHOOLJHQFH'HVLJQLQJ$,IRU+XPDQ9DOXHV
3DJHV
Virginia Dignum
$UWLILFLDOLQWHOOLJHQFH$,LVLQFUHDVLQJO\DIIHFWLQJRXUOLYHVLQVPDOOHURUJUHDWHUZD\V,QRUGHUWRHQVXUHWKDW
V\VWHPVZLOOXSKROGKXPDQYDOXHVGHVLJQPHWKRGVDUHQHHGHGWKDWLQFRUSRUDWHHWKLFDOSULQFLSOHVDQGDGGUHVV
VRFLHWDOFRQFHUQV,QWKLVSDSHUZHH[SORUHWKHLPSDFWRI$,LQWKHFDVHRIWKHH[SHFWHGHIIHFWVRQWKH(XURSHDQ
ODERUPDUNHWDQGSURSRVHWKHDFFRXQWDELOLW\UHVSRQVLELOLW\DQGWUDQVSDUHQF\$57GHVLJQSULQFLSOHVIRUWKH
GHYHORSPHQWRI$,V\VWHPVWKDWDUHVHQVLWLYHWRKXPDQYDOXHV
9LHZ$UWLFOH
5HFRQILJXUDEOH3URFHVVRUIRU'HHS/HDUQLQJLQ$XWRQRPRXV9HKLFOHV
3DJHV
Yu Wang, Shuang Liang, Song Yao, Yi Shan, Song Han, Jinzhang Peng, Hong Luo
7KHUDSLGJURZWKRIFLYLOLDQYHKLFOHVKDVVWLPXODWHGWKHGHYHORSPHQWRIDGYDQFHGGULYHUDVVLVWDQFHV\VWHPV
$'$6VWREHHTXLSSHGLQFDU5HDOWLPHDXWRQRPRXVYLVLRQ57$9LVDQHVVHQWLDOSDUWRIWKHRYHUDOOV\VWHP
DQGWKHHPHUJHQFHRIGHHSOHDUQLQJPHWKRGVKDVJUHDWO\LPSURYHGWKHV\VWHPTXDOLW\ZKLFKDOVRUHTXLUHVWKH
SURFHVVRUWRRIIHUDFRPSXWLQJVSHHGRIWHUDRSHUDWLRQVSHUVHFRQG7236DQGDSRZHUFRQVXPSWLRQRIQR
PRUHWKDQ:ZLWKSURJUDPPDELOLW\7KLVDUWLFOHJLYHVDQRYHUYLHZRIWKHWUHQGVRI57$9DOJRULWKPVDQG
GLIIHUHQWKDUGZDUHVROXWLRQVDQGSURSRVHVDGHYHORSPHQWURXWHIRUWKHUHFRQILJXUDEOH57$9DFFHOHUDWRU:H
SURSRVHRXUILHOGSURJUDPPDEOHJDWHDUUD\)3*$EDVHGV\VWHP$ULVWRWOHWRJHWKHUZLWKDQDOOVWDFNVRIWZDUH
KDUGZDUH FR GHVLJQ ZRUNIORZ LQFOXGLQJ FRPSUHVVLRQ FRPSLODWLRQ DQG FXVWRPL]HG KDUGZDUH DUFKLWHFWXUH
(YDOXDWLRQVKRZVWKDWRXU)3*$V\VWHPFDQUHDOL]HUHDOWLPHSURFHVVLQJRQPRGHUQ57$9DOJRULWKPVZLWKD
KLJKHUHIILFLHQF\WKDQSHHU&38DQG*38SODWIRUPV2XURXWORRNEDVHGRQWKH$6,&EDVHGV\VWHPGHVLJQDQG
WKHRQJRLQJLPSOHPHQWDWLRQRIQH[WJHQHUDWLRQPHPRU\ZRXOGWDUJHWD7236SHUIRUPDQFHZLWKDURXQG
:SRZHU
9LHZ$UWLFOH
5HDO7LPH0RQLWRULQJRIWKH*UHDW%DUULHU5HHI8VLQJ,QWHUQHWRI7KLQJVZLWK%LJ
'DWD$QDO\WLFV
3DJHV
Marimuthu Palaniswami, Aravinda S. Rao, Scott Bainbridge
7KH*UHDW%DUULHU5HHI*%5RI$XVWUDOLDLVWKHODUJHVWVL]HRIFRUDOUHHIV\VWHPRQWKHSODQHWVWUHWFKLQJRYHU
NLORPHWHUV&RUDOUHHIVDUHH[SHULHQFLQJDUDQJHRIVWUHVVHVLQFOXGLQJFOLPDWHFKDQJHZKLFKKDVUHVXOWHG
LQ HSLVRGHV RI FRUDO EOHDFKLQJ DQG RFHDQ DFLGLILFDWLRQ ZKHUH LQFUHDVHG OHYHOV RI FDUERQ GLR[LGH IURP WKH
EXUQLQJRIIRVVLOIXHOVDUHUHGXFLQJWKHFDOFLILFDWLRQPHFKDQLVPRIFRUDOV,QWKLVDUWLFOHZHSUHVHQWDVXFFHVVIXO
DSSOLFDWLRQRIELJGDWDDQDO\WLFVZLWK,QWHUQHWRI7KLQJV,R7ZLUHOHVVVHQVRUQHWZRUNV:61VWHFKQRORJ\
WR PRQLWRU FRPSOH[ PDULQH HQYLURQPHQWV RI WKH *%5 7KH SDSHU SUHVHQWV DWZRWLHUHG ,R7:61 QHWZRUN
DUFKLWHFWXUH XVHG WR PRQLWRU WKH *%5 DQG WKH UROH RI DUWLILFLDO LQWHOOLJHQFH $, DOJRULWKPV ZLWK ELJ GDWD
DQDO\WLFVWRGHWHFWHYHQWVRILQWHUHVW7KHFDVHVWXG\SUHVHQWVWKHGHSOR\PHQWRID:61DW+HURQ,VODQGLQWKH
VRXWKHUQ*%5LQ,WLVVKRZQWKDWZHDUHDEOHWRGHWHFW&\FORQH+DPLVKSDWWHUQVDVDQDQRPDO\XVLQJ
WKHVHQVRUWLPHVHULHVRIWHPSHUDWXUHSUHVVXUHDQGKXPLGLW\GDWD7KHDUWLFOHDOVRJLYHVDSHUVSHFWLYHRI$,
DOJRULWKPV IURP WKH YLHZSRLQW WR PRQLWRU PDQDJH DQG XQGHUVWDQG FRPSOH[ PDULQH HFRV\VWHPV 7KH
NQRZOHGJHREWDLQHGIURPWKHODUJHVFDOHLPSOHPHQWDWLRQRI,R7ZLWKELJGDWDDQDO\WLFVZLOOFRQWLQXHWRDFWDV
DIHHGEDFNPHFKDQLVPIRUPDQDJLQJDFRPSOH[V\VWHPRIV\VWHPV6R6LQRXUPDULQHHFRV\VWHP
9LHZ$UWLFOH
±[Y±
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
,QFOXVLRQRI$UWLILFLDO,QWHOOLJHQFHLQ&RPPXQLFDWLRQ1HWZRUNVDQG6HUYLFHV
3DJHV
Xu Guibao, Mu Yubo, Liu Jialiang
$,ZLWKOHDUQLQJDELOLWLHVLVDUHYROXWLRQDU\WHFKQRORJ\ZKLFKWKHFRPPXQLFDWLRQLQGXVWU\LVH[SORULQJZLWK
WKHDLPRILQWURGXFLQJLWLQWRFRPPXQLFDWLRQQHWZRUNVDQGWRSURYLGHQHZVHUYLFHVDQGWRLPSURYHQHWZRUN
HIILFLHQF\DQGXVHUH[SHULHQFH$WWKLVWLPHWKHUHLVQRWRWDOVROXWLRQRUFRPSOHWHIUDPHZRUNWRGRVR2QH
FRQWHQGHULQWKHVWHSVWRZDUGVDVROXWLRQLVD),1(IUDPHZRUNZKLFKFDQEHLOOXVWUDWHGE\WKHH[DPSOHRIDQ
6'11)9FROODERUDWLYHO\GHSOR\HGQHWZRUN
9LHZ$UWLFOH
([SODLQDEOH$UWLILFLDO,QWHOOLJHQFH8QGHUVWDQGLQJ9LVXDOL]LQJDQG,QWHUSUHWLQJ'HHS
/HDUQLQJ0RGHOV
3DJHV
Wojciech Samek, Thomas Wiegand, Klaus-Robert Müller
:LWK WKH DYDLODELOLW\ RI ODUJH GDWDEDVHV DQG UHFHQW LPSURYHPHQWV LQ GHHS OHDUQLQJ PHWKRGRORJ\ WKH
SHUIRUPDQFH RI $, V\VWHPV LV UHDFKLQJ RU HYHQ H[FHHGLQJ WKH KXPDQ OHYHO RQ DQ LQFUHDVLQJ QXPEHU RI
FRPSOH[WDVNV,PSUHVVLYHH[DPSOHVRIWKLVGHYHORSPHQWFDQEHIRXQGLQGRPDLQVVXFKDVLPDJHFODVVLILFDWLRQ
VHQWLPHQWDQDO\VLVVSHHFKXQGHUVWDQGLQJRUVWUDWHJLFJDPHSOD\LQJ+RZHYHUEHFDXVHRIWKHLUQHVWHGQRQ
OLQHDUVWUXFWXUHWKHVHKLJKO\VXFFHVVIXOPDFKLQHOHDUQLQJDQGDUWLILFLDOLQWHOOLJHQFHPRGHOVDUHXVXDOO\DSSOLHG
LQDEODFNER[PDQQHULHQRLQIRUPDWLRQLVSURYLGHGDERXWZKDWH[DFWO\PDNHVWKHPDUULYHDWWKHLUSUHGLFWLRQV
6LQFHWKLVODFNRIWUDQVSDUHQF\FDQEHDPDMRUGUDZEDFNHJLQPHGLFDODSSOLFDWLRQVWKHGHYHORSPHQWRI
PHWKRGVIRUYLVXDOL]LQJH[SODLQLQJDQGLQWHUSUHWLQJGHHSOHDUQLQJPRGHOVKDVUHFHQWO\DWWUDFWHGLQFUHDVLQJ
DWWHQWLRQ7KLVSDSHUVXPPDUL]HVUHFHQWGHYHORSPHQWVLQWKLVILHOGDQGPDNHVDSOHDIRUPRUHLQWHUSUHWDELOLW\
LQDUWLILFLDOLQWHOOLJHQFH)XUWKHUPRUHLWSUHVHQWVWZRDSSURDFKHVWRH[SODLQLQJSUHGLFWLRQVRIGHHSOHDUQLQJ
PRGHOVRQHPHWKRGZKLFKFRPSXWHVWKHVHQVLWLYLW\RIWKHSUHGLFWLRQZLWKUHVSHFWWRFKDQJHVLQWKHLQSXWDQG
RQHDSSURDFKZKLFKPHDQLQJIXOO\GHFRPSRVHVWKHGHFLVLRQLQWHUPVRIWKHLQSXWYDULDEOHV7KHVHPHWKRGVDUH
HYDOXDWHGRQWKUHHFODVVLILFDWLRQWDVNV
9LHZ$UWLFOH
7KH&RQYHUJHQFHRI0DFKLQH/HDUQLQJDQG&RPPXQLFDWLRQV
3DJHV
Wojciech Samek, Slawomir Stanczak, Thomas Wiegand
7KH DUHDV RI PDFKLQH OHDUQLQJ DQG FRPPXQLFDWLRQ WHFKQRORJ\ DUH FRQYHUJLQJ 7RGD\¶V FRPPXQLFDWLRQ
V\VWHPV JHQHUDWH D ODUJH DPRXQW RI WUDIILF GDWD ZKLFK FDQ KHOS WR VLJQLILFDQWO\ HQKDQFH WKH GHVLJQ DQG
PDQDJHPHQWRIQHWZRUNVDQGFRPPXQLFDWLRQFRPSRQHQWVZKHQFRPELQHGZLWKDGYDQFHGPDFKLQHOHDUQLQJ
PHWKRGV)XUWKHUPRUHUHFHQWO\GHYHORSHGHQGWRHQGWUDLQLQJSURFHGXUHVRIIHUQHZZD\VWRMRLQWO\RSWLPL]H
WKHFRPSRQHQWVRIDFRPPXQLFDWLRQV\VWHP$OVRLQPDQ\HPHUJLQJDSSOLFDWLRQILHOGVRIFRPPXQLFDWLRQ
WHFKQRORJ\HJVPDUWFLWLHVRU,QWHUQHWRIWKLQJVPDFKLQHOHDUQLQJPHWKRGVDUHRIFHQWUDOLPSRUWDQFH7KLV
SDSHUJLYHVDQRYHUYLHZRIWKHXVHRIPDFKLQHOHDUQLQJLQGLIIHUHQWDUHDVRIFRPPXQLFDWLRQVDQGGLVFXVVHV
WZRH[HPSODUDSSOLFDWLRQVLQZLUHOHVVQHWZRUNLQJ)XUWKHUPRUHLWLGHQWLILHVSURPLVLQJIXWXUHUHVHDUFKWRSLFV
DQGGLVFXVVHVWKHLUSRWHQWLDOLPSDFW
9LHZ$UWLFOH
±[YL±
ITU JOURNAL: ICT Discoveries, Vol. 1(1), March 2018
– xvii –
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
Selected Papers
2Q$GDSWLYH1HUXR)X]]\0RGHOIRU3DWK/RVV3UHGLFWLRQLQWKH9+)%DQG
3DJHV
Nazmat T. Surajudeen-Bakinde, Nasir Faruk, Muhammed Salman, Segun Popoola, Abdulkarim Oloyede,
Lukman A. Olawoyin
3DWKORVVSUHGLFWLRQPRGHOVDUHHVVHQWLDOLQWKHSODQQLQJRIZLUHOHVVV\VWHPVSDUWLFXODUO\LQEXLOWXSHQYLURQPHQWV
+RZHYHUWKHHIILFDFLHVRIWKHHPSLULFDOPRGHOVGHSHQGRQWKHORFDODPELHQWFKDUDFWHULVWLFVRIWKHSURSDJDWLRQ
HQYLURQPHQWV7KLVSDSHULQWURGXFHVDUWLILFLDOLQWHOOLJHQFHLQSDWKORVVSUHGLFWLRQLQWKH9+)EDQGE\SURSRVLQJDQ
DGDSWLYHQHXURIX]]\1)PRGHO7KHPRGHOXVHVILYHOD\HURSWLPL]HG1)QHWZRUNEDVHGRQEDFNSURSDJDWLRQ
JUDGLHQWGHVFHQWDOJRULWKPDQGOHDVWVTXDUHHUURUVHVWLPDWH(OHFWURPDJQHWLFILHOGVWUHQJWKVIURPWKHWUDQVPLWWHURI
WKH17$,ORULQZKLFKRSHUDWHVDWDIUHTXHQF\RI0+]ZHUHPHDVXUHGDORQJIRXUURXWHV7KHSUHGLFWLRQ
UHVXOWV RI WKH SURSRVHG PRGHO ZHUH FRPSDUHG WR WKRVH REWDLQHG YLD WKH ZLGHO\ XVHG HPSLULFDO PRGHOV 7KH
SHUIRUPDQFHVRIWKHPRGHOVZHUHHYDOXDWHGXVLQJWKH5RRW0HDQ6TXDUH(UURU506(6SUHDG&RUUHFWHG506(
6&506(0HDQ(UURU0(DQG6WDQGDUG'HYLDWLRQ(UURU6'(UHODWLYHWRWKHPHDVXUHGGDWD$FURVVDOOWKH
URXWHVFRYHUHGLQWKLVVWXG\WKHSURSRVHG1)PRGHOSURGXFHGWKHORZHVW506(DQG0(ZKLOHWKH6'(DQGWKH
6&506(ZHUHGHSHQGHQWRQWKHWHUUDLQDQGFOXWWHUFRYHUVRIWKHURXWHV7KXVWKHHIILFDF\RIWKHDGDSWLYH1)
PRGHOZDVYDOLGDWHGDQGFDQEHXVHGIRUHIIHFWLYHFRYHUDJHDQGLQWHUIHUHQFHSODQQLQJ
9LHZ$UWLFOH
%H\RQG0$'"7KH5DFHIRU$UWLILFLDO*HQHUDO,QWHOOLJHQFH
3DJHV
Anand Ramamoorthy, Roman Yampolskiy
$UWLILFLDOLQWHOOLJHQFHUHVHDUFKLVDVRXUFHRIJUHDWWHFKQRORJLFDODGYDQFHPHQWDVZHOODVHWKLFDOFRQFHUQDVDSSOLHG
$,LQYDGHVGLYHUVHDVSHFWVRIKXPDQOLIH<HWWUXHDUWLILFLDOJHQHUDOLQWHOOLJHQFHUHPDLQVRXWRIUHDFK%DVHGRQWKH
KLVWRU\ RI GHHSO\ WUDQVIRUPDWLYH WHFKQRORJLHV GHYHORSHG E\ PXOWLSOH DFWRUV RQ WKH JOREDO VWDJH DQG WKHLU
FRQVHTXHQFHVIRUJOREDOVWDELOLW\ZHFRQVLGHUWKHSRVVLELOLW\RIDUWLILFLDOJHQHUDOLQWHOOLJHQFHDUPVUDFHVDQGSURSRVH
VROXWLRQVDLPHGDWPDQDJLQJWKHGHYHORSPHQWRIVXFKDQLQWHOOLJHQFHZLWKRXWLQFUHDVLQJWKHULVNVWRJOREDOVWDELOLW\
DQGKXPDQLW\
9LHZ$UWLFOH
$UWLILFLDO,QWHOOLJHQFHIRU3ODFH7LPH&RQYROYHG:LUHOHVV&RPPXQLFDWLRQ1HWZRUNV
3DJHV
Ambuj Kumar
3UHYLRXVZRUNVKDYHEURXJKWWROLJKWWKDWWKHG\QDPLFDQGYDULDEOHPRWLRQVRISRWHQWLDOQHWZRUNXVHUVDQGRWKHU
HQYLURQPHQWDOIDFWRUVDUHWKHHWHUQDOWKUHDWWRSUHVHQWDQGIXWXUHZLUHOHVVFRPPXQLFDWLRQV2QHRIP\HDUOLHUZRUNV
GLVFXVVHVWKLVSHUHQQLDODQGSHUSHWXDOFKDOOHQJHDVWKHSODFHWLPHGHSHQGHQWIXQFWLRQV7KHSKHQRPHQDZDVFRLQHG
LQP\ZRUNDVSODFHWLPHFDSDFLW\37&DQGSODFHWLPHFRYHUDJH37&RZLWKERWKFROOHFWLYHO\NQRZQDVSODFH
WLPHFRYHUDJHDQGFDSDFLW\37&DUHGHULYHGDVWKHRXWFRPHVRIG\QDPLFVWKDWFDQEHH[SUHVVHGDVWKHIXQFWLRQV
RISODFHDQGWLPH7KHVHSKHQRPHQDGHJUDGHWKHHIILFLHQF\RIDQ\ZLUHOHVVFRPPXQLFDWLRQQHWZRUN:&1WRWKDW
ORZHVWSRLQWIURPZKHUHDQHWZRUNVHUYLFHSURYLGHU163PD\QRWKDYHDQ\FKRLFHEXWWRUHYDPSWKHQHWZRUN
$UWLILFLDOLQWHOOLJHQFH$,RQWKHRWKHUKDQGKDVEHHQVWULGLQJSURIRXQGO\IRUWKHSDVWVHYHUDOGHFDGHVIDQQLQJRXW
LWVLQIOXHQFHLQYDULRXVVHFWRUVRIVFLHQWLILFDQGWHFKQRORJLFDOGHYHORSPHQWV+RZHYHU$,LVDOPRVWDEVHQWLQWKH
DUHDRI:&1GLPHQVLRQLQJDQGRSWLPL]DWLRQHVSHFLDOO\IRUSODFH±WLPHHYHQWV7KLVSDSHUUHYLVLWVWKHWZRSODFH
WLPHIXQFWLRQVDV:&1SKHQRPHQDDQGZLWKWKHEDFNGURSRIWKHVHDVSHFWVVKDOOLQYHVWLJDWHWKHLQHYLWDEOHQHHG
IRU$,LQ:&1VDVZHOODVGHPRQVWUDWLQJKRZ$,FDQEHSDUWRISUHVHQWDQGIXWXUHZLUHOHVVFRPPXQLFDWLRQV
9LHZ$UWLFOH
±[YLLL±
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
%D\HVLDQ2QOLQH/HDUQLQJ%DVHG6SHFWUXP2FFXSDQF\3UHGLFWLRQLQ&RJQLWLYH5DGLR
1HWZRUNV
3DJHV
Ahmed Mohammed Mikaeil
3UHGLFWLQJ WKH QHDU IXWXUH RI SULPDU\ XVHU 38 FKDQQHO VWDWH DYDLODELOLW\ LH VSHFWUXP RFFXSDQF\ LV TXLWH
LPSRUWDQWLQFRJQLWLYHUDGLRQHWZRUNVLQRUGHUWRDYRLGLQWHUIHULQJLWVWUDQVPLVVLRQE\DFRJQLWLYHVSHFWUXPXVHU
LHVHFRQGDU\XVHU687KLVSDSHULQWURGXFHVDQHZVLPSOHPHWKRGIRUSUHGLFWLQJ38FKDQQHOVWDWHEDVHGRQ
HQHUJ\GHWHFWLRQ,QWKLVPHWKRGZHPRGHOWKH38FKDQQHOVWDWHGHWHFWLRQVHTXHQFHLH³38FKDQQHOLGOH´DQG
³38 FKDQQHO RFFXSLHG´ DV D WLPH VHULHV UHSUHVHQWHG E\ WZR GLIIHUHQW UDQGRP YDULDEOH GLVWULEXWLRQV :H WKHQ
LQWURGXFH%D\HVLDQRQOLQHOHDUQLQJ%2/WRSUHGLFWLQDGYDQFHWKHFKDQJHVLQWLPHVHULHVLH38FKDQQHOVWDWH
VR WKDW WKH VHFRQGDU\ XVHU FDQ DGMXVW LWV WUDQVPLVVLRQ VWUDWHJLHV DFFRUGLQJO\ $ VLPXODWLRQ UHVXOW SURYHV WKH
HIILFLHQF\RIWKHQHZDSSURDFKLQSUHGLFWLQJ38FKDQQHOVWDWHDYDLODELOLW\
9LHZ$UWLFOH
7KH(YROXWLRQRI)UDXG(WKLFDO,PSOLFDWLRQVLQWKH$JHRI/DUJH6FDOH'DWD%UHDFKHV
DQG:LGHVSUHDG$UWLILFLDO,QWHOOLJHQFH6ROXWLRQV'HSOR\PHQW
3DJHV
Abhishek Gupta
$UWLILFLDOLQWHOOLJHQFHLVEHLQJUDSLGO\GHSOR\HGLQDOOFRQWH[WVRIRXUOLYHVRIWHQLQVXEWOH\HWEHKDYLRUQXGJLQJ
ZD\V$WWKHVDPHWLPHWKHSDFHRIGHYHORSPHQWRIQHZWHFKQLTXHVDQGUHVHDUFKDGYDQFHPHQWVLVRQO\TXLFNHQLQJ
DVUHVHDUFKDQGLQGXVWU\ODEVDFURVVWKHZRUOGOHYHUDJHWKHHPHUJLQJWDOHQWDQGLQWHUHVWRIFRPPXQLWLHVDFURVVWKH
JOREH:LWKWKHLQHYLWDEOHGLJLWL]DWLRQRIRXUOLYHVLQFUHDVLQJO\VRSKLVWLFDWHGDQGHYHUODUJHUGDWDVHFXULW\EUHDFKHV
LQWKHSDVWIHZ\HDUVZHDUHLQDQHUDZKHUHSULYDF\DQGLGHQWLW\RZQHUVKLSLVEHFRPLQJDUHOLFRIWKHSDVW,QWKLV
SDSHUZHZLOOH[SORUHKRZODUJHVFDOHGDWDEUHDFKHVFRXSOHGZLWKVRSKLVWLFDWHGGHHSOHDUQLQJWHFKQLTXHVZLOOFUHDWH
DQHZFODVVRIIUDXGPHFKDQLVPVDOORZLQJSHUSHWUDWRUVWRGHSOR\³,GHQWLW\7KHIW´
9LHZ$UWLFOH
±[L[±
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
1HZ7HFKQRORJ\%ULQJV1HZ2SSRUWXQLW\IRU7HOHFRPPXQLFDWLRQ&DUULHUV$UWLILFLDO
,QWHOOLJHQW$SSOLFDWLRQVDQG3UDFWLFHVLQ7HOHFRP2SHUDWRUV
3DJHV
Wei Liang, Mingjun Sun, Baohong He, Mingchuan Yang, Xiaoou Liu, Bohuan Zhang, Yuntao Wang
,Q WKH HUD RI ³FRPSXWDWLRQDO LQWHOOLJHQFH SHUFHSWLRQDO LQWHOOLJHQFH DQG FRJQLWLYH LQWHOOLJHQFH´DV WKH PDLQ
GLUHFWLRQIRUWKHIXWXUHWHOHFRPRSHUDWRUVDUHRQWKHLUZD\WREXLOGLQJWKHLURZQDUWLILFLDOLQWHOOLJHQFH$,
HFRV\VWHP,QWHUPVRIGHYHORSLQJ$,WHFKQRORJ\WHOHFRPRSHUDWRUVKDYHXQLTXHUHVRXUFHVDQGWHFKQRORJ\
DGYDQWDJHVELJGDWDUHVRXUFHVVXSHULRUFRPSXWLQJSRZHUORWVRILQYHVWPHQWLQ$,DOJRULWKPLFUHVHDUFKEURDG
JRYHUQPHQWDQGHQWHUSULVHFXVWRPHUUHVRXUFHV%\PDNLQJIXOOXVHRIWKHVHVWUHQJWKVWKH\KDYHFDUULHGRXWD
VHULHVRIHIIHFWLYHSUDFWLFHVLQWKHYDULRXVILHOGDQGDFKLHYHGFRQVWUXFWLYHUHVXOWV7KLVUHSRUWZLOOEHDUUDQJHG
DVIROORZV,QWKHILUVWSDUWWKHKLVWRU\DQGWKHGHYHORSPHQWVWDWXVRI$,KDVEHHQLQWURGXFHGDVZHOODVWKH
&KLQHVH SRZHUIXO SROLF\ ZKLFK ZDV UHOHDVHG WR VXSSRUW LWV GHYHORSPHQW ,Q WKH VHFRQG SDUW WKH XQLTXH
DGYDQWDJHVIRURSHUDWRUVWRGHYHORS$,KDYHEHHQLQWURGXFHGZKLOVWLQWKHPHDQWLPHWKH$,GHYHORSPHQWLGHD
IRUWHOHFRPRSHUDWRUVKDVEHHQSURYLGHG,QWKHWKLUGSDUWLQRUGHUWREHPRUHSHUVXDVLYHWKHSUDFWLFHRI$,
E\WHOHFRPRSHUDWRUVLQPXOWLSOHILHOGVWRVDWLVI\LQWHUQDOUHTXLUHPHQWVDQGPHHWFXVWRPHUQHHGVKDVEHHQ
GHVFULEHG)LQDOO\EDVHGRQWKHFXUUHQWGHYHORSPHQWWUHQGVRI$,LWVIXWXUHSURVSHFWVDUHPDGHE\WKLVUHSRUW
8QGRXEWHGO\ LQ WKH IXWXUH RSHUDWRUV ZLOO IXUWKHU XVH WKHLU DGYDQWDJHV WR H[SORUH PRUH $, GHYHORSPHQW
RSSRUWXQLWLHV
9LHZ$UWLFOH
&RUUHODWLRQDQG'HSHQGHQFH$QDO\VLVRQ&\EHUWKUHDW$OHUWV
3DJHV
John M.A. Bothos, Konstantinos-Georgios Thanos, Dimitris M. Kyriazanos, George Vardoulias, Andreas
Zalonis, Eirini Papadopoulou, Yannis Corovesis, Stelios C.A. Thomopoulos
,QWKLVSDSHUDPHWKRGRORJ\IRUWKHHQKDQFHPHQWRIFRPSXWHUQHWZRUNV¶F\EHUGHIHQVHLVSUHVHQWHG8VLQJD
WLPHVHULHV GDWDVHW GUDZQ IRU D GD\ SHULRG DQG IRU KRXUV SHU GD\ DQG GHSLFWLQJ WKH RFFXUUHQFHV RI
F\EHUWKUHDW DOHUWV DW KRXUO\ LQWHUYDOV WKH FRUUHODWLRQ DQG GHSHQGHQF\ FRHIILFLHQWV WKDW RFFXU LQ DQ
RUJDQL]DWLRQ¶V QHWZRUN EHWZHHQ GLIIHUHQW W\SHV RI F\EHUWKUHDW DOHUWV DUH GHWHUPLQHG &HUWDLQ PDWKHPDWLFDO
PHWKRGVOLNHWKH6SHDUPDQFRUUHODWLRQFRHIILFLHQWDQGWKH3RLVVRQUHJUHVVLRQVWRFKDVWLFPRGHODUHXVHG)RU
FHUWDLQW\SHVRIF\EHUWKUHDWDOHUWVUHVXOWVVKRZDVLJQLILFDQWSRVLWLYHFRUUHODWLRQDQGGHSHQGHQFHEHWZHHQWKHP
7KH DQDO\VLV PHWKRGRORJ\ SUHVHQWHG FRXOG KHOS WKH DGPLQLVWUDWLYH DQG ,7 PDQDJHUV RI DQ RUJDQL]DWLRQ WR
LPSOHPHQWRUJDQL]DWLRQDOSROLFLHVIRUF\EHUVHFXULW\
9LHZ$UWLFOH
±[[±
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
KWWSHXURSDHXUDSLGSUHVVUHOHDVHB63((&+BHQKWP
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
3. RESPONSIBILITY IN AI
,QWKLVFODXVHZHGLVFXVVKRZWRDSSURDFKWKHGHVLJQ
RI$,V\VWHPVWKDWDUHVHQVLWLYHWRPRUDOSULQFLSOHV
DQGKXPDQYDOXH5HVSRQVLEOH$,LVPRUHWKDQWKH
WLFNLQJRIVRPHHWKLFDOµER[HV¶RUWKHGHYHORSPHQW
RI VRPH DGGRQ IHDWXUHV LQ $, V\VWHPV 5DWKHU
UHVSRQVLELOLW\LVIXQGDPHQWDOWRLQWHOOLJHQFHDQGQR
V\VWHPFDQEHWUXO\LQWHOOLJHQWLILWFDQQRWXQGHUVWDQG
UHVSRQVLELOLW\
5HVSRQVLEOH $, UHVWV LQ WKUHH SLOODUV RI HTXDO
)LJ,QIOXHQFHRIGLIIHUHQWIDFWRUVRQWKHHIIHFWVRI$, LPSRUWDQFH )LUVWO\ VRFLHW\ LQ JHQHUDO PXVW EH
RQWKHQDWXUHDQGQXPEHURI(XURSHDQMREV6FRUHVUDQJH SUHSDUHGWRWDNHUHVSRQVLELOLW\IRUWKHLPSDFWRI$,
IURPQRLQIOXHQFHWRKXJHLQIOXHQFH 7KLV PHDQV WKDW UHVHDUFKHUV DQG GHYHORSHUV VKRXOG
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
ER[HV +RZHYHU UHJXODWRUV DQG XVHUV GHPDQG ZD\ )XUWKHU UHVHDUFK LV QHHGHG WR YHULI\ WKLV
H[SODQDWLRQDQGFODULW\DERXWWKHGDWDXVHG0HWKRGV DSSURDFK<HWDQRWKHUDSSURDFKLVSURSRVHGLQ>@
DUHQHHGHGWRLQVSHFWDOJRULWKPVDQGWKHLUUHVXOWVDQG EDVHGRQSUDJPDWLFVRFLDOKHXULVWLFVLQVWHDGRIPRUDO
WRPDQDJHGDWDWKHLUSURYHQDQFHDQGWKHLUG\QDPLFV UXOHV RU PD[LPL]DWLRQ SULQFLSOHV 7KLV DSSURDFK
WDNHV D OHDUQLQJ SHUVSHFWLYH LQWHJUDWLQJ ERWK WKH
3.1. Responsible AI challenges LQLWLDO HWKLFDO GHOLEHUDWLRQ UXOHV ZLWK DGDSWDWLRQ WR
WKHFRQWH[W)LQDOO\SRRUO\XQGHUVWRRGEHKDYLRUE\
,QWKLVFODXVHZHGLVFXVVKRZWKHJHQHUDOSULQFLSOHV $,V\VWHPVFDQKDYHODUJHDQGODVWLQJFRQVHTXHQFHV
GHVFULEHG DERYH FDQ GLUHFW WKH GHYHORSPHQW RI $, DQG DGDSWLYH V\VWHPV PD\ DUULYH DW ³SHUYHUVH
V\VWHPV $VVXPLQJ WKDW WKH GHYHORSPHQW RI $, LQVWDQWLDWLRQV´RIWKHLUSURJUDPPHGJRDOV>@
V\VWHPV IROORZV D VWDQGDUG HQJLQHHULQJ F\FOH RI
$QDO\VLV'HVLJQ,PSOHPHQW(YDOXDWH WDNLQJ D 4. CONCLUDING REMARKS
GHVLJQIRUYDOXHVDSSURDFKEDVLFDOO\PHDQVWKDWWKH
DQDO\VLVSKDVHZLOOQHHGWRLQFOXGHDFWLYLWLHVIRUL ,QFUHDVLQJO\$,V\VWHPVZLOOEHWDNLQJGHFLVLRQVWKDW
WKHLGHQWLILFDWLRQRIVRFLHWDOYDOXHVLLGHFLGLQJRQ DIIHFWRXUOLYHVDQGRXUZD\RIOLYLQJLQVPDOOHURU
D PRUDO GHOLEHUDWLRQ DSSURDFK HJ WKURXJK JUHDWHUZD\V,QDOODUHDVRIDSSOLFDWLRQ$,PXVWEH
DOJRULWKPV XVHU FRQWURO RU UHJXODWLRQ DQG LLL DEOHWRWDNHLQWRDFFRXQWVRFLHWDOYDOXHVPRUDODQG
PHWKRGV WR OLQN YDOXHV WR IRUPDO V\VWHP HWKLFDO FRQVLGHUDWLRQV ZHLJK XS WKH UHVSHFWLYH
UHTXLUHPHQWV>@ SULRULWLHVRIYDOXHVKHOGE\GLIIHUHQWVWDNHKROGHUVDQG
5HVSRQVLELOLW\ LV DVVRFLDWHG ZLWK WKH FDSDELOLW\ RI LQPXOWLFXOWXUDOFRQWH[WVH[SODLQLWVUHDVRQLQJDQG
PRUDOGHOLEHUDWLRQLQSDUWLFXODUWKDWZKLFKLVUHODWHG JXDUDQWHH WUDQVSDUHQF\ $V WKH FDSDELOLWLHV IRU
WR GHDOLQJ ZLWK PRUDO GLOHPPDV IRU ZKLFK WKHUH LV DXWRQRPRXVGHFLVLRQPDNLQJJURZSHUKDSVWKHPRVW
QRW RQH RSWLPDO VROXWLRQ 6HYHUDO DXWKRUV KDYH LPSRUWDQW LVVXH WR FRQVLGHU LV WKH QHHG WR UHWKLQN
GLVFXVVHGWKHWUROOH\SUREOHPDVDQH[DPSOHRIVXFK UHVSRQVLELOLW\ %HLQJ IXQGDPHQWDOO\ WRROV $,
D VLWXDWLRQ ,Q WKLV VFHQDULR DQ $, V\VWHP HJ DQ V\VWHPVDUHIXOO\XQGHUWKHFRQWURODQGUHVSRQVLELOLW\
DXWRQRPRXVYHKLFOHPXVWGHFLGHEHWZHHQKDUPLQJ RI WKHLU RZQHUV RU XVHUV +RZHYHU WKHLU SRWHQWLDO
SHGHVWULDQVRULWVRZQSDVVHQJHUVZKHQDQDFFLGHQW DXWRQRP\DQGFDSDELOLW\WROHDUQUHTXLUHWKDWGHVLJQ
FDQQRWEHDYRLGHG$SSURDFKHVWRPRUDOGHOLEHUDWLRQ FRQVLGHUV DFFRXQWDELOLW\ UHVSRQVLELOLW\ DQG
UHIOHFW HWKLFDO WKHRULHV VXFK DV XWLOLWDULDQLVP VDYH WUDQVSDUHQF\SULQFLSOHVLQDQH[SOLFLWDQGV\VWHPDWLF
WKHPRVWOLYHVRUGHRQWRORJLFDO.DQWLDQGRQRKDUP PDQQHU 7KH GHYHORSPHQW RI $, DOJRULWKPV KDV VR
GHOLEHUDWHO\ )URP DQ LPSOHPHQWDWLRQ SHUVSHFWLYH IDUEHHQOHGE\WKHJRDORILPSURYLQJSHUIRUPDQFH
WKH GLIIHUHQW HWKLFDO WKHRULHV GLIIHU LQ WHUPV RI OHDGLQJWRRSDTXHEODFNER[HV3XWWLQJKXPDQYDOXHV
FRPSXWDWLRQDO FRPSOH[LW\ RI WKH UHTXLUHG DW WKH FRUH RI $, V\VWHPV FDOOV IRU D PLQG VKLIW RI
GHOLEHUDWLRQ DOJRULWKPV 7R LPSOHPHQW UHVHDUFKHUV DQG GHYHORSHUV WRZDUGV WKH JRDO RI
FRQVHTXHQWLDOLVW DJHQWV UHDVRQLQJ DERXW WKH LPSURYLQJ WUDQVSDUHQF\ UDWKHU WKDQ SHUIRUPDQFH
FRQVHTXHQFHV RI DFWLRQV LV QHHGHG ZKLFK FDQ EH ZKLFKZLOOOHDGWRQRYHODQGH[FLWLQJWHFKQLTXHVDQG
VXSSRUWHGE\HJG\QDPLFORJLFV)RUGHRQWRORJLFDO DSSOLFDWLRQV
DJHQWV KLJKHU RUGHU UHDVRQLQJ LV QHHGHG WR UHDVRQ $V $, V\VWHPV UHSODFH SHRSOH LQ PDQ\ WUDGLWLRQDO
DERXWWKHDFWLRQVWKHPVHOYHVLHWKHDJHQWPXVWEH MREVLWLVQHFHVVDU\WRUHWKLQNWKHPHDQLQJRIZRUN
DZDUH RI LWV RZQ DFWLRQ FDSDELOLWLHV DQG WKHLU -REV FKDQJH EXW PRUH LPSRUWDQWO\ WKH FKDUDFWHU RI
UHODWLRQVWRLQVWLWXWLRQDOQRUPVDQGWKHUXOHRIODZ MREVZLOOFKDQJH0HDQLQJIXORFFXSDWLRQVDUHWKRVH
$FFRXQWDELOLW\UHTXLUHVERWKWKHIXQFWLRQRIJXLGLQJ WKDW FRQWULEXWH WR WKH ZHOIDUH RI VRFLHW\ WKH
DFWLRQ E\ IRUPLQJ EHOLHIV DQG PDNLQJ GHFLVLRQV IXOILOOPHQWRIRQHVHOIDQGWKHDGYDQFHRIPDQNLQG
DQGWKHIXQFWLRQRIH[SODQDWLRQE\SODFLQJGHFLVLRQV 7KHVHDUHQRWQHFHVVDULO\HTXDWHGZLWKFXUUHQWµSDLG
LQDEURDGHUFRQWH[WDQGE\FODVVLI\LQJWKHPDORQJ MREV¶$,V\VWHPVFDQIUHHXVWRDQGEHUHZDUGIRU
PRUDO YDOXHV 7R WKLV HIIHFW PDFKLQH OHDUQLQJ FDUH IRU HDFK RWKHU HQJDJH LQ DUWV KREELHV DQG
WHFKQLTXHVFDQEHXVHGWRFODVVLI\VWDWHVRUDFWLRQVDV VSRUWVHQMR\QDWXUHDQGPHGLWDWHLHWKRVHWKLQJV
µULJKW¶ RU µZURQJ¶ EDVLFDOO\ LQ WKH VDPH ZD\ DV WKDWJLYHXVHQHUJ\DQGPDNHXVKDSS\
FODVVLILHUVOHDUQWRGLVWLQJXLVKEHWZHHQFDWVDQGGRJV ,QFUHDVLQJO\ URERWV DQG LQWHOOLJHQW DJHQWV ZLOO EH
$QRWKHUDSSURDFKWRGHYHORSH[SODQDWLRQPHWKRGVLV WDNLQJGHFLVLRQVWKDWFDQDIIHFWRXUOLYHVDQGZD\RI
WR DSSO\ HYROXWLRQDU\ HWKLFV >@ DQG VWUXFWXUHG OLYLQJ LQ VPDOOHU RU JUHDWHU ZD\V %HLQJ
DUJXPHQWDWLRQPRGHOV>@ IXQGDPHQWDOO\DUWLIDFWV$,V\VWHPV DUHIXOO\XQGHU
7KLVPRUHRYHUSURYLGHVDPRGHODJQRVWLFDSSURDFK WKH FRQWURO DQG UHVSRQVLELOLW\ RI WKHLU RZQHUV RU
SRWHQWLDOO\ DEOH WR GHDO ZLWK WUDQVSDUHQF\ LQ XVHUV +RZHYHU GHYHORSPHQWV LQ DXWRQRP\ DQG
VWRFKDVWLFORJLFDQGGDWDEDVHGPRGHOVLQDXQLIRUP OHDUQLQJ DUH UDSLGO\ HQDEOLQJ $, V\VWHPV WR GHFLGH
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
DQG DFW ZLWKRXW GLUHFW KXPDQ FRQWURO 7KDW LV LQ >@%DW\D)ULHGPDQ3HWHU.DKQDQG$ODQ%RUQLQJ
G\QDPLF HQYLURQPHQWV WKHLU DGDSWDELOLW\ 9DOXH VHQVLWLYH GHVLJQ DQG LQIRUPDWLRQ
FDSDELOLWLHV FDQ OHDG WR VLWXDWLRQV LQ ZKLFK WKH V\VWHPV$GYDQFHVLQ0DQDJHPHQW,QIRUPDWLRQ
FRQVHTXHQFHVRIWKHLUGHFLVLRQVDQGDFWLRQVZLOOQRW 6\VWHPV
EHDOZD\VSRVVLEOHWRGLUHFWRUSUHGLFW
0RUHWKDQEHLQJDULVNWRKXPDQYDOXHV$,EULQJVLQ >@'RORUHV *DOOHJR DQG 6DOYDGRU %XHQR
LWVHOI HQRUPRXV SRWHQWLDO WR LPSURYH WKH OLYHV RI ([SORULQJWKHDSSOLFDWLRQRIWKH'HOSKLPHWKRG
PDQ\DQGWRHQVXUHKXPDQULJKWVWRDOO+RZHYHU DVDIRUHFDVWLQJWRROLQLQIRUPDWLRQV\VWHPVDQG
KRZWKLVZLOOEHUHDOL]HGGHSHQGVRQXV WHFKQRORJLHVUHVHDUFK7HFKQRORJ\$QDO\VLV
6WUDWHJLF0DQDJHPHQW±
ACKNOWLEDGEMENT
>@*HUG*LJHUHQ]HU0RUDOVDWLVILFLQJ5HWKLQNLQJ
7KHDXWKRULVJUDWHIXOWR7KRPDV YDQ%LHPHQZKR PRUDO EHKDYLRU DV ERXQGHG UDWLRQDOLW\ 7RSLFV
SHUIRUPHGWKHVWXG\GHVFULEHGLQFODXVH LQFRJQLWLYHVFLHQFH±
REFERENCES >@5*RUGHQ7KHGHPLVHRI86HFRQRPLFJURZWK
5HVWDWHPHQWUHEXWWDODQGUHIOHFWLRQV7HFKQLFDO
>@ +$OGHZHUHOG9'LJQXPDQG<+7DQ'HVLJQ 5HSRUW 1%(5 :RUNLQJ 3DSHU 1R
IRUYDOXHVLQVRIWZDUHGHYHORSPHQW 1DWLRQDO%XUHDX(FRQRPLF5HVHDUFK
>@ .HQ %LQPRUH 1DWXUDO MXVWLFH 2[IRUG >@-DPHV-+XJKHV$VWUDWHJLFRSHQLQJIRUDEDVLF
8QLYHUVLW\3UHVV LQFRPH JXDUDQWHH LQ WKH JOREDO FULVLV EHLQJ
FUHDWHG E\ $, URERWV GHVNWRS PDQXIDFWXULQJ
>@ 1LFN %RVWURP 6XSHULQWHOOLJHQFH 3DWKV DQG ELRPHGLFLQH -RXUQDO RI (YROXWLRQ
GDQJHUVVWUDWHJLHV2832[IRUG 7HFKQRORJ\±
>@ (ULN %U\QMROIVVRQ DQG $QGUHV 0F$IHH 7KH >@../LOMD./DDNVRDQG-3DORPlNL8VLQJ
VHFRQG PDFKLQH DJH :RUN SURJUHVV DQG WKH GHOSKL PHWKRG ,Q 3URFHHGLQJV RI
SURVSHULW\ LQ D WLPH RI EULOOLDQW WHFKQRORJLHV 3,&0(7¶7HFKQRORJ\ 0DQDJHPHQWLQWKH
::1RUWRQ &RPSDQ\ (QHUJ\ 6PDUW :RUOG 3,&0(7 SDJHV ±
-XO\
>@ (ULN %U\QMROIVVRQ $QGUHZ 0F$IHH DQG
0LFKDHO6SHQFH/DERUFDSLWDODQGLGHDVLQWKH >@0F.LQVH\0DQXIDFWXULQJWKHIXWXUH7HFKQLFDO
SRZHUODZHFRQRP\)RUHLJQ$II UHSRUW
>@ 'HORLWWH )URP EUDZQ WR EUDLQV WKH LPSDFW RI >@6DQMD\ 0RGJLO DQG +HQU\ 3UDNNHQ $ JHQHUDO
WHFKQRORJ\RQMREVLQWKH8.7HFKQLFDOUHSRUW DFFRXQW RI DUJXPHQWDWLRQ ZLWK SUHIHUHQFHV
$FFHVVHG $UWLILFLDO,QWHOOLJHQFH±
>@ 9LUJLQLD 'LJQXP 5HVSRQVLEOH DXWRQRP\ ,Q >@,QW )HGHUDWLRQ RI 5RERWLFV 7KH LPSDFW RI
3URFHHGLQJV RI WKH 7ZHQW\6L[WK ,QWHUQDWLRQDO URERWV RQ SURGXFWLYLW\ HPSOR\PHQW DQG MREV
-RLQW&RQIHUHQFHRQ$UWLILFLDO,QWHOOLJHQFH,- 7HFKQLFDOUHSRUW$FFHVVHG
&$,¶SDJHV
>@&KLWX 2NROL DQG 6X]DQQH ' 3DZORZVNL 7KH
>@ /XFLDQR )ORULGL DQG -HII : 6DQGHUV 2Q WKH 'HOSKLPHWKRGDVDUHVHDUFKWRRODQH[DPSOH
PRUDOLW\ RI DUWLILFLDO DJHQWV 0LQGV DQG GHVLJQ FRQVLGHUDWLRQV DQG DSSOLFDWLRQV
PDFKLQHV ,QIRUPDWLRQ PDQDJHPHQW ±
>@ &DUO %HQHGLNW )UH\ DQG 0LFKDHO $ 2VERUQH >@&RPPLWWHH RQ 7HFKQRORJ\ 1DWLRQDO 6FLHQFH
7KHIXWXUHRIHPSOR\PHQWKRZVXVFHSWLEOHDUH 7HFKQRORJ\ &RXQFLO DQG 3HQQ\ +LOO 3UHVV
MREV WR FRPSXWHULVDWLRQ" 7HFKQRORJLFDO 3UHSDULQJ IRU WKH )XWXUH RI $UWLILFLDO
)RUHFDVWLQJ DQG 6RFLDO &KDQJH ,QWHOOLJHQFH &UHDWH6SDFH ,QGHSHQGHQW
3XEOLVKLQJ3ODWIRUP
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
ITU JOURNAL: ICT Discoveries, Vol. 1(1), March 2018
"CTUSBDU The rapid growth of civilian vehicles has stimulated the development of advanced driver assistance systems
(ADASs) to beequipped in-car. Real-time autonomous vision (RTAV) is an essential part of the overall system, and the
emergenceofdeeplearningmethodshasgreatlyimprovedthesystemquality, whichalsorequirestheprocessortooffera
computing speed of tera operations per second (TOPS) and a power consumption of no more than 30 W with
programmability. Thisarticlegivesan overview of the trends of RTAV algorithms and different hardware solutions, and
proposes a development route for thereconfigurable RTAV accelerator. We propose our field programmable gate array
(FPGA) based system Aristotle, together with an all-stack software-hardware co design workflow including
compression, compilation, and customized hardwarearchitecture. Evaluation shows that our FPGA system can realize
real-time processing on modern RTAV algorithms with a higher efficiency than peer CPU and GPU platforms. Our
outlookbasedontheASIC-basedsystemdesignandtheongoingimplementationofnextgenerationmemorywouldtargeta
100TOPSperformancewitharound20Wpower.
Keywords - Advanced driver assistance system (ADAS), autonomous vehicles, computer vision, deep learning, reconfig-
urable processor
1. INTRODUCTION
If you have seen the cartoon movie WALL-E, you will re-
member when WALL-E enters the starliner Axiom following
Eve, he sees a completely automated world with obese and
feeble human passengers laying in their auto driven chairs,
drinking beverages and watching TV. The movie describes
a pathetic future of human beings in the year of 2805 and
warns people to get up from their chairs and take some exer-
cise. However, the inside laziness has always been motivat-
ing geniuses to build auto driven cars or chairs, whatever it
takes to get rid of being a bored driver stuck in traffic jams.
At least for now, people find machines genuinely helpful for Figure 1. The market pattern of automotive cars.
our driving experience and sometimes they can even save
peoples lives. It has been nearly 30 years since the first In current ADASs, machine vision is an essential part; it is
successful demonstrations of ADAS [1][2][3], and the rapid also called autonomous vision [10]. Since the conditions of
development of sensors, computing hardware and related weather, roads and the shapes of captured objects are com-
algorithms has brought the conceptual system into reality. plex and variable with little concern for safety, the anticipa-
Modern cars are being equipped with ADAS and the num- tion for high recognition accuracy and rapid system reaction
bers are increasing. According to McKinseys estimation to these is urgent. For state-of-the-art algorithms, the number
[4], auto-driven cars will form a 1.9 trillion dollars mar- of operations has already increased to tens and hundreds of
ket in 2025. Many governments like those in the USA [5], giga-operations (GOPs). This has set a great challenge for
Japan [6] and Europe [7][8][9] have proposed their intelli- real time processing, and correspondingly we need to find a
gent transportation system (ITS) strategic plans, which have powerful processing platform to deal with it.
drawn up timetables for the commercialization of related
technologies.
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
Figure 7. Hardware designs of CNN accelerators on different platforms and development route for RTAV accelerator in
ADAS.
(Source by:https://nicsefc.ee.tsinghua.edu.cn/projects/neural-network-accelerator/)
[51] shows the comparison between neural network acceler- less than FPGAs, and the dynamic power consumption ratio
ators, as depicted in Fig. 7. We can see from the image that is approximately 14 for FPGA to ASIC, while the average
GPUs are among the top tier of computing speeds, but the chip area of ASIC is also 18 times smaller than FPGA. This
power consumption is also very high. The freshly released means we can realize a much better performance with ASIC
NVIDIA Tesla V100 can get an astounding computing speed within a given hardware area. ASIC designs have the rela-
of 120 TOPS [52], with a power consumption of 300 W. This tively better energy efficiency, mostly between 100 GOPS/W
can be useful in datacenter scenarios for cases like model to 10 TOPS/W. They have shown excellent performance in
training where power is not the main concern. There are low-power area, and as we can see from Fig. 7 some repre-
also some GPUs designed for low-power embedded environ- sentative designs such as DianNao [55], Eyeriss [56] and En-
ments, like NVIDIA Jetson TX1 mobile GPU, which brings vision [57] are showing a performance of around 100 GOPS
a 300 GOPS speed on VGG-16 and a peak performance of with only milli-watt level power consumption. The efficiency
1 TOPS with only a 10 W cost [53]. The large general pur- can even reach 10 TOPS/W at extreme low voltage status.
pose stream processors on chip might bring a considerable To the other side, those ASICs with larger chip sizes are
parallelism, but the efficiency remains a question. With the capable of offering more abundant PEs and memory band-
technology of 28nm, the NVIDIA TITAN-X and TX1 GPU width, which can lead to a faster throughput speed, such as
can only get an efficiency of 20-100 GOPS/W. Googles TPU [58] which can get a peak performance of 86
TOPS. From the business aspect, a large quantity production
To improve the efficiency, we need to customize the inside
of ASIC could also reduce the overall cost. However, note
logic of processing elements (PEs) to enhance processing
that the deep-learning algorithms for RTAV have a quite short
parallelism and optimize memory access patterns. FPGA
evolving cycle, usually within six to nine months. Moreover,
could be a suitable initial selection, since it can provide
the benchmarks for RTAV are also far from perfect and new
a large amount of computing and memory resources and
tasks appear nearly every year. While ASICs time to market
enough reconfigurability with programmable interconnec-
is no less than one year, there is a potential risk of incom-
tion to map common algorithms on. In Fig. 7 we can see
patibility between hardware processors and fresh algorithms
that there have been many FPGA designs. The top designs,
and application scenes. Solution providers need to make a
including our Aristotle system on the Xilinx ZU9 FPGA plat-
risk-return analysis.
form, can get a throughput speed at around 2 TOPS, which
is quite close to the same technology generation NVIDIA
Recently, some breakthroughs have taken place in the area
TITAN-X GPUs, but of almost 10 times better efficiency.
of near-memory and in-memory computing. The 3-D mem-
This proves the capability of FPGA of being a strong com-
ory can offer an order of magnitude higher bandwidth and
petitor.
several times power consumption than 2-D memory, such
As we can see, most CNN layers consist of MAC operations as Hyper Memory Cube (HMC) proposed by Micron [59],
and have similar computing patterns which could be possibly which uses through silicon vias (TSV) to stack the dynamic
generalized and parameterized. Therefore, with mature hard- random-access memory (DRAM) on top of the logic cir-
ware architecture and processing flow, it is feasible to harden cuit. Through this method, the memory bandwidth can be
the original FPGA accelerator design into an ASIC chip with increased by an order of magnitude from 2-D memory, and
a programmable interface for reconfigurability, which can the power consumption can be five times less. There have
further improve performance. Kuon et al. [54] have mea- already been some designs combining the CNN accelerator
sured the performance gap between FPGA and ASIC. It is architecture with HMC [60][61]. Another technology is to
said that the critical-path delay of ASIC is three to four times embed the computation inside memory, such as memristor
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
[62]. It can realize a MAC operation through the summation specialized controllers could be introduced to deal with ir-
of currents from different memristor branches. This avoids regular sparsity inside the models.
the data movement and can save energy. Recent simulation 7) Multi-thread processing. For ADAS systems, it would
works such as ISAAC [63] and PRIME [64] have evaluated be best for different algorithms to be processed simultane-
the efficiency of memristors in CNN acceleration. ously, such as LDW would work on grayscale images while
An ideal ADAS system should be able to offer a comput- PD would process RGB images. Reconfigurable processors
ing speed of over 200 GOPS with no more than 40 W, and can provide vast spatial parallelism for algorithms to work in
hence we can mark the sweet zone for ADAS systems as the individual channels.
red painted area in Fig. 7. Inside this sweet zone, we can However, challenges remain for the wide use of reconfig-
sketch a development route for the reconfigurable processors urable processors such as:
for RTAV acceleration, shown as the dark red curve. Starting
1) Programming language gap: Most developers use high-
from the FPGA design, we can climb up through logic hard-
level programming languages to build their project, while for
ening for an efficiency of above 1 TOPS/W, and with the help
reconfigurable processors they need to start from the bottom-
of the implementation of next generation memory technol-
level hardware and describe the logic with register-transfer
ogy, the bandwidth can be broaden and the memory access
level (RTL) hardware description language (HDL) such as
cost could be reduced, which can lead to an even higher effi-
Verilog and VHDL.
ciency, to more than 10 TOPS/W. We use the yellow star to
indicate our target in Fig. 7. With a larger die size, a through- 2) Limited on-chip resource: There is limited area for on-
put speed of over 100 TOPS could be expected, which can be chip arithmetic and memory resource to map the tiled algo-
a suitable choice for an ideal RTAV system. rithm on spatially. This might form a bottleneck for some
large-scale algorithms.
3) Limited off-chip bandwidth: To communicate recon-
3.2. Chances and challenges for reconfigurable proces- figurable processors with off-chip memories like DDR, the
sors bandwidth is often limited by the clock frequency of the con-
troller and the width of data wires.
In the area of RTAV, chances and challenges coexist for a
wide application of reconfigurable processors. The follow-
ing features of reconfigurable processors will bring them op- 3.3. Related reconfigurable processors
portunities:
1) Programmability. Reconfigurable processors can offer a There have been many excellent reconfigurable processor de-
pool of logic and memory resources on-chip. Considering signs for deep learning models. Initial designs are mostly
the fast evolving RTAV algorithms, it is not hard for users based on FPGAs. Chakaradhar et al. [65] proposed a run-
to update the on-chip functions after they bought it from the time reconfigurable architecture for CNN on FPGA with ded-
supplier. icated switches to deal with different CNN layers. Zhang
et al. [66] used a nested loop model to describe CNN and
2) Reliability. For example, the industrial grade FPGAs
designed the on-chip architecture based on high-level syn-
can stably work in a temperature range between −40◦ C ∼
thesis optimizations. Suda et al. [67] presented an OpenCL-
100◦ C. This makes them able to satisfy the requirement of
based FPGA accelerator with fully-connected layers also im-
standards AEC-Q100 and ISO 26262.
plemented on-chip.
3) Low-power. The power consumption for reconfigurable
ASIC-based reconfigurable processors have appeared in re-
processors is no more than 30 W. Low-power consumption is
cent years. The representative work is Diannao [55] and its
suitable for the in-car environment.
subsequent series [68][69][70], which focused great efforts
4) Low-latency. Since algorithms mapped onto reconfig- on memory system optimization. Eyeriss [56] focused on
urable processors provide deterministic timing, they can of- the dataflow optimization and used smaller PEs to form a
fer a latency of several nanoseconds, which is one order of coarse-grained computing array. ENVISION [57] utilized
magnitude faster than GPUs. A quick reaction of ADAS sys- a dynamic-voltage-accuracy-frequency-scaling (DVAFS)
tems is essential to dealing with sudden changes on the road. method to enhance its efficiency and reached 10 TOPS/W
5) Interfaces. Unlike GPU which can only make commu- with low voltage supply. Googles TPU [58] has been the
nication through the PCI Express protocol, both ASIC and recent star with large on-chip memories and has reached a
FPGA designs can provide huge interface flexibility, which similar throughput speed to peer GPUs withdrawing much
can be very helpful for ADAS system integration. less energy.
6) Customizable logic. Recently there has been great Most of these precedent reconfigurable processors have their
progress in the area of model compression, including data own features with partial optimization of the entire flow, but
quantization and sparsity exploration. For general purpose few consider the entire flow of the neural network acceler-
processors like CPU and GPU, only fixed data types could be ator system. Therefore, the on-chip utilization rate of dif-
supported and the memory access pattern would be regular. ferent CNN layers will eventually fluctuate [58] which may
Reconfigurable processors can offer fine-grained customiz- drag down the overall efficiency of the system, and there has
ability which can support data type as low as to 1 bit, and been a large space left for improvement from the aspect of
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
4. SOFTWARE-HARDWARE CO-DESIGN FOR A RE- Figure 9. Quantization results for different CNN models.
CONFIGURABLE AUTONOMOUS VISION SYSTEM
4.1. The overall system workflow Table 3. Comparison of compression ratio between quanti-
zation, pruning and matrix transformation methods at differ-
What we have already achieved is an FPGA-based system ent accuracy loss levels (baseline 32-bit floating-point).
called Aristotle to target CNN acceleration, which can deal Accuracy Quantization Pruning Quantization
SVD
with various CNN-based applications and can be conve- Loss Only Only and Pruning
niently mapped onto different FPGA platforms. For a better 0% - 5.8x 10.3x 27.0x
processing performance, we should reduce the software 1% 5.4x 14.1x 15.6x 35.7x
workload and improve the hardware utilization rate. Accord- 2% 6.5x 14.9x 19.1x 37.0x
ingly, we design the software hardware co-design workflow 4% 6.9x 15.4x 22.9x 37.7x
of our Aristotle system depicted in Fig. 8. To reduce the
workload, we compress the models using software methods
like quantization, pruning and matrix transformation. To
loss and the loss can be further healed by retraining. Table
improve the utilization rate, the compiler will take the com-
3 has shown that if we combine pruning and quantization to-
pressed model and hardware parameters of different FPGA
gether, the compressed model size would be the smallest with
platforms as inputs, and execute a task tiling with dataflow
negligible accuracy loss. Together with Huffman coding, the
optimizations to generate instructions for the hardware. The
model size of AlexNet can be reduced by 35 times, and that
hardware architecture will exploit the parallelism on-chip
of VGG-16 can be reduced by 49 times. We should notice
for higher throughput with proper granularity choice and
the randomness of sparsity from pruning, which is tough to
datapath reuse. The details will be introduced as follows.
be efficiently used for hardware execution. To deal with this
case, we add some constraints to limit the pruned connec-
4.2. Compression methods tions in regular patterns, and this can increase the number
of all zero channels for more skips during the acceleration
Usually, an algorithm model is trained in floating-point form, process.
but there exists redundancy. Previous work has shown that it
is not necessary to represent every datum with 32-bit, and Moreover, we can see that inside the basic MAC operations
an appropriate data quantization would not hurt the overall of CNN, multiplication is always the most resource consum-
accuracy of the model. In Fig. 9 we have made an experiment ing operation, so reducing the number of multiplications can
of quantization on state-of-the-art CNN models, and as we also enhance the hardware performance. Matrix transforma-
can see from an 8-bit quantization brings little loss to the tion like Winograd [72] and FFT [73] can achieve this goal
accuracy. A lower bit-width can directly compress the size by targeting different sizes of filters. Take Winograd trans-
of memory footprint, and can bring chance to share datapath formation as example, if we tile the input feature maps into
consists of integrated DSP blocks. We can implement two 6 × 6 blocks and convolve it with 3 × 3 filters, through trans-
multipliers for 8-bit inputs with one 25 × 18 DSP block on formation we can reduce the number of multiplications by
Xilinx platform. 2.25 times and replace them with cheap add and shifting op-
erations.
Another method is to implement a pruning process to the pre-
trained model, in order to decrease the number of connec- With all these compression methods above, we can reduce
tions inside a model [71]. It has been proved that some of the the workload of the original model, which will benefit the on-
connections that have weights close to zero will make a small chip memory and arithmetic resources and system through-
impact on the output pixel, and can be pruned without much put speed.
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
Our ASIC-based reconfigurable accelerator Tingtao is al- [1] E. D. Dickmanns and V. Graefe, “Dynamic monocu-
ready on schedule. The PS of Tingtao is an ARM Cortex-A5 lar machine vision,” Machine vision and applications,
processor, and the PL includes two deep-learning processing vol. 1, no. 4, pp. 223–240, 1988.
units (DPUs), each containing 2048 MAC PEs and works
at 500MHz. Some necessary interfaces for RTAV applica- [2] C. Thorpe, M. H. Hebert, T. Kanade, and S. A. Shafer,
tion are also integrated. Tingtao has taken a 28nm CMOS “Vision and navigation for the carnegie-mellon navlab,”
technology and is projected to provide a peak performance IEEE Transactions on Pattern Analysis and Machine
of 4 TOPS at a power of 3 W, which is slightly better than Intelligence, vol. 10, no. 3, pp. 362–373, 1988.
the EyeQ4 product. With the compression method and com-
piling optimization introduced, the performance could get [3] E. D. Dickmanns and B. D. Mysliwetz, “Recursive 3-d
even better. As shown in Fig. 7, Tingtao has filled the sparse road and relative ego-state recognition,” IEEE Trans-
area of 1 to 10 W of power and TOPS level throughput. We actions on pattern analysis and machine intelligence,
are also planning to try a larger design for our next version, vol. 14, no. 2, pp. 199–213, 1992.
and we will pay efforts in the ongoing research of the im-
plementation of emerging memory technology based on our [4] J. Manyika, M. Chui, J. Bughin, R. Dobbs, P. Bisson,
precedent work [64] for the target of our development route. and A. Marrs, Disruptive technologies: Advances that
will transform life, business, and the global economy.
McKinsey Global Institute San Francisco, CA, 2013,
5. CONCLUSION vol. 180.
This article has reviewed the algorithms for RTAV applica- [5] J. Barbaresso, G. Cordahi, D. Garcia, C. Hill,
tions of ADAS, a comparative analysis has been done over A. Jendzejec, and K. Wright, “USDOT’s intelligent
different types of platforms, and an enumeration of chances transportation systems (ITS) ITS strategic plan 2015-
and challenges for reconfigurable RTAV platforms. We have 2019,” Tech. Rep., 2014.
introduced the software-hardware co-design workflow for
our reconfigurable RTAV system, with detailed hardware [6] Cabinet of Japan, “Statement on ”forging the world-
architecture design and implemented compression methods, leading it nation”,” Tech. Rep., 2013.
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
[7] Directive 2010/40/EU of the European Parliament and [20] V. Gaikwad and S. Lokhande, “Lane departure identi-
of the council, “Directives on the framework for the de- fication for advanced driver assistance,” IEEE Trans-
ployment of intelligent transport systems in the field of actions on Intelligent Transportation Systems, vol. 16,
road transport and for interfaces with other modes of no. 2, pp. 910–918, 2015.
transport,” Tech. Rep., 2010.
[21] A. Broggi, M. Bertozzi, A. Fascioli, and M. Sechi,
[8] European Comission. Directorate-General for Mobility “Shape-based pedestrian detection,” in Intelligent Ve-
and Transport, White Paper on Transport: Roadmap to hicles Symposium, 2000. IV 2000. Proceedings of the
a Single European Transport Area: Towards a Compet- IEEE. IEEE, 2000, pp. 215–220.
itive and Resource-efficient Transport System. Publi-
cations Office of the European Union, 2011. [22] J. R. Uijlings, K. E. Van De Sande, T. Gevers, and
A. W. Smeulders, “Selective search for object recog-
[9] European Comission, “Preliminary descriptions of re- nition,” International journal of computer vision, vol.
search and innovation areas and fields, research and 104, no. 2, pp. 154–171, 2013.
innovation for europe’s future mobility,” Tech. Rep.,
[23] D. G. Lowe, “Distinctive image features from scale-
2012.
invariant keypoints,” International journal of computer
[10] J. Janai, F. Güney, A. Behl, and A. Geiger, “Computer vision, vol. 60, no. 2, pp. 91–110, 2004.
vision for autonomous vehicles: Problems, datasets [24] N. Dalal and B. Triggs, “Histograms of oriented gradi-
and state-of-the-art,” arXiv preprint arXiv:1704.05519, ents for human detection,” in Computer Vision and Pat-
2017. tern Recognition, 2005. CVPR 2005. IEEE Computer
Society Conference on, vol. 1. IEEE, 2005, pp. 886–
[11] Intel, “Intel atom processor e3900 series.”
893.
[Online]. Available: https://www.qualcomm.com/
solutions/automotive/drive-data-platform [25] P. Viola and M. Jones, “Rapid object detection using a
boosted cascade of simple features,” in Computer Vi-
[12] Qualcomm, “Drive data platform.” [Online].
sion and Pattern Recognition, 2001. CVPR 2001. Pro-
Available: https://www.qualcomm.com/solutions/
ceedings of the 2001 IEEE Computer Society Confer-
automotive/drive-data-platform
ence on, vol. 1. IEEE, 2001, pp. I–I.
[13] N. Corp., “NVIDIA drive PX - the AI car computer [26] Y. Freund and R. E. Schapire, “A desicion-theoretic
for autonomous driving,” 2017. [Online]. Available: generalization of on-line learning and an application
http://www.nvidia.com/object/drive-px.html to boosting,” in European conference on computational
learning theory. Springer, 1995, pp. 23–37.
[14] NVIDIA CUDA, “NVIDIA CUDA C programming
guide,” Nvidia Corporation, vol. 120, no. 18, p. 8, [27] C. Cortes and V. Vapnik, “Support vector machine,”
2011. Machine learning, vol. 20, no. 3, pp. 273–297, 1995.
[15] S. Chetlur, C. Woolley, P. Vandermersch, J. Cohen, [28] P. Felzenszwalb, D. McAllester, and D. Ramanan, “A
J. Tran, B. Catanzaro, and E. Shelhamer, “cuDNN: discriminatively trained, multiscale, deformable part
Efficient primitives for deep learning,” arXiv preprint model,” in Computer Vision and Pattern Recognition,
arXiv:1410.0759, 2014. 2008. CVPR 2008. IEEE Conference on. IEEE, 2008,
pp. 1–8.
[16] Xilinx, “Xilinx automotive Zynq-7000.” [Online].
Available: https://www.xilinx.com/publications/prod\ [29] A. Krizhevsky, I. Sutskever, and G. E. Hinton, “Ima-
mktg/ZynqAuto\ ProdBrf.pdf genet classification with deep convolutional neural net-
works,” in Advances in neural information processing
[17] Altera, “A safety methodology for ADAS systems, 2012, pp. 1097–1105.
designs in FPGAs.” [Online]. Avail-
able: https://www.altera.com/en\ US/pdfs/literature/ [30] J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and
wp/wp-01204-automotive-functional-safety.pdf L. Fei-Fei, “Imagenet: A large-scale hierarchical image
database,” in Computer Vision and Pattern Recognition,
[18] Mobileye, “The evolution of EyeQ,” 2017. [Online]. 2009. CVPR 2009. IEEE Conference on. IEEE, 2009,
Available: https://www.mobileye.com/our-technology/ pp. 248–255.
evolution-eyeq-chip/
[31] C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed,
[19] J. Son, H. Yoo, S. Kim, and K. Sohn, “Real-time illumi- D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabi-
nation invariant lane detection for lane departure warn- novich, “Going deeper with convolutions,” in Proceed-
ing system,” Expert Systems with Applications, vol. 42, ings of the IEEE conference on computer vision and
no. 4, pp. 1816–1824, 2015. pattern recognition, 2015, pp. 1–9.
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
[32] S. Ioffe and C. Szegedy, “Batch normalization: Accel- [44] M. Everingham, L. Van Gool, C. K. Williams, J. Winn,
erating deep network training by reducing internal co- and A. Zisserman, “The pascal visual object classes
variate shift,” in International Conference on Machine (VOC) challenge,” International journal of computer
Learning, 2015, pp. 448–456. vision, vol. 88, no. 2, pp. 303–338, 2010.
[33] C. Szegedy, V. Vanhoucke, S. Ioffe, J. Shlens, and [45] A. Geiger, P. Lenz, and R. Urtasun, “Are we ready for
Z. Wojna, “Rethinking the inception architecture for autonomous driving? the kitti vision benchmark suite,”
computer vision,” in Proceedings of the IEEE Con- in Computer Vision and Pattern Recognition (CVPR),
ference on Computer Vision and Pattern Recognition, 2012 IEEE Conference on. IEEE, 2012, pp. 3354–
2016, pp. 2818–2826. 3361.
[34] C. Szegedy, S. Ioffe, V. Vanhoucke, and A. A. Alemi, [46] Z. Cai, Q. Fan, R. S. Feris, and N. Vasconcelos, “A
“Inception-v4, inception-resnet and the impact of resid- unified multi-scale deep convolutional neural network
ual connections on learning.” in AAAI, 2017, pp. 4278– for fast object detection,” in European Conference on
4284. Computer Vision. Springer, 2016, pp. 354–370.
[35] K. Simonyan and A. Zisserman, “Very deep convo- [47] Y. Xiang, W. Choi, Y. Lin, and S. Savarese,
lutional networks for large-scale image recognition,” “Subcategory-aware convolutional neural networks for
arXiv preprint arXiv:1409.1556, 2014. object proposals and detection,” in Applications of
Computer Vision (WACV), 2017 IEEE Winter Confer-
[36] K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual ence on. IEEE, 2017, pp. 924–933.
learning for image recognition,” in Proceedings of the
IEEE conference on computer vision and pattern recog- [48] F. Yang, W. Choi, and Y. Lin, “Exploit all the layers:
nition, 2016, pp. 770–778. Fast and accurate cnn object detector with scale depen-
dent pooling and cascaded rejection classifiers,” in Pro-
[37] O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, ceedings of the IEEE Conference on Computer Vision
S. Ma, Z. Huang, A. Karpathy, A. Khosla, M. Bernstein and Pattern Recognition, 2016, pp. 2129–2137.
et al., “Imagenet large scale visual recognition chal-
[49] X. Chen, K. Kundu, Y. Zhu, A. G. Berneshawi, H. Ma,
lenge,” International Journal of Computer Vision, vol.
S. Fidler, and R. Urtasun, “3d object proposals for ac-
115, no. 3, pp. 211–252, 2015.
curate object class detection,” in Advances in Neural
[38] A. Sharif Razavian, H. Azizpour, J. Sullivan, and Information Processing Systems, 2015, pp. 424–432.
S. Carlsson, “CNN features off-the-shelf: an astound-
[50] X. Chen, K. Kundu, Z. Zhang, H. Ma, S. Fidler, and
ing baseline for recognition,” in Proceedings of the
R. Urtasun, “Monocular 3d object detection for au-
IEEE conference on computer vision and pattern recog-
tonomous driving,” in Proceedings of the IEEE Con-
nition workshops, 2014, pp. 806–813.
ference on Computer Vision and Pattern Recognition,
[39] R. Girshick, J. Donahue, T. Darrell, and J. Malik, “Rich 2016, pp. 2147–2156.
feature hierarchies for accurate object detection and se- [51] NICS Lab of Tsinghua University, “Neural
mantic segmentation,” in Proceedings of the IEEE con- network accelerator inference,” 2017. [Online].
ference on computer vision and pattern recognition, Available: https://nicsefc.ee.tsinghua.edu.cn/projects/
2014, pp. 580–587. neural-network-accelerator/
[40] K. He, X. Zhang, S. Ren, and J. Sun, “Spatial pyra- [52] NVIDIA, “NVIDIA Tesla V100,” 2017. [Online].
mid pooling in deep convolutional networks for visual Available: https://www.nvidia.com/en-us/data-center/
recognition,” in European Conference on Computer Vi- tesla-v100/
sion. Springer, 2014, pp. 346–361.
[53] ——, “NVIDIA Jetson - the embedded plat-
[41] R. Girshick, “Fast R-CNN,” in Proceedings of the IEEE form for autonomous everything,” 2017. [Online].
international conference on computer vision, 2015, pp. Available: http://www.nvidia.com/object/embedded-
1440–1448. systems-dev-kits-modules.html
[42] S. Ren, K. He, R. Girshick, and J. Sun, “Faster R-CNN: [54] I. Kuon and J. Rose, “Measuring the gap between fp-
Towards real-time object detection with region proposal gas and asics,” IEEE Transactions on computer-aided
networks,” in Advances in neural information process- design of integrated circuits and systems, vol. 26, no. 2,
ing systems, 2015, pp. 91–99. pp. 203–215, 2007.
[43] J. Redmon, S. Divvala, R. Girshick, and A. Farhadi, [55] T. Chen, Z. Du, N. Sun, J. Wang, C. Wu,
“You only look once: Unified, real-time object detec- Y. Chen, and O. Temam, “Diannao: A small-footprint
tion,” in Proceedings of the IEEE Conference on Com- high-throughput accelerator for ubiquitous machine-
puter Vision and Pattern Recognition, 2016, pp. 779– learning,” in ACM Sigplan Notices, vol. 49, no. 4.
788. ACM, 2014, pp. 269–284.
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
[56] Y.-H. Chen, T. Krishna, J. S. Emer, and V. Sze, “Eye- [66] C. Zhang, P. Li, G. Sun, Y. Guan, B. Xiao, and J. Cong,
riss: An energy-efficient reconfigurable accelerator for “Optimizing fpga-based accelerator design for deep
deep convolutional neural networks,” IEEE Journal of convolutional neural networks,” in Proceedings of the
Solid-State Circuits, vol. 52, no. 1, pp. 127–138, 2017. 2015 ACM/SIGDA International Symposium on Field-
Programmable Gate Arrays. ACM, 2015, pp. 161–
[57] B. Moons, R. Uytterhoeven, W. Dehaene, and M. Ver- 170.
helst, “Envision: A 0.26-to-10 tops/w subword-
parallel dynamic-voltage-accuracy-frequency-scalable [67] N. Suda, V. Chandra, G. Dasika, A. Mohanty, Y. Ma,
convolutional neural network processor in 28nm fdsoi,” S. Vrudhula, J.-s. Seo, and Y. Cao, “Throughput-
in IEEE International Solid-State Circuits Conference optimized OpenCL-based FPGA accelerator for large-
(ISSCC), 2017, pp. 246–257. scale convolutional neural networks,” in Proceedings
of the 2016 ACM/SIGDA International Symposium on
[58] N. P. Jouppi, C. Young, N. Patil, D. Patterson, Field-Programmable Gate Arrays. ACM, 2016, pp.
G. Agrawal, R. Bajwa, S. Bates, S. Bhatia, N. Bo- 16–25.
den, A. Borchers et al., “In-datacenter performance
analysis of a tensor processing unit,” arXiv preprint [68] Y. Chen, T. Luo, S. Liu, S. Zhang, L. He, J. Wang,
arXiv:1704.04760, 2017. L. Li, T. Chen, Z. Xu, N. Sun et al., “Dadiannao:
A machine-learning supercomputer,” in Proceedings of
[59] J. Jeddeloh and B. Keeth, “Hybrid memory cube new
the 47th Annual IEEE/ACM International Symposium
dram architecture increases density and performance,”
on Microarchitecture. IEEE Computer Society, 2014,
in VLSI Technology (VLSIT), 2012 Symposium on.
pp. 609–622.
IEEE, 2012, pp. 87–88.
[69] Z. Du, R. Fasthuber, T. Chen, P. Ienne, L. Li, T. Luo,
[60] M. Gao, J. Pu, X. Yang, M. Horowitz, and
X. Feng, Y. Chen, and O. Temam, “Shidiannao: Shift-
C. Kozyrakis, “Tetris: Scalable and efficient neural net-
ing vision processing closer to the sensor,” in ACM
work acceleration with 3d memory,” in Proceedings of
SIGARCH Computer Architecture News, vol. 43, no. 3.
the Twenty-Second International Conference on Archi-
ACM, 2015, pp. 92–104.
tectural Support for Programming Languages and Op-
erating Systems. ACM, 2017, pp. 751–764.
[70] D. Liu, T. Chen, S. Liu, J. Zhou, S. Zhou, O. Teman,
[61] D. Kim, J. Kung, S. Chai, S. Yalamanchili, and X. Feng, X. Zhou, and Y. Chen, “Pudiannao: A polyva-
S. Mukhopadhyay, “Neurocube: A programmable lent machine learning accelerator,” in ACM SIGARCH
digital neuromorphic architecture with high-density Computer Architecture News, vol. 43, no. 1. ACM,
3d memory,” in Computer Architecture (ISCA), 2016 2015, pp. 369–381.
ACM/IEEE 43rd Annual International Symposium on.
[71] S. Han, H. Mao, and W. J. Dally, “Deep compres-
IEEE, 2016, pp. 380–392.
sion: Compressing deep neural networks with prun-
[62] L. Chua, “Memristor-the missing circuit element,” ing, trained quantization and huffman coding,” arXiv
IEEE Transactions on circuit theory, vol. 18, no. 5, pp. preprint arXiv:1510.00149, 2015.
507–519, 1971.
[72] A. Lavin and S. Gray, “Fast algorithms for convolu-
[63] A. Shafiee, A. Nag, N. Muralimanohar, R. Balasub- tional neural networks,” in Proceedings of the IEEE
ramonian, J. P. Strachan, M. Hu, R. S. Williams, and Conference on Computer Vision and Pattern Recogni-
V. Srikumar, “Isaac: A convolutional neural network tion, 2016, pp. 4013–4021.
accelerator with in-situ analog arithmetic in crossbars,”
in Proceedings of the 43rd International Symposium on [73] M. Mathieu, M. Henaff, and Y. LeCun, “Fast training
Computer Architecture. IEEE Press, 2016, pp. 14–26. of convolutional networks through ffts,” arXiv preprint
arXiv:1312.5851, 2013.
[64] P. Chi, S. Li, C. Xu, T. Zhang, J. Zhao, Y. Liu, Y. Wang,
and Y. Xie, “Prime: A novel processing-in-memory [74] J. Qiu, J. Wang, S. Yao, K. Guo, B. Li, E. Zhou, J. Yu,
architecture for neural network computation in reram- T. Tang, N. Xu, S. Song et al., “Going deeper with
based main memory,” in Proceedings of the 43rd Inter- embedded fpga platform for convolutional neural net-
national Symposium on Computer Architecture. IEEE work,” in Proceedings of the 2016 ACM/SIGDA Inter-
Press, 2016, pp. 27–39. national Symposium on Field-Programmable Gate Ar-
rays. ACM, 2016, pp. 26–35.
[65] S. Chakradhar, M. Sankaradas, V. Jakkula, and
S. Cadambi, “A dynamically configurable coprocessor [75] W. Liu, D. Anguelov, D. Erhan, C. Szegedy, S. Reed,
for convolutional neural networks,” in ACM SIGARCH C.-Y. Fu, and A. C. Berg, “Ssd: Single shot multibox
Computer Architecture News, vol. 38, no. 3. ACM, detector,” in European conference on computer vision.
2010, pp. 247–257. Springer, 2016, pp. 21–37.
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
[76] L. Huang, Y. Yang, Y. Deng, and Y. Yu, “Densebox: [89] L. Song, X. Qian, H. Li, and Y. Chen, “Pipelayer: A
Unifying landmark localization with end to end object pipelined reram-based accelerator for deep learning,”
detection,” arXiv preprint arXiv:1509.04874, 2015. in High Performance Computer Architecture (HPCA),
2017 IEEE International Symposium on. IEEE, 2017,
[77] J. Schmidhuber and S. Hochreiter, “Long short-term pp. 541–552.
memory,” Neural computation, vol. 9, no. 8, pp. 1735–
1780, 1997.
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
SDWWHUQV DQG HFRORJLFDO UHVSRQVH WR PLWLJDWH WKH LQFRUSRUDWHV VHYHUDO HOHPHQWV RI OHDUQLQJ
KXPDQDFWLYLW\LQGXFHGVWUHVVHV>@*LYHQWKHODFN DGDSWDWLRQHYROXWLRQDQGIX]]\ORJLFWRLQWHOOLJHQWO\
RI HYLGHQFH FRPSOH[ HQYLURQPHQWDO VLPXODWLRQ DQDO\]H GDWD DQG FUHDWH LQWHOOLJHQW PDFKLQHV WR
PRGHOVZLWKGHWDLOHGFKDUDFWHUL]DWLRQDUHPRUHOLNHO\ H[WUDFW DQG UHSUHVHQW LQIRUPDWLRQ LQ D PHDQLQJIXO
WR OHDG WR PRUH XQFHUWDLQW\ >@ 7KH RQO\ ZD\ WR ZD\>@
DSSURDFK WKLV SUREOHP LV WR FROOHFW LQIRUPDWLRQ RQ ,QWKLVDUWLFOHZHSUHVHQWRXUSUHYLRXVH[SHULHQFHV
WKHWURSLFDOPDULQHHQYLURQPHQWDVVLVWLQJWRGHYHORS LQLPSOHPHQWLQJUHDOWLPH:61,R7IRUPRQLWRULQJ
PRUH UREXVW PRGHOV ZLWK HYLGHQFH +RZHYHU WKH WKH *%5 7KH DUWLFOH IRFXVHV RQ LPSOHPHQWDWLRQ
FKDOOHQJH KHUH LV WR FROOHFW GDWD DW WKH DSSURSULDWH FKDOOHQJHVDQGKRZ$,ZDVXVHGWRGHWHFWLQWHUHVWLQJ
VSDWLDO DQG WHPSRUDO VFDOHV >@ 7KH VHQVLWLYH HYHQWVIURPWKHGHSOR\HG:61&ODXVHGHVFULEHV
HQYLURQPHQWDO G\QDPLFV RQ WKH *%5 QHFHVVLWDWHV WKHPHDVXUHVWDNHQWRPRQLWRUDQGXQGHUVWDQG*%5
UHDOWLPH PRQLWRULQJ DV D ZD\ RI PDQDJLQJ DQG ,W DOVR SURYLGHV WKH FKDOOHQJHV IDFHG LQ GHSOR\LQJ
XQGHUVWDQGLQJDQWKURSRJHQLFVWUHVVHVHIIHFWLYHO\ :61RQWKH*%5&ODXVHSURYLGHVWKHSURSRVHG
,QWHUQHW RI 7KLQJV ,R7ZLUHOHVV VHQVRU QHWZRUNV QHWZRUN DUFKLWHFWXUH XVHG LQ PRQLWRULQJ WKH *%5
:61V HQDEOH UHDOWLPH UHPRWH VHQVLQJ DW ILQH XVLQJ :61 &ODXVH SURYLGHV D FDVH VWXG\ RI
VSDWLDODQGWHPSRUDOVFDOHVRIODUJHDUHDVVXFKDVWKH GHWHFWLQJ&\FORQH+DPLVKWKDWSDVVHGWKURXJKWKH
*%5 >@ :61V FRQVLVW RI D QHWZRUN RI VHQVRU *%5 GXULQJ 0DUFK XVLQJ D VXLWH RI $,
QRGHV GHSOR\HG DW PXOWLSOH VWDWLVWLFDOO\ LPSRUWDQW DOJRULWKPV DQG VRPH RI WKH RSHQ FKDOOHQJHV LQ
ORFDWLRQV 6HQVRU QRGHV DUH HTXLSSHG ZLWK UHOHYDQW V\VWHP RI V\VWHPV 6R6 LQWHJUDWLRQ ZLWK $, 7KH
VHQVLQJ HOHPHQWV GDWD SURFHVVRU XQLWV WUDQVFHLYHU FRQFOXVLRQRIWKLVDUWLFOHLVSURYLGHGLQFODXVH
ZLWK DQWHQQDV SRZHU V\VWHPV DQG SURWHFWLYH
KRXVLQJV >@ 7KH QHWZRUN RI VHQVRU QRGHV LV 2. THE GREAT BARRIER REEF
IRUPHGE\GLUHFWLQJWKHQRGHVWRFRPPXQLFDWHZLWK MONITORING
VSHFLILF QRGHV LQ WKH QHWZRUN 6HQVRU QHWZRUNV
SURPLVHWRDOORZGDWDFROOHFWLRQDWDKLJKHUVDPSOLQJ 7KH*%5LVWKHODUJHVWOLYLQJVWUXFWXUHWKDWVWUHWFKHV
IUHTXHQF\ LQFOXGLQJ ILQHU VSDWLDO DQG WHPSRUDO RYHUNLORPHWHUV,WLQFOXGHVW\SHVRIFRUDO
VFDOHVZKLOHDEOHWRNHHSWKHFRVWWRDPLQLPXPDQG RYHUMHOO\ILVKVSHFLHVPRUHWKDQYDULHWLHV
SURYLGH UHDOWLPH DFFHVV WR D UDQJH RI SDUDPHWHUV RIPROOXVFVNLQGVRIILVKW\SHVRIVKDUNV
>@ ,Q DGGLWLRQ YLVXDOL]DWLRQ RI VHQVRU GDWD RQ D DQGUD\VDQGRYHUGLIIHUHQWW\SHVRIZKDOHVDQG
ZHESRUWDOLQUHDOWLPHZLWKPRGHOLQJDQGVLPXODWLRQ GROSKLQV ,W LV DOVR XQLTXH DV WKH *%5 H[WHQGV
UHVXOWV KDYH FOHDUO\ FKDQJHG WKH DSSURDFKHV WR GHJUHHVRIODWLWXGHLQFOXGLQJFRQWLQHQWDOLVODQGV
PRQLWRULQJWKH*%5 DQGDERXWLQODQGPDQJURYHLVODQGV>@
$UWLILFLDO LQWHOOLJHQFH $, SOD\V D FULWLFDO UROH LQ 7KH *UHDW %DUULHU 5HHI 2FHDQ 2EVHUYLQJ 6\VWHP
DQDO\]LQJUHDOWLPHVWUHDPLQJVHQVRUGDWDIURPVXFK *%52263URMHFWZKLFKLVSDUWRIWKH$XVWUDOLDQ
ODUJHVFDOHHQYLURQPHQWV*LYHQWKHYROXPHRIGDWD ,QWHJUDWHG 0DULQH 2EVHUYLQJ 6\VWHP ,026 KDV
UHFHLYHGIURPWKHVHQVRUQRGHVWKHGDWDQHHGVWREH EHHQVXSSRUWHGE\DVSHFLDO1DWLRQDO&ROODERUDWLYH
PRGHOHGWRPDNHDPHDQLQJIXOVHQVHRIWKHGDWD7R 5HVHDUFK ,QIUDVWUXFWXUH 6WUDWHJ\ 1&5,6 JUDQW
H[WUDFWXVHIXOLQIRUPDWLRQIURPWKHPDULQHV\VWHP IURP WKH $XVWUDOLDQ *RYHUQPHQW *%5226 LV DQ
:61V,R7 QHHG DSSURSULDWH QHWZRUN DUFKLWHFWXUH REVHUYDWLRQV\VWHPWKDWORRNVWRUHFRUGWKHLPSDFWRI
SURWRFROV FRPPXQLFDWLRQ ZLWK $,EDVHG DQDO\WLFV WKH&RUDO6HDRQWKH*%56SHFLILFDOO\*%5226
KHOSLQJ WR LQIRUP HQG XVHUV >@ 'HVLJQLQJ VXFK DLPVWRSURYLGHWKHREVHUYDWLRQDOGDWDWRXQGHUVWDQG
QHWZRUNVUHTXLUHVFDWHJRUL]LQJVHQVRUQHWZRUNVLQWR WKHORQJWHUPFKDQJHDQGLPSDFWRQWKH*%57KH
GLIIHUHQW FRPPXQLFDWLRQ PRGHOV GDWD GHOLYHU\ *%5226KDVILYHFRPSRQHQWVRIPRQLWRULQJ>@
PRGHOV DQG QHWZRUN G\QDPLF PRGHOV +RZHYHU
WHFKQLFDOFKDOOHQJHVLQLPSOHPHQWLQJVXFKQHWZRUNV QLQH ORQJWHUP PRRULQJV WHPSHUDWXUH DQG
LQFOXGH QHWZRUN GLVFRYHU\ FRQWURO DQG URXWLQJ VDOLQLW\SURILOHVZDYHVDQGFXUUHQWV
FROODERUDWLYH VLJQDO DQG LQIRUPDWLRQ SURFHVVLQJ WZR UHIHUHQFH PRRULQJV EDVLF
WDVNLQJ DQG TXHU\LQJ DQG VHFXULW\ 7KH UROH RI $, RFHDQRJUDSKLFSDUDPHWHUV
DQGGDWDDQDO\WLFVLVYLWDOLQVXFKVLWXDWLRQV$,
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
3. CLOUD-CENTRIC NETWORK LQFOXGHV WKH RSHQLQJ DQG FORVLQJ RI VHVVLRQV 7KH
ARCHITECTURE FOR REAL-TIME SUHVHQWDWLRQ OD\HU PDQDJHV FRQWH[WV EHWZHHQ
MONITORING DSSOLFDWLRQV E\ KDQGOLQJ IRUPDW FRQYHUVLRQV
HQFU\SWLRQGHFU\SWLRQLQGHSHQGHQWRIDSSOLFDWLRQ±
ZHEFRQWHQWLVDQH[DPSOH7KHDSSOLFDWLRQOD\HULV
WKH WRSPRVW OD\HU DQG LV XVHG E\ WKH HQG XVHUV ,W
SURYLGHV VHUYLFHV WR HQGXVHU DSSOLFDWLRQV WKURXJK
DSSURSULDWHQHWZRUNLQJSURWRFROVVXFKDV+\SHUWH[W
7UDQVIHU 3URWRFRO +773 DQG +\SHUWH[W 7UDQVIHU
3URWRFRO 6HFXUH +7736 :HE EURZVHU LV DQ
H[DPSOH RI DSSOLFDWLRQ OD\HU WKDW XVHV +773 RU
+7736 QHWZRUNLQJ SURWRFRO IRU D ZLGH YDULHW\ RI
VHUYLFHV
3.2. Data framework
)LJ3URSRVHG,R7:61DUFKLWHFWXUHIRUUHDO 7KH GDWD IUDPHZRUN SURYLGHV D PRGHO RI WKH GDWD
WLPHPRQLWRULQJPDQDJLQJDQGXQGHUVWDQGLQJRI IORZ IURP SK\VLFDO VHQVLQJ WR GDWD WUDQVPLVVLRQ
HQYLURQPHQW DPRQJ VHQVRU QRGHV URXWLQJ WKURXJK GLIIHUHQW
QHWZRUNVGHOLYHU\ZLWKDSSURSULDWHHQFDSVXODWLRQV
)LJXUHVKRZVWKHSURSRVHGFORXGFHQWULFQHWZRUN LQWHUSUHWDWLRQ DQG YLVXDOL]DWLRQ EDVHG RQ FORXG
DUFKLWHFWXUH IRU UHDOWLPH VHQVLQJ PRQLWRULQJ DQG FRPSXWLQJ DQG DQDO\WLFV 6HQVRUV DWWDFKHG WR WKH
GHFLVLRQPDNLQJ 7KH GDWD IUDPHZRUN LQ )LJ QRGHVPHDVXUHSK\VLFDOSKHQRPHQDDQGSURFHVVLQJ
LOOXVWUDWHV KRZ GDWD LV FRQYHUWHG ZKHQ WUDQVIHUULQJ ERDUGV DUH SURJUDPPHG WR VDPSOH DW VSHFLILF
IURP ORZHU OD\HUV RI WKH QHWZRUN DUFKLWHFWXUH WR VDPSOLQJUDWHV6HQVRUQRGHVDUHVSDWLDOO\GLVWULEXWHG
OD\HUV DERYH 7KH GDWD IURP WKH HQGXVHU EDVHG RQ WKH SURMHFW SODQ FRVW DSSOLFDWLRQ DQG
DSSOLFDWLRQVDUHPDQDJHGWKURXJKDFORXGSODWIRUP VFLHQWLILFREMHFWLYHV7KHGDWDIURPWKHVHQVRUVDUH
7KH SODWIRUP FRQWDLQV FRPSXWLQJ KDUGZDUH DQG VWRUHGWHPSRUDULO\RQERDUGWKHQRGHVEHIRUHWKH\
VRIWZDUH GDWD VWRUDJH FDSDFLW\ DQG $, DQDO\WLFV WR DUHWUDQVPLWWHGWRJDWHZD\QRGHV7KHGDWDOLQNOD\HU
VHUYLFHHQGXVHUVRQDUHDOWLPHEDVLV KDQGOHV GDWD WUDQVPLVVLRQ E\ VHQVLQJ WKH SK\VLFDO
PHGLXP DQG FKDQQHO DYDLODELOLW\ 2QFH WKH GDWD LV
3.1. Networking framework WUDQVIHUUHGIURPQRGHVWRJDWHZD\VWKHGDWDZLOOEH
7KH QHWZRUNLQJ IUDPHZRUN VKRZV WKH QHWZRUNLQJ GLUHFWHG WR KLJKOHYHO QRGHV VXFK DV WKH FORXG
SURWRFROVIURP SK\VLFDO OD\HU XSWRWKH DSSOLFDWLRQ VHUYHUV*DWHZD\VDUHSURJUDPPHGWRGLUHFWWKHGDWD
OD\HU 7KH OD\HUV DUH FRQFHSWXDOO\ VLPLODU WR WKH IURP VHQVRU QRGHV WR FORXG GDWDEDVHV WKURXJK ,3
2SHQ 6\VWHPV ,QWHUFRQQHFWLRQ 26, PRGHO 7KH DGGUHVVHV 7KH QHWZRUN OD\HU PDQDJHV WKH ,3
OD\HUVHQVXUHWKDWWKHFRQWUROLVSDVVHGIURPWKHOD\HU DGGUHVVHVDQGGDWDURXWLQJ7KHGHOLYHU\RIGDWDWRD
EHORZWRWKHOD\HUDERYH7KHSK\VLFDOOD\HUDOORZV SDUWLFXODUGDWDEDVHLVHQVXUHGE\WKHWUDQVSRUWOD\HU
SK\VLFDOWUDQVPLVVLRQRIGDWDELWVZKHUHDVWKHGDWD &ORXG VHUYHUV PDQDJH WKH VWRUDJH RI UHFHLYHG GDWD
OLQN OD\HU DOORZV WUDQVIHU RI GDWD IURP RQH VHQVRU IURPVHQVRUQRGHVDQGDOVRKDYHKLJKFRPSXWDWLRQ
QRGH WR DQRWKHU7KHQHWZRUN OD\HU GHWHUPLQHV WKH FRPSDUHG WR VHQVRU QRGHV 7KH GDWD LV PDGH
SDWKRQWKHQHWZRUNWRWKHFRUUHFWSK\VLFDOQRGHE\ DYDLODEOHWRHQGXVHUVWKURXJKDSSOLFDWLRQVIURPWKH
PDQDJLQJ ,QWHUQHW 3URWRFRO ,3 DGGUHVVHV 7KH FORXG VHUYHUV 6HUYHUV DOVR PDQDJH DSSOLFDWLRQ
WUDQVSRUWOD\HUPDQDJHVHQGWRHQGFRQQHFWLRQVDQG VHVVLRQV DPRQJ GLIIHUHQW KRVWV DV ZHOO DV DOORZ
UHOLDELOLW\ RI QHWZRUN 7KLV LV DFKLHYHG E\ PXOWLSOH VHVVLRQV IRU WKH VDPH DSSOLFDWLRQ IURP
WUDQVIHUULQJ GDWD DFURVV QHWZRUN FRQQHFWLRQV PXOWLSOHXVHUV
7UDQVIHU&RQWURO3URWRFRO7&3LVDQH[DPSOHRID
WUDQVIHUOD\HUSURWRFRO
)LJXUHDOVRVKRZVWKDWWKHGDWDOLQNOD\HUQHWZRUN
OD\HUDQGWUDQVSRUWOD\HUVWRJHWKHUDUHUHVSRQVLEOHIRU
FRQWUROOLQJ WKH TXDOLW\ RI VHUYLFH 4R6 GHPDQGV
UHTXHVWHGE\WKHXVHUVDVZHOODVIRUSULRULWL]LQJGDWD
IRU UHDOWLPH DSSOLFDWLRQV VXFK DV YLGHR >@ 7KH
VHVVLRQ OD\HU PDQDJHV GLIIHUHQW W\SHV RI
FRPPXQLFDWLRQV EHWZHHQ KRVWV 7KLV RSHUDWLRQ
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
>@&DPHURQ +XGGOHVWRQH+ROPHV *LOOHV *LJDQ >@&KULV 7RZQVHQG DQG 6WHYHQ $UPV ³:LUHOHVV
*UDKDP :RRGV $GDP 5X[WRQ ,DQ $WNLQVRQ VHQVRUQHWZRUNV3ULQFLSOHVDQGDSSOLFDWLRQV´LQ
DQG 6WXDUW .LQLQPRQWK ³,QIUDVWUXFWXUH IRU D 6HQVRU 7HFKQRORJ\ +DQGERRN -RQ 6 :LOVRQ
VHQVRU QHWZRUN RQ GDYLHV UHHI JUHDW EDUULHU (GFKDSWHUSS±1HZQHV
UHHI´ LQ UG ,QWHUQDWLRQDO &RQIHUHQFH RQ
,QWHOOLJHQW 6HQVRUV 6HQVRU 1HWZRUNV DQG >@-HVXV 3HUH] 9LFWRU =DUDWH DQG &KULVWLDQ
,QIRUPDWLRQ,(((SS± &DEUHUD ³$ QHWZRUN DQG GDWD OLQN OD\HU TRV
PRGHO WR LPSURYH WUDIILF SHUIRUPDQFH´
>@2PSUDNDVK *QDZDOL .L<RXQJ -DQJ (PHUJLQJ 'LUHFWLRQV LQ (PEHGGHG DQG
-HRQJ\HXS 3DHN 0DUFRV 9LHLUD 5DPHVK 8ELTXLWRXV&RPSXWLQJSS±
*RYLQGDQ %HQ *UHHQVWHLQ $XJXVW -RNL
'HERUDK (VWULQ DQG (GGLH .RKOHU ³7KH WHQHW >@6FRWW %DLQEULGJH 'DPLHQ (JJHOLQJ DQG *HRII
DUFKLWHFWXUH IRU WLHUHG VHQVRU QHWZRUNV´ LQ 3DJH ³/HVVRQV IURP WKH ILHOGWZR \HDUV RI
3URFHHGLQJVRIWKHWKLQWHUQDWLRQDOFRQIHUHQFH GHSOR\LQJRSHUDWLRQDOZLUHOHVVVHQVRUQHWZRUNV
RQ(PEHGGHGQHWZRUNHGVHQVRUV\VWHPV$&0 RQWKHJUHDWEDUULHUUHHI´6HQVRUVYROQR
SS± SS±
>@3HWHU'HVQR\HUV'HHSDN*DQHVDQDQG3UDVKDQW >@6XWKDUVKDQ 5DMDVHJDUDU -DPHV & %H]GHN
6KHQR\ ³7VDU D WZR WLHU VHQVRU VWRUDJH &KULVWRSKHU /HFNLH DQG 0DULPXWKX
DUFKLWHFWXUH XVLQJ LQWHUYDO VNLS JUDSKV´ LQ 3DODQLVZDPL ³(OOLSWLFDO DQRPDOLHV LQ ZLUHOHVV
3URFHHGLQJVRIWKHUGLQWHUQDWLRQDOFRQIHUHQFH VHQVRUQHWZRUNV´$&07UDQVDFWLRQVRQ6HQVRU
RQ(PEHGGHGQHWZRUNHGVHQVRUV\VWHPV$&0 1HWZRUNV7261YROQRSS
SS±
>@0DVXG 0RVKWDJKL 6XWKDUVKDQ 5DMDVHJDUDU
>@3XUXVKRWWDP .XONDUQL 'HHSDN *DQHVDQ &KULVWRSKHU/HFNLHDQG6KDQLND.DUXQDVHNHUD
3UDVKDQW 6KHQR\ DQG 4LIHQJ /X ³6HQVH\H D ³$QRPDO\ GHWHFWLRQ E\ FOXVWHULQJ HOOLSVRLGV LQ
PXOWLWLHU FDPHUD VHQVRU QHWZRUN´ LQ ZLUHOHVV VHQVRU QHWZRUNV´ LQ ,QWHOOLJHQW
3URFHHGLQJV RI WKH WK DQQXDO $&0 6HQVRUV 6HQVRU 1HWZRUNV DQG ,QIRUPDWLRQ
LQWHUQDWLRQDO FRQIHUHQFH RQ 0XOWLPHGLD $&0 3URFHVVLQJ ,661,3 WK ,QWHUQDWLRQDO
SS± &RQIHUHQFHRQ,(((SS±
>@-XQVXN 6KLQ 5DMQLVK .XPDU 'XVKPDQWD >@7LPRWK\ & +DYHQV DQG -DPHV & %H]GHN ³$Q
0RKDSDWUD 8PDNLVKRUH 5DPDFKDQGUDQ DQG HIILFLHQW IRUPXODWLRQ RI WKH LPSURYHG YLVXDO
0RVWDID $PPDU ³$VDS $ FDPHUD VHQVRU DVVHVVPHQWRIFOXVWHUWHQGHQF\LYDWDOJRULWKP´
QHWZRUN IRU VLWXDWLRQ DZDUHQHVV´ 3ULQFLSOHV RI ,((( 7UDQVDFWLRQV RQ .QRZOHGJH DQG 'DWD
'LVWULEXWHG6\VWHPVSS± (QJLQHHULQJYROQRSS±
>@3KRHEXV&KHQ3DUYH]$KDPPDG&ROE\%R\HU >@*DUWQHU ,QF ³*DUWQHU VD\V ELOOLRQ
6KLK, +XDQJ /HRQ /LQ (GJDU /REDWRQ 0DUFL FRQQHFWHG´WKLQJV´ZLOOEHLQXVHLQXS
0HLQJDVW 6RQJKZDL 2K 6LPRQ :DQJ 3RVX SHU FHQW IURP ´ KWWSZZZJDUWQHUFRP
<DQ HW DO ³&LWULF $ ORZEDQGZLGWK ZLUHOHVV QHZVURRPLG>2QOLQH@
FDPHUDQHWZRUNSODWIRUP´LQ'LVWULEXWHGVPDUW
FDPHUDV ,&'6& 6HFRQG
$&0,((( LQWHUQDWLRQDO FRQIHUHQFH RQ ,(((
SS±
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
;8*XLEDR08<XER/,8-LDOLDQJ
,QVWLWXWHRI7HFKQRORJ\DQG6WDQGDUGV5HVHDUFK&KLQD$FDGHP\RI,QIRUPDWLRQDQG&RPPXQLFDWLRQ
7HFKQRORJ\%HLMLQJ&KLQD35
Abstract – AI with learning abilities is a revolutionary technology which the communication industry is exploring,
with the aim of introducing it into communication networks and to provide new services, and to improve network
efficiency and user experience. At this time there is no total solution or complete framework to do so. One
contender in the steps towards a solution is a FINE framework, which can be illustrated by the example of an
SDN/NFV collaboratively- deployed network.
.H\ZRUGV±$UWLILFLDOLQWHOOLJHQFHFRPPXQLFDWLRQQHWZRUNQHWZRUNIXQFWLRQVYLUWXDOL]DWLRQ1)9VRIWZDUH
GHILQHGQHWZRUN6'1
1. INTRODUCTION 2.1. Characterized requirements
,QUHFHQW\HDUVZLWKWKHGHYHORSPHQWDQGPDWXUDWLRQ :LWKDQLQFUHDVLQJQXPEHURIXVHUVDQGWKHJURZLQJ
RI VXFK WHFKQRORJLHV DV FORXG FRPSXWLQJ ELJ GDWD VL]H RI WKH FRPPXQLFDWLRQ QHWZRUN GLIIHUHQFHV RI
DQG GHHS OHDUQLQJ WKHLQGXVWULDOL]DWLRQ RI DUWLILFLDO SUHIHUHQFHV KDELWV DQG WKH LQIRUPDWLRQ QHHGV RI
LQWHOOLJHQFH $, KDV EHHQ GHYHORSHG DFFRUGLQJO\ HQWHUSULVHV DQG LQGLYLGXDO XVHUV DUH JUDGXDOO\
6LQFH$OSKD*RZRQWKH*RPDWFKDJDLQVW/HH6H H[SRVHG 7KH GHPDQG IRUVSHFLDOL]HG EXVLQHVVHVLV
GRO LQ $, KDV DWWUDFWHG PRUH DQG PRUH EHFRPLQJ VWURQJHU ZLWK FXVWRPL]HG QHWZRUNV DQG
DWWHQWLRQ$,WHFKQRORJ\KDVEHHQLQWURGXFHGLQWRD VHUYLFHVQRZEHLQJSURYLGHGIRUHQWHUSULVHXVHUV,Q
QXPEHU RI DUHDV $V D UHYROXWLRQDU\ IRUFH $, KDV WKHIXWXUHWKHUHZLOOEHDVSHFLDOVHUYLFHSDFNDJHIRU
EHHQ PDNLQJ JUHDW SURJUHVV DQG UHDOL]HG PDQ\ HDFKXVHUDQGHYHQDVSHFLDOQHWZRUN6XFKFRPSOH[
DFKLHYHPHQWVLQWKHVHDUHDV UHTXLUHPHQWV ZRXOG EH XQLPDJLQDEOH ZLWKRXW DQ
&RPPXQLFDWLRQV LV D VHFWRU ZLWK KHDY\ ,&7 XVH LQWHOOHFWXDOWRRO
GHDOLQJ ZLWK D YDULHW\ RI FRQVXPHU GHPDQGV RQ
LQGLYLGXDOL]DWLRQUHTXLUHPHQWVPXOWLPHGLDVHUYLFHV 2.2. Multimedia services
DQGSUHFLVLRQPDQDJHPHQWZKLFKKDVPDGHQHWZRUN
VHFXULW\ EHFRPH PRUH DQG PRUH LPSRUWDQW :LWK :LWK WKH DUULYDO RI WKH :HE HUD ,QWHUQHW XVHUV
$,¶V DGYDQWDJHV LQ OHDUQLQJ XQGHUVWDQGLQJ KDYH EHFRPH LQIRUPDWLRQ SURGXFHUV DV ZHOO DV
UHDVRQLQJ DQG FRRSHUDWLQJ JUDGXDOO\ EHLQJ LQIRUPDWLRQFRQVXPHUVDQGDUHSURGXFLQJPRUHDQG
GLVFRYHUHG VRIWZDUHGHILQHG QHWZRUNV 6'1 DQG PRUH LQIRUPDWLRQ LQ PXOWLPHGLD 8VHUJHQHUDWHG
QHWZRUN IXQFWLRQV YLUWXDOL]DWLRQ 1)9 KDYH FRQWHQWLQFUHDVHV,QWHUQHWWUDIILFDWDQXQEHOLHYDEOH
DSSHDUHGWHFKQRORJLHVRIGHHSSDFNHWLQVSHFWLRQDQG VSHHG8QGHUWKHVHFLUFXPVWDQFHVERWKVWRUDJHDQG
VHUYLFHDZDUHQHWZRUNVDUHDOPRVWLQPDWXULW\DQG WUDQVPLVVLRQDUHDJUHDWFKDOOHQJH7KHLQFOXVLRQRI
WKH LQWHOOHFWXDOL]DWLRQ RI FRPPXQLFDWLRQ QHWZRUNV $,EROVWHUVRXUDELOLWLHVWRKDQGOHWKLVFKDOOHQJH
DQG VHUYLFHV DUH EHFRPLQJ SRVVLEOH )XUWKHUPRUH
RSHUDWRUV KDYH D NHHQ LQWHUHVW LQ $, ZKLFK PD\ 2.3. Precision management
GHFUHDVH FDSLWDO H[SHQGLWXUH &$3(; DQG
RSHUDWLQJH[SHQVH23(; 7KHXVHRIVPDUWSKRQHVPDNHVLWLQHYLWDEOHWKDWWKH
YDULRXV GLPHQVLRQV DQG JUDQXODULWLHV LQ WRGD\
V
2. TRENDS IN COMMUNICATION ZLUHOHVVWUDIILFPRGHOVVKRXOGEHFRQVLGHUHGLQWKH
NETWORKS AND SERVICES QHWZRUNV
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
(;3/$,1$%/($57,),&,$/,17(//,*(1&(81'(567$1',1*
9,68$/,=,1*$1',17(535(7,1*'((3/($51,1*02'(/6
:RMFLHFK6DPHN7KRPDV:LHJDQG.ODXV5REHUW0OOHU
'HSWRI9LGHR&RGLQJ $QDO\WLFV)UDXQKRIHU+HLQULFK+HUW],QVWLWXWH%HUOLQ*HUPDQ\
'HSWRI(OHFWULFDO(QJLQHHULQJ &RPSXWHU6FLHQFH7HFKQLVFKH8QLYHUVLWlW%HUOLQ%HUOLQ*HUPDQ\
'HSWRI%UDLQ &RJQLWLYH(QJLQHHULQJ.RUHD8QLYHUVLW\6HRXO6RXWK.RUHD
0D[3ODQFN,QVWLWXWHIRU,QIRUPDWLFV6DDUEUFNHQ*HUPDQ\
$EVWUDFW±:LWKWKHDYDLODELOLW\RIODUJHGDWDEDVHVDQGUHFHQWLPSURYHPHQWVLQGHHSOHDUQLQJPHWKRGRORJ\WKH
SHUIRUPDQFHRI$,V\VWHPVLVUHDFKLQJRUHYHQH[FHHGLQJWKHKXPDQOHYHORQDQLQFUHDVLQJQXPEHURIFRPSOH[
WDVNV,PSUHVVLYHH[DPSOHVRIWKLVGHYHORSPHQWFDQEHIRXQGLQGRPDLQVVXFKDVLPDJHFODVVLILFDWLRQVHQWLPHQW
DQDO\VLV VSHHFK XQGHUVWDQGLQJ RU VWUDWHJLF JDPH SOD\LQJ +RZHYHU EHFDXVH RI WKHLU QHVWHG QRQOLQHDU
VWUXFWXUH WKHVH KLJKO\ VXFFHVVIXO PDFKLQH OHDUQLQJ DQG DUWLILFLDO LQWHOOLJHQFH PRGHOV DUH XVXDOO\ DSSOLHG LQ D
EODFNER[ PDQQHU LH QR LQIRUPDWLRQ LV SURYLGHG DERXW ZKDW H[DFWO\ PDNHV WKHP DUULYH DW WKHLU SUHGLFWLRQV
6LQFH WKLV ODFN RI WUDQVSDUHQF\ FDQ EH D PDMRU GUDZEDFN HJ LQ PHGLFDO DSSOLFDWLRQV WKH GHYHORSPHQW RI
PHWKRGV IRU YLVXDOL]LQJ H[SODLQLQJ DQG LQWHUSUHWLQJ GHHS OHDUQLQJ PRGHOV KDV UHFHQWO\ DWWUDFWHG LQFUHDVLQJ
DWWHQWLRQ7KLVSDSHUVXPPDUL]HVUHFHQWGHYHORSPHQWVLQWKLVILHOGDQGPDNHVDSOHDIRUPRUHLQWHUSUHWDELOLW\LQ
DUWLILFLDO LQWHOOLJHQFH )XUWKHUPRUH LW SUHVHQWV WZR DSSURDFKHV WR H[SODLQLQJ SUHGLFWLRQV RI GHHS OHDUQLQJ
PRGHOVRQHPHWKRGZKLFKFRPSXWHVWKHVHQVLWLYLW\RIWKHSUHGLFWLRQZLWKUHVSHFWWRFKDQJHVLQWKHLQSXWDQGRQH
DSSURDFK ZKLFK PHDQLQJIXOO\ GHFRPSRVHV WKH GHFLVLRQ LQ WHUPV RI WKH LQSXW YDULDEOHV 7KHVH PHWKRGV DUH
HYDOXDWHGRQWKUHHFODVVLILFDWLRQWDVNV
.H\ZRUGV±$UWLILFLDOLQWHOOLJHQFHEODFNER[PRGHOVGHHSQHXUDOQHWZRUNVLQWHUSUHWDELOLW\OD\HUZLVHUHOHYDQFH
SURSDJDWLRQVHQVLWLYLW\DQDO\VLV
1. INTRODUCTION SRNHU>@7KHVHLPPHQVHVXFFHVVHVRI$,V\VWHPV
HVSHFLDOO\ GHHS OHDUQLQJ PRGHOV VKRZ WKH
7KH ILHOG RI PDFKLQH OHDUQLQJ DQG DUWLILFLDO UHYROXWLRQDU\ FKDUDFWHU RI WKLV WHFKQRORJ\ ZKLFK
LQWHOOLJHQFH KDV SURJUHVVHG RYHU WKH ODVW IHZ ZLOOKDYHDODUJHLPSDFWEH\RQGWKHDFDGHPLFZRUOG
GHFDGHV $ GULYLQJ IRUFH IRU WKLV GHYHORSPHQW ZDV DQG ZLOO DOVR JLYH ULVH WR GLVUXSWLYH FKDQJHV LQ
WKH HDUOLHU LPSURYHPHQWV LQ VXSSRUW YHFWRU LQGXVWULHVDQGVRFLHWLHV
PDFKLQHV DQG PRUH UHFHQW LPSURYHPHQWV LQ GHHS +RZHYHU DOWKRXJK WKHVH PRGHOV UHDFK LPSUHVVLYH
OHDUQLQJPHWKRGRORJ\ >@ $OVR WKH DYDLODELOLW\ RI SUHGLFWLRQ DFFXUDFLHV WKHLU QHVWHG QRQOLQHDU
ODUJH GDWDEDVHV VXFK DV ,PDJH1HW >@ RU 6SRUWV0 VWUXFWXUH PDNHV WKHP KLJKO\ QRQWUDQVSDUHQW LH LW
>@ WKH VSHHGXS JDLQV REWDLQHG ZLWK SRZHUIXO LVQRWFOHDUZKDWLQIRUPDWLRQLQWKHLQSXWGDWDPDNHV
*38 FDUGV DQG WKH KLJK IOH[LELOLW\ RI VRIWZDUH WKHP DFWXDOO\ DUULYH DW WKHLU GHFLVLRQV 7KHUHIRUH
IUDPHZRUNV VXFK DV &DIIH >@ RU 7HQVRU)ORZ >@ WKHVHPRGHOVDUHW\SLFDOO\UHJDUGHGDVEODFNER[HV
ZHUH FUXFLDO IDFWRUV LQ WKH VXFFHVV 7RGD\¶V 7KH WK PRYH LQ WKH VHFRQG JDPH RI WKH KLVWRULF
PDFKLQH OHDUQLQJ EDVHG $, V\VWHPV H[FHO LQ D *RPDWFKEHWZHHQ/HH6HGRODWRS*RSOD\HUDQG
QXPEHURIFRPSOH[WDVNVUDQJLQJIURPWKHGHWHFWLRQ $OSKD*R DQ DUWLILFLDO LQWHOOLJHQFH V\VWHP EXLOW E\
RI REMHFWV LQ LPDJHV >@ DQG WKH XQGHUVWDQGLQJ RI 'HHS0LQG GHPRQVWUDWHV WKH QRQWUDQVSDUHQF\ RI
QDWXUDO ODQJXDJHV >@ WR WKH SURFHVVLQJ RI VSHHFK WKH $, V\VWHP $OSKD*R SOD\HG D PRYH ZKLFK ZDV
VLJQDOV>@2QWRSRIWKLVUHFHQW$,V\VWHPVFDQ WRWDOO\XQH[SHFWHGDQGZKLFKZDVFRPPHQWHGRQE\
HYHQRXWSOD\SURIHVVLRQDOKXPDQSOD\HUVLQGLIILFXOW D*RH[SHUWLQWKHIROORZLQJZD\
VWUDWHJLFJDPHVVXFKDV*R>@DQG7H[DVKROG¶HP
7KHWHUPVDUWLILFLDOLQWHOOLJHQFHDQGPDFKLQHOHDUQLQJDUHXVHG
7KLV ZRUN ZDV VXSSRUWHG E\ WKH *HUPDQ 0LQLVWU\ IRU
(GXFDWLRQ DQG 5HVHDUFK DV %HUOLQ %LJ 'DWD &HQWHU %%'& V\QRQ\PRXVO\
6$ :H WKDQN *UpJRUH 0RQWDYRQ IRU KLV YDOXDEOH
FRPPHQWVRQWKHSDSHU
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
)LJ([SODLQLQJSUHGLFWLRQVRIDQ$,V\VWHP7KHLQSXWLPDJHLVFRUUHFWO\FODVVLILHGDV³URRVWHU´,QRUGHUWRXQGHUVWDQG
ZK\WKHV\VWHPKDVDUULYHGDWWKLVGHFLVLRQH[SODQDWLRQPHWKRGVVXFKDV6$RU/53DUHDSSOLHG7KHUHVXOWRIWKLV
H[SODQDWLRQLVDQLPDJHWKHKHDWPDSZKLFKYLVXDOL]HVWKHLPSRUWDQFHRIHDFKSL[HOIRUWKHSUHGLFWLRQ,QWKLVH[DPSOHWKH
URRVWHU¶VUHGFRPEDQGZDWWOHDUHWKHEDVLVIRUWKH$,V\VWHP¶VGHFLVLRQ:LWKWKHKHDWPDSRQHFDQYHULI\WKDWWKH$,
V\VWHPZRUNVDVLQWHQGHG
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
(;3(5,0(17$/(9$/8$7,21 7H[WGRFXPHQWFODVVLILFDWLRQ
KWWSTZRQHFRPaMDVRQ1HZVJURXSV
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
)LJ&VKRZV/53KHDWPDSVRYHUODLGRQWRILYH IUDPHV 2QH FDQ VHH WKDW WKH UHOHYDQFH VFRUHV DUH
H[HPSODUIUDPHVRIDYLGHRVDPSOH7KHYLGHRZDV ODUJHUIRUIUDPHVLQZKLFKWKHSHUVRQLVSHUIRUPLQJ
FRUUHFWO\ FODVVLILHG DV VKRZLQJ WKH DFWLRQ ³VLWXS´ DQXSZDUGVDQGGRZQZDUGVPRYHPHQW7KXV/53
2QH FDQ VHH WKDW WKH PRGHO PDLQO\ IRFXVHV RQ WKH KHDWPDSVQRWRQO\YLVXDOL]HWKHUHOHYDQWORFDWLRQVRI
EORFNV VXUURXQGLQJ WKH XSSHU ERG\ RI WKH SHUVRQ WKH DFWLRQ ZLWKLQ D YLGHR IUDPH LH ZKHUH WKH
7KLV PDNHV SHUIHFW VHQVH DV WKLV SDUW RI WKH YLGHR UHOHYDQWDFWLRQKDSSHQVEXWWKH\DOVRLGHQWLI\WKH
IUDPHVKRZVPRWLRQZKLFKLVLQGLFDWLYHRIWKHDFWLRQ PRVW UHOHYDQW WLPH SRLQWV ZLWKLQ D YLGHR VHTXHQFH
³VLWXS´QDPHO\XSZDUGDQGGRZQZDUGPRYHPHQWV LHZKHQWKHUHOHYDQWDFWLRQKDSSHQV
RIWKHERG\ 0RUHGLVFXVVLRQRQWKLVH[SHULPHQWFDQEHIRXQGLQ
7KH FXUYH DW WKH ERWWRP RI )LJ & GLVSOD\V WKH >@
GLVWULEXWLRQ RI UHOHYDQFH RYHU IRXU FRQVHFXWLYH
)LJ([SODLQLQJSUHGLFWLRQVRI$,V\VWHPV$VKRZVWKHDSSOLFDWLRQRIH[SODLQDEOHPHWKRGVWRLPDJHFODVVLILFDWLRQ7KH
6$KHDWPDSVDUHQRLV\DQGGLIILFXOWWRLQWHUSUHWZKHUHDV/53KHDWPDSVPDWFKKXPDQLQWXLWLRQ%VKRZVWKHDSSOLFDWLRQ
RIH[SODLQDEOHPHWKRGVWRWH[WGRFXPHQWFODVVLILFDWLRQ7KH6$DQG/53KHDWPDSVLGHQWLI\ZRUGVVXFKDV³GLVFRPIRUW´
³ERG\´DQG³VLFNQHVV´DVWKHUHOHYDQWRQHVIRUH[SODLQLQJWKHSUHGLFWLRQ³VFLPHG´,QFRQWUDVWWRVHQVLWLYLW\DQDO\VLV/53
GLVWLQJXLVKHVEHWZHHQSRVLWLYHUHGDQGQHJDWLYHEOXHUHOHYDQFHV&VKRZVH[SODQDWLRQVIRUDKXPDQDFWLRQUHFRJQLWLRQ
FODVVLILHUEDVHGRQPRWLRQYHFWRUIHDWXUHV7KH/53KHDWPDSVRIDYLGHRZKLFKZDVFODVVLILHGDV³VLWXS´VKRZLQFUHDVHG
UHOHYDQFHRQIUDPHVLQZKLFKWKHSHUVRQLVSHUIRUPLQJDQXSZDUGVDQGGRZQZDUGVPRYHPHQW
&21&/86,21 KRZWRDVVLJQUHVSRQVLELOLW\LQFDVHRIV\VWHPIDLOXUH
6LQFHWKH³ULJKWWRH[SODQDWLRQ´KDVEHFRPHSDUWRI
7KLVSDSHUDSSURDFKHGWKHSUREOHPRIH[SODLQDELOLW\ (XURSHDQ ODZ LW FDQ EH H[SHFWHG WKDW LW ZLOO DOVR
LQDUWLILFLDOLQWHOOLJHQFH,WZDVGLVFXVVHGZK\EODFN JUHDWO\IRVWHUH[SODLQDELOLW\LQ$,V\VWHPV
ER[ PRGHOV DUH QRW DFFHSWDEOH IRU FHUWDLQ %HVLGHV EHLQJ D JDWHZD\ EHWZHHQ $, DQG VRFLHW\
DSSOLFDWLRQV HJ LQ WKH PHGLFDO GRPDLQ ZKHUH H[SODLQDELOLW\ LV DOVR D SRZHUIXO WRRO IRU GHWHFWLQJ
ZURQJGHFLVLRQVRIWKHV\VWHPFDQEHYHU\KDUPIXO IODZV LQ WKH PRGHO DQG ELDVHV LQ WKH GDWD IRU
)XUWKHUPRUH H[SODLQDELOLW\ ZDV SUHVHQWHG DV D YHULI\LQJ SUHGLFWLRQV IRU LPSURYLQJ PRGHOV DQG
SUHUHTXLVLWH IRU VROYLQJ OHJDO TXHVWLRQV ZKLFK DUH ILQDOO\IRUJDLQLQJQHZLQVLJKWVLQWRWKHSUREOHPDW
DULVLQJZLWKWKHLQFUHDVHGXVDJHRI$,V\VWHPVHJ KDQGHJLQWKHVFLHQFHV
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
>@ / $UUDV ) +RUQ * 0RQWDYRQ .5 0OOHU >@ )'RVKL9HOH]DQG%.LP7RZDUGVDULJRURXV
DQG : 6DPHN ([SODLQLQJ SUHGLFWLRQV RI QRQ VFLHQFH RI LQWHUSUHWDEOH PDFKLQH OHDUQLQJ DU;LY
OLQHDUFODVVLILHUVLQQOS,Q3URFHHGLQJVRIWKHVW SUHSULQWDU;LY
:RUNVKRSRQ5HSUHVHQWDWLRQ/HDUQLQJIRU1/3
SDJHV±$&/ >@ '(UKDQ<%HQJLR$&RXUYLOOHDQG39LQFHQW
9LVXDOL]LQJ KLJKHUOD\HU IHDWXUHV RI D GHHS
>@ / $UUDV ) +RUQ * 0RQWDYRQ .5 0OOHU QHWZRUN 7HFKQLFDO 5HSRUW 8QLYHUVLW\ RI
DQG : 6DPHN ´:KDW LV UHOHYDQW LQ D WH[W 0RQWUHDO
GRFXPHQW"´ $Q LQWHUSUHWDEOH PDFKLQH OHDUQLQJ
DSSURDFK3/R621(H >@ % *RRGPDQ DQG 6 )OD[PDQ (XURSHDQ XQLRQ
UHJXODWLRQV RQ DOJRULWKPLF GHFLVLRQPDNLQJ DQG
>@ / $UUDV * 0RQWDYRQ .5 0OOHU DQG : D ´ULJKW WR H[SODQDWLRQ´ DU;LY SUHSULQW
6DPHN ([SODLQLQJ UHFXUUHQW QHXUDO QHWZRUN DU;LY
SUHGLFWLRQVLQVHQWLPHQWDQDO\VLV,Q3URFHHGLQJV
RIWKH(01/3¶:RUNVKRSRQ&RPSXWDWLRQDO >@ . +H ; =KDQJ 6 5HQ DQG - 6XQ 'HHS
$SSURDFKHV WR 6XEMHFWLYLW\ 6HQWLPHQW 6RFLDO UHVLGXDO OHDUQLQJ IRU LPDJH UHFRJQLWLRQ ,Q
0HGLD$QDO\VLV:$66$SDJHV± 3URFHHGLQJV RI WKH ,((( &RQIHUHQFH RQ
&RPSXWHU 9LVLRQ DQG 3DWWHUQ 5HFRJQLWLRQ
>@ 6%DFK$%LQGHU*0RQWDYRQ).ODXVFKHQ &935SDJHV±
.5 0OOHU DQG : 6DPHN 2Q SL[HOZLVH
H[SODQDWLRQVIRUQRQOLQHDUFODVVLILHUGHFLVLRQVE\ >@ <-LD(6KHOKDPHU-'RQDKXH6.DUD\HY-
OD\HUZLVH UHOHYDQFH SURSDJDWLRQ 3/R6 21( /RQJ5*LUVKLFN6*XDGDUUDPDDQG7'DUUHOO
H &DIIH&RQYROXWLRQDODUFKLWHFWXUHIRUIDVWIHDWXUH
HPEHGGLQJ ,Q 3URFHHGLQJV RI WKH QG $&0
>@ ' %DHKUHQV 7 6FKURHWHU 6 +DUPHOLQJ 0 LQWHUQDWLRQDO FRQIHUHQFH RQ 0XOWLPHGLD SDJHV
.DZDQDEH.+DQVHQDQG.50OOHU+RZWR ±
H[SODLQ LQGLYLGXDO FODVVLILFDWLRQ GHFLVLRQV
-RXUQDORI0DFKLQH/HDUQLQJ5HVHDUFK± >@ 9 .DQWRURY DQG , /DSWHY (IILFLHQW IHDWXUH
H[WUDFWLRQHQFRGLQJDQGFODVVLILFDWLRQIRUDFWLRQ
UHFRJQLWLRQ ,Q 3URFHHGLQJV RI WKH ,(((
>@ 5&DUXDQD</RX-*HKUNH3.RFK06WXUP &RQIHUHQFH RQ &RPSXWHU 9LVLRQ DQG 3DWWHUQ
DQG 1 (OKDGDG ,QWHOOLJLEOH PRGHOV IRU 5HFRJQLWLRQ&935SDJHV±
KHDOWKFDUH 3UHGLFWLQJ SQHXPRQLD ULVN DQG
KRVSLWDO GD\ UHDGPLVVLRQ ,Q 3URFHHGLQJV RI
WKHWK$&06,*.'',QWHUQDWLRQDO&RQIHUHQFH
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
>@ $.DUSDWK\*7RGHULFL66KHWW\7/HXQJ5 >@ * 0RQWDYRQ : 6DPHN DQG .5 0OOHU
6XNWKDQNDU DQG / )HL)HL /DUJHVFDOH YLGHR 0HWKRGVIRULQWHUSUHWLQJDQGXQGHUVWDQGLQJGHHS
FODVVLILFDWLRQZLWKFRQYROXWLRQDOQHXUDOQHWZRUNV QHXUDO QHWZRUNV DU;LY SUHSULQW
,Q 3URFHHGLQJV RI WKH ,((( FRQIHUHQFH RQ DU;LY
&RPSXWHU 9LVLRQ DQG 3DWWHUQ 5HFRJQLWLRQ
&935SDJHV± >@ 00RUDYþtN06FKPLG1%XUFK9/LV\'
0RUULOO 1%DUGHWDO 'HHSVWDFN ([SHUWOHYHO
>@ +.XHKQH+-KXDQJ(*DUURWH73RJJLRDQG DUWLILFLDOLQWHOOLJHQFHLQKHDGVXSQROLPLWSRNHU
7 6HUUH+PGEDODUJHYLGHRGDWDEDVHIRUKXPDQ 6FLHQFH±
PRWLRQ UHFRJQLWLRQ ,Q 3URFHHGLQJV RI WKH ,(((
,QWHUQDWLRQDO &RQIHUHQFH RQ &RPSXWHU 9LVLRQ >@ $ 1JX\HQ - <RVLQVNL DQG - &OXQH
,&&9SDJHV±,((( 0XOWLIDFHWHG IHDWXUH YLVXDOL]DWLRQ 8QFRYHULQJ
WKH GLIIHUHQW W\SHV RI IHDWXUHV OHDUQHG E\ HDFK
>@ : /DQGHFNHU 0 ' 7KRPXUH / 0 $ QHXURQ LQ GHHS QHXUDO QHWZRUNV DU;LY SUHSULQW
%HWWHQFRXUW00LWFKHOO*7.HQ\RQDQG63 DU;LY
%UXPE\,QWHUSUHWLQJLQGLYLGXDOFODVVLILFDWLRQVRI
KLHUDUFKLFDOQHWZRUNV,Q3URFHHGLQJVRIWKH,((( >@ 0 7 5LEHLUR 6 6LQJK DQG & *XHVWULQ :K\
6\PSRVLXP RQ &RPSXWDWLRQDO ,QWHOOLJHQFH DQG VKRXOGLWUXVW\RX"([SODLQLQJWKHSUHGLFWLRQVRI
'DWD0LQLQJ&,'0SDJHV± DQ\ FODVVLILHU ,Q 3URFHHGLQJV RI WKH $&0
6,*.'' ,QWHUQDWLRQDO &RQIHUHQFH RQ
>@ 6 /DSXVFKNLQ $ %LQGHU * 0RQWDYRQ .5 .QRZOHGJH 'LVFRYHU\ DQG 'DWD 0LQLQJ SDJHV
0OOHU DQG : 6DPHN $QDO\]LQJ FODVVLILHUV ±$&0
)LVKHU YHFWRUV DQG GHHS QHXUDO QHWZRUNV ,Q
3URFHHGLQJV RI WKH ,((( &RQIHUHQFH RQ >@ : 6DPHN $ %LQGHU * 0RQWDYRQ 6
&RPSXWHU 9LVLRQ DQG 3DWWHUQ 5HFRJQLWLRQ /DSXVFKNLQ DQG .5 0OOHU (YDOXDWLQJ WKH
&935SDJHV± YLVXDOL]DWLRQ RIZKDWD GHHSQHXUDOQHWZRUN KDV
OHDUQHG,(((7UDQVDFWLRQVRQ1HXUDO1HWZRUNV
>@ 6 /DSXVFKNLQ $ %LQGHU * 0RQWDYRQ .5 DQG/HDUQLQJ6\VWHPVLQSUHVV
0OOHUDQG:6DPHN7KHOD\HUZLVHUHOHYDQFH
SURSDJDWLRQWRROER[IRUDUWLILFLDOQHXUDOQHWZRUNV >@ . 7 6FKWW ) $UEDE]DGDK 6 &KPLHOD . 5
-RXUQDO RI 0DFKLQH /HDUQLQJ 5HVHDUFK 0OOHU DQG $ 7NDWFKHQNR 4XDQWXPFKHPLFDO
± LQVLJKWVIURPGHHSWHQVRUQHXUDOQHWZRUNV1DWXUH
FRPPXQLFDWLRQV
>@ < $ /H&XQ / %RWWRX * % 2UU DQG .5
0OOHU (IILFLHQW EDFNSURS ,Q 1HXUDO QHWZRUNV >@ $6KULNXPDU3*UHHQVLGH$6KFKHUELQDDQG
7ULFNVRIWKHWUDGHSDJHV±6SULQJHU $ .XQGDMH 1RW MXVW D EODFN ER[ /HDUQLQJ
LPSRUWDQWIHDWXUHVWKURXJKSURSDJDWLQJDFWLYDWLRQ
>@ =&/LSWRQ7KHP\WKRVRIPRGHOLQWHUSUHWDELOLW\ GLIIHUHQFHV DU;LY SUHSULQW DU;LY
DU;LYSUHSULQWDU;LY
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
>@ , 6WXUP 6 /DSXVFKNLQ : 6DPHN DQG .5 >@ 0 ' =HLOHU DQG 5 )HUJXV 9LVXDOL]LQJ DQG
0OOHU ,QWHUSUHWDEOH GHHS QHXUDO QHWZRUNV IRU XQGHUVWDQGLQJ FRQYROXWLRQDO QHWZRUNV ,Q
VLQJOHWULDO HHJ FODVVLILFDWLRQ -RXUQDO RI (XURSHDQ&RQIHUHQFH&RPSXWHU9LVLRQ(&&9
1HXURVFLHQFH0HWKRGV± SDJHV±
>@ &6]HJHG\:/LX<-LD36HUPDQHW65HHG >@ / 0 =LQWJUDI 7 6 &RKHQ 7 $GHO DQG 0
' $QJXHORY ' (UKDQ 9 9DQKRXFNH DQG $ :HOOLQJ 9LVXDOL]LQJ GHHS QHXUDO QHWZRUN
5DELQRYLFK*RLQJGHHSHUZLWK FRQYROXWLRQV ,Q GHFLVLRQV 3UHGLFWLRQ GLIIHUHQFH DQDO\VLV DU;LY
3URFHHGLQJV RI WKH ,((( &RQIHUHQFH RQ SUHSULQWDU;LY
&RPSXWHU 9LVLRQ DQG 3DWWHUQ 5HFRJQLWLRQ
&935SDJHV±
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
)LJ$SSOLFDWLRQVRQPDFKLQHOHDUQLQJLQGLIIHUHQWDUHDVRIFRPPXQLFDWLRQV
SHUIRUPDQFH DQG LW LV D ZHOOVWXGLHG WRSLF LQ +HUHPDFKLQHOHDUQLQJPHWKRGVUHFRJQL]HVWDWLVWLFDO
FRPPXQLFDWLRQV 0DFKLQH OHDUQLQJ PHWKRGV KDYH SDWWHUQV LQ WKH WUDIILF GDWD E\ DQDO\]LQJ
EHHQ XVHG WR WDFNOH GLIIHUHQW W\SHV RI URXWLQJ SDFNHWKHDGHU DQG IORZOHYHO LQIRUPDWLRQ $Q
SUREOHPVLQWKHSDVWLQFOXGLQJVKRUWHVWSDWKURXWLQJ H[FHOOHQW UHYLHZ RI WUDIILF FODVVLILFDWLRQ ZLWK
DGDSWLYH URXWLQJ DQG PXOWLFDVWLQJ URXWLQJ 7KH PDFKLQHOHDUQLQJPHWKRGVLV>@
DXWKRUV RI >@ SURSRVHG DQ DOJRULWKP IRU SDFNDJH
URXWLQJLQG\QDPLFDOO\FKDQJLQJQHWZRUNVEDVHGRQ 2.2. Wireless communications
UHLQIRUFHPHQW OHDUQLQJ 7KLV DOJRULWKP OHDUQV D
URXWLQJ SROLF\ ZKLFK EDODQFHV EHWZHHQ WKH URXWH 7RDFKLHYHDKLJKHIILFLHQF\DWWKHGHVLUHG4R6LWLV
OHQJWK DQG WKH SRVVLELOLW\ RI FRQJHVWLRQ DORQJ WKH HVVHQWLDO LQ ZLUHOHVVV\VWHPV WR FRQWLQXRXVO\ DGDSW
SRSXODU URXWHV ([WHQVLRQV RQ WKLV LGHD KDYH EHHQ GLIIHUHQW SDUDPHWHUV RI 0,022)'0 V\VWHPV LQ
SURSRVHGLQ>@2WKHUUHVHDUFKHUVDSSURDFKHGWKH SDUWLFXODUWKHOLQNSDUDPHWHUVWRWKHYDULDWLRQVLQWKH
URXWLQJSUREOHPZLWKJHQHWLFDOJRULWKPV>@+HUH FRPPXQLFDWLRQ HQYLURQPHQW 9DULRXV ZRUN HJ
DOWHUQDWLYH URXWHV DUH FUHDWHG E\ FURVVRYHU DQG >@WDFNOHWKLVSDUDPHWHUVHOHFWLRQSUREOHPXVLQJ
PXWDWLRQRIWKHH[LVWLQJURXWHV*HQHWLFDOJRULWKPV PDFKLQHOHDUQLQJ'XHWRWKHG\QDPLFQDWXUHRIWKH
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
PXOWLPHGLD FRPPXQLFDWLRQ V\VWHP $ VXUYH\ RQ KLJKVSHFWUDO HIILFLHQF\ DQG WKH XWLOL]DWLRQ RI
LPDJH FRPSUHVVLRQ PHWKRGV ZLWK QHXUDO QHWZRUNV H[WUHPHO\ KLJK IUHTXHQFLHV DERYH *+] PDNHV
FDQ EH IRXQG LQ >@ 7UDFNLQJ LV DQRWKHU WKHVH DVVXPSWLRQV XQWHQDEOH LQ IXWXUH QHWZRUNV $
ZHOOVWXGLHGWRSLFLQPDFKLQHOHDUQLQJZKLFKLVDOVR SRWHQWLDO VROXWLRQ ZLOO QRW EH DQ DGDSWDWLRQ RU
UHOHYDQW LQ PXOWLPHGLD FRPPXQLFDWLRQ $ QHZ H[WHQVLRQZLWKLQDQH[LVWLQJIUDPHZRUNEXWUDWKHUD
JHQHUDWLRQRIREMHFWWUDFNLQJPHWKRGVEDVHGRQGHHS SDUDGLJPVKLIWLVQHFHVVDU\WRPHHWWKHUHTXLUHPHQWV
QHXUDO QHWZRUNV KDV EHHQ GHVFULEHG LQ >@ RI * QHWZRUNV 7KLV LQ WXUQ UHTXLUHV ODUJH VWULGHV
7UDFNLQJ DOJRULWKPV ZKLFK PDNH XVH RI WKH ERWK ZLWK UHVSHFW WR WKHRUHWLFDO IRXQGDWLRQV DQG
FRPSUHVVHG YLGHR UHSUHVHQWDWLRQ KDYH DOVR JDLQHG SUDFWLFDOLPSOHPHQWDWLRQV
DWWHQWLRQ UHFHQWO\ >@ ,Q PXOWLPHGLD DSSOLFDWLRQV 0RGHUQ ZLUHOHVV QHWZRUNV FROOHFW DQG SURFHVV D
VXFKDVYLGHRVWUHDPLQJWKHTXDOLW\RIWKHGLVSOD\HG ODUJH DPRXQW RI GDWD DQG WKLV GDWD LQFOXGLQJ
YLGHR LV RI FUXFLDO LPSRUWDQFH 'LIIHUHQW PDFKLQH PHDVXUHPHQW GDWD FDQ EH XVHG IRU WDFNOLQJ WKH
OHDUQLQJPHWKRGVKDYHEHHQSURSRVHGWRHVWLPDWHWKH SUHYLRXVO\ PHQWLRQHG SUREOHP RI FKDQQHO
VXEMHFWLYHTXDOLW\RILPDJHVSHUFHLYHGE\DKXPDQ UHFRQVWUXFWLRQWUDFNLQJDQGSUHGLFWLRQ7KHUHIRUHLQ
>@ WKLVFRQWH[WVSHFLDODWWHQWLRQKDVEHHQJLYHQWRWKH
GHYHORSPHQW RI QHZ PDFKLQH OHDUQLQJ DOJRULWKPV
3. EXEMPLAR APPLICATIONS IN WKDWDUHDEOHWRSURFHVVVSDWLDOO\GLVWULEXWHGGDWDLQ
WIRELESS NETWORKING UHDO WLPH ZKLOH HIILFLHQWO\ XVLQJ VFDUFH ZLUHOHVV
FRPPXQLFDWLRQ UHVRXUFHV 7KLV FDOOV IRU WKH
7KHGHVLJQDQGRSHUDWLRQRIZLUHOHVVQHWZRUNVLVD GHYHORSPHQW RI GLVWULEXWHG DOJRULWKPV WKDW LQ
KLJKO\ FKDOOHQJLQJ WDVN 2Q WKH URDG WR WKH ILIWK DGGLWLRQ PXVW SURYLGH UREXVW UHVXOWV KDYH JRRG
JHQHUDWLRQRIPRELOHQHWZRUNV*UHVHDUFKHVDQG WUDFNLQJRQOLQHFDSDELOLWLHVDQGH[KLELWDUHODWLYHO\
SUDFWLWLRQHUV DUH LQ SDUWLFXODU FKDOOHQJHG E\ D ORZFRPSOH[LW\)LQDOO\WKH\QHHGWRH[SORLWFRQWH[W
PXOWLWXGHRIFRQIOLFWLQJUHTXLUHPHQWVDQGSURPLVHV DQG VLGH LQIRUPDWLRQ VXFK DV VSDWLDO DQG WHPSRUDO
DV HYHU KLJKHU GDWDUDWHV ORZHUODWHQF\ DQG ORZHU VSDUVLW\LQWKHZLUHOHVVFKDQQHO
HQHUJ\FRQVXPSWLRQ ,Q WKH IROORZLQJ VXEFODXVH ZH SUHVHQW RQH
7KH PDLQ FDXVH RI WKH SUREOHPV DQG OLPLWDWLRQV LQ SURPLVLQJPDFKLQHOHDUQLQJDSSURDFKWRWKHSUREOHP
WKHFRQWH[WRI*LVWKHUDGLRSURSDJDWLRQFKDQQHO RI UHFRQVWUXFWLQJ DQG WUDFNLQJ SDWK ORVV PDSV LQ
7KLVVRFDOOHGZLUHOHVVFKDQQHOFDQVWURQJO\GLVWRUW FHOOXODU QHWZRUNV &ODXVH H[HPSOLILHV WKH
WUDQVPLVVLRQ VLJQDOV LQ D PDQQHU WKDW YDULHV ZLWK SRVVLELOLW\ RI GHVLJQLQJ GHHS QHXUDO QHWZRUNV WKDW
IUHTXHQF\WLPHVSDFHDQGRWKHUV\VWHPSDUDPHWHUV H[SORLW VSDUVLW\ LQ WKH LQSXW GDWD DQG ZKLFK DUH
7KH FKDQQHO GLVWRUWLRQV DUH WKHUHIRUH RI UDQGRP DPHQDEOHWRUHDOWLPHLPSOHPHQWDWLRQ
QDWXUHDQGDUHQRWRULRXVO\GLIILFXOWWRHVWLPDWHDQG
SUHGLFW,QDGGLWLRQWKHZLUHOHVVFKDQQHOLVDVKDUHG 3.1. Reconstruction of radio maps
FRPPXQLFDWLRQ PHGLXP VR WKDW GLIIHUHQW ZLUHOHVV
FRPPXQLFDWLRQ OLQNV PXVW VKDUH WKH DYDLODEOH
FRPPXQLFDWLRQ UHVRXUFHV ,Q PRGHUQ PRELOH
QHWZRUNVWKLVOHDGVWRLQWHUIHUHQFHEHWZHHQGLIIHUHQW
PRELOHXVHUVZKLFKLQWXUQPD\KDYHDGHWULPHQWDO
LPSDFW RQ QHWZRUN RSHUDWLRQ $V D UHVXOW WKH
FDSDFLW\ RI ZLUHOHVV OLQNV LV RI DQ HSKHPHUDO DQG
KLJKO\ G\QDPLF QDWXUH DQG LW GHSHQGV RQ JOREDO
FKDQQHOSDUDPHWHUVVXFKDVSDWKORVVSDWKGHOD\DQG
FDUULHU SKDVH VKLIWV DOO RI ZKLFK YDU\ ZLWK WLPH
IUHTXHQF\DQGVSDFH
$JDLQVWWKLVEDFNJURXQGLWLVQRWVXUSULVLQJWKDWWKH
SUREOHP RI UHFRQVWUXFWLQJ WUDFNLQJ DQG SUHGLFWLQJ
)LJ$QH[DPSOHRIDSDWKORVVPDSIRUWKHGRZQOLQN
FKDQQHO SDUDPHWHUV SOD\ D SURPLQHQW UROH LQ WKH
VFHQDULRZLWKPXOWLSOHEDVHVWDWLRQV7KHSDWKORVVPDS
GHVLJQ DQG RSHUDWLRQ RI PRGHUQ ZLUHOHVV QHWZRUNV LVDGLPHQVLRQDOIXQFWLRQWKDWDVVLJQVWRD
VXFKDV* 7UDGLWLRQDODSSURDFKHVWRWKLVSUREOHP JHRJUDSKLFDOSRVLWLRQLWVSDWKORVVWRWKHVWURQJHVWEDVH
DUH XVXDOO\ EDVHG RQ WKH DVVXPSWLRQV WKDW WKH VWDWLRQ
ZLUHOHVV FKDQQHO FDQ EH PRGHOHG ZLWK D VXIILFLHQW
DFFXUDF\ DQG D VXIILFLHQW QXPEHU RI SLORWEDVHG
FKDQQHOPHDVXUHPHQWVFDQEHSHUIRUPHGLQUHDOWLPH
+RZHYHU WKH FRQWLQXRXVO\ LQFUHDVLQJ QHHG IRU
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
:HFRQVLGHUWKHGRZQOLQNRIDFHOOXODUQHWZRUNLQ UHIHUWKHUHDGHUWR>@IRUDULJRURXVGHILQLWLRQRIWKH
ZKLFKDQXPEHURIEDVHVWDWLRQVWUDQVPLWWHUVVHQG FRQFHSWRI5.+6
WKHGDWDWRPRELOHXVHUV:KLOHWKHXVHUVPRYHRYHU 6LQFH Sn LV D FORVHG FRQYH[ VHW WKH PHWKRG RI
DJHRJUDSKLFDODUHDFRYHUHGE\WKHQHWZRUNDQGVHQG SURMHFWLRQRQFRQYH[VHWV32&6>@SURYLGHVWKH
SHULRGLFDOO\WKHLUSDWKORVVPHDVXUHPHQWVWRWKHEDVH EDVLVIRUWKHGHYHORSPHQWRIDQLWHUDWLYHDOJRULWKP
VWDWLRQV WKH SUREOHP LV WR UHFRQVWUXFW DQG WUDFN D +RZHYHU WKH 32&6 IUDPHZRUN FDQQRW EH GLUHFWO\
FRPSOHWHSDWKORVVPDSLQDQRQOLQHIDVKLRQIURP DSSOLHGWRRXUSUREOHPDWKDQGEHFDXVHWKHQXPEHU
WKHVH PHDVXUHPHQWV 7KH SDWK ORVV GHWHUPLQHV WKH RI PHDVXUHPHQWV JURZV ZLWKRXW ERXQG DV WLPH
UHGXFWLRQ LQ WKH SRZHU GHQVLW\ RI D WUDQVPLVVLRQ HYROYHV7KHUHIRUHWKHDXWKRUVRI>@FRQVLGHUHGD
VLJQDO DV LW SURSDJDWHV IURP D EDVH VWDWLRQ WR D GLIIHUHQWDOJRULWKPLFDSSURDFKWKDWLVDVSHFLDOFDVH
JHRJUDSKLFDO SRVLWLRQ 1RWH WKDW IRU HYHU\ RI WKH DGDSWLYH SURMHFWHG VXEJUDGLHQW PHWKRGV
JHRJUDSKLFDO SRVLWLRQ LWV SDWK ORVV LV GHILQHG ZLWK $360 GHYHORSHG LQ > @ 7KHVH PHWKRGV
UHVSHFW WR WKH VWURQJHVW EDVH VWDWLRQ ZKLFK LV WKH RSHQ WKH GRRU WR GLVWULEXWHG LPSOHPHQWDWLRQ DQG
EDVHVWDWLRQZLWKWKHVPDOOHVWSDWKORVV$UDGLRPDS UHDOWLPH RQOLQH SURFHVVLQJ YLD DGDSWLYH SDUDOOHO
LVWKHQDIXQFWLRQ f : ĺ WKDWDVVLJQVWRHYHU\ SURMHFWLRQV RQ FORVHG FRQYH[ VHWV VXFK DV WKH
JHRJUDSKLFDO SRVLWLRQ LQ D JLYHQ DUHD LWV SDWK ORVV K\SHUVODEV0RUHRYHUWKH\DOORZIRULQFRUSRUDWLQJ
DVVRFLDWHGZLWKWKHVWURQJHVWEDVHVWDWLRQ)LJXUH FRQWH[W LQIRUPDWLRQ LQ D V\VWHPDWLF PDQQHU ZKLOH
VKRZV DQ H[DPSOH RI D SDWK ORVV PDS WKH H[KLELWLQJUHODWLYHO\ORZFRPSOH[LW\DQGUREXVWQHVV
GLPHQVLRQDOIXQFWLRQRYHUWKHJHRJUDSKLFDODUHD DJDLQVWHUURUV)RUPRUHGHWDLOVWKHUHDGHULVUHIHUUHG
IRUWKHGRZQOLQNRIDFHOOXODUQHWZRUN WR>@
7KHJHQHUDOVHWWLQJLVDVIROORZV(DFKEDVHVWDWLRQ 7KH PDLQ GLVDGYDQWDJH RI WKH $360EDVHG
FROOHFWVSDWKORVVPHDVXUHPHQWVVHQWE\DVXEVHWRI DSSURDFKLVWKHQHHGIRUFKRRVLQJDSSURSULDWHNHUQHO
PRELOHXVHUVDQGLWXSGDWHVLWVHVWLPDWHRIWKHSDWK IXQFWLRQV ,Q IDFW LQ SUDFWLFDO VFHQDULRV GLIIHUHQW
ORVV PDS LQ DQ RQOLQH PDQQHU ZKHQHYHU D QHZ JHRJUDSKLFDO SRVLWLRQV UHTXLUH GLIIHUHQW NHUQHO
PHDVXUHPHQW DUULYHV 0HDVXUHPHQWV PD\ FRQWDLQ IXQFWLRQV WKDW LQ DGGLWLRQ QHHG WR EH DGDSWHG RYHU
HUURUV VLQFH JHRJUDSKLFDO ORFDWLRQ FDQQRW EH WLPH GXH WR WKH G\QDPLF QDWXUH RI WKH ZLUHOHVV
GHWHUPLQHG ZLWK DUELWUDU\ SUHFLVLRQ DQG PHDVXUHG HQYLURQPHQW 6LQFH D UHDOWLPH RSWLPL]DWLRQ RI WKH
SDWK ORVV YDOXHV FDQ EH HUURQHRXV )LQDOO\ NHUQHOIXQFWLRQVLVDQLQWULFDWHWDVNLQVSLUHGE\WKH
PHDVXUHPHQWV DUH QRW XQLIRUPO\ GLVWULEXWHG RYHU D ZRUN >@ WKH DXWKRUV RI >@ GHYHORSHG D PXOWL
JLYHQJHRJUDSKLFDODUHDVRWKDWPRUHPHDVXUHPHQWV NHUQHO DSSURDFK WKDW DGDSWV NHUQHO IXQFWLRQV RYHU
PD\EHDYDLODEOHIRUVRPHVXEDUHDVWKDQIRURWKHUV WLPHDQGVSDFHE\FKRRVLQJWKHPIURPDODUJHVHWRI
7KHFKDOOHQJHLVWRUHOLDEO\UHFRQVWUXFWWKHSDWKORVV SUHGHILQHGNHUQHOIXQFWLRQVZKLOHPDLQWDLQLQJORZ
PDSLQFOXGLQJWKHSDWKORVVYDOXHVIRUJHRJUDSKLFDO FRPSOH[LW\ DQG UHDOWLPH FDSDELOLWLHV ,Q WKH
SRVLWLRQVIRU ZKLFKQR SDWK ORVV PHDVXUHPHQWV DUH IROORZLQJZHEULHIO\H[SODLQWKLVDSSURDFK
DYDLODEOH 7RWKLVHQGOHW^țP`0P ZLWKțm î հ EHD
7KH SUREOHP ZDV FRQVLGHUHG LQ >@ ZKHUH WKH JLYHQVHWRIVRPHSUHGHILQHGNHUQHOIXQFWLRQVZKHUH
DXWKRUVSURSRVHXVLQJDPXOWLNHUQHODSSURDFKEDVHG ب ܯ1LV VXIILFLHQWO\ ODUJH WR LQFOXGH DOO UHOHYDQW
RQDGDSWLYHSURMHFWLRQPHWKRGV7REHPRUHSUHFLVH NHUQHOIXQFWLRQV
FRQVLGHU DQ DUELWUDU\ EDVH VWDWLRQ DQG OHW
xn,yn אî EH LWV PHDVXUHPHQW DW WLPH n א
ZKHUHxn אLVDVDPSOHSRVLWLRQPHDVXUHPHQWDW
WLPHn DQGyn אLVWKHFRUUHVSRQGLQJUHVSRQVHD
QRLV\ SDWK ORVV PHDVXUHPHQW $Q HVWLPDWH
݂መ հ RIWKHSDWKORVVPDSPXVWEHFRQVLVWHQW
ZLWK WKH DYDLODEOH PHDVXUHPHQWV 7R WKLV HQG ZH
UHTXLUH WKDW א݊Գ |yn െ ݂መ(ݔn)| ߳ IRU VRPH
VXLWDEO\FKRVHQVPDOO߳!,Q>@WKLVUHTXLUHPHQW )LJ,OOXVWUDWLRQRIWKH$360EDVHGDSSURDFK8VLQJ
LVPHWE\SURMHFWLQJWKHHVWLPDWH݂መRQWKHK\SHUVODEV SDUDOOHOSURMHFWLRQPHWKRGVWKHHVWLPDWH݂መQIROORZVWKH
JLYHQE\Sn ^f ݕ|אn െ ݂ۃ, ߢ(ݔn,·) |ۄ ߳`,n א LQWHUVHFWLRQVRIWKHK\SHUVODEVDWWLPHVQDQGQWR
ZKHUH LV D UHSURGXFLQJ NHUQHO +LOEHUW VSDFH HQVXUHFRQVLVWHQF\ZLWKQHZPHDVXUHPHQWVDQGJRRG
5.+6 DQG ț î հ LV WKH UHSURGXFLQJ WUDFNLQJFDSDELOLWLHVZLWKRQOLQHSURFHVVLQJ$WHDFK
WLPHWKHUHDUHWZRK\SHUVODEVFRUUHVSRQGLQJWRWZR
NHUQHO IRU VR WKDW ݂ۃ, ߢ(ݔn,·) ۄfxn WKH
PHDVXUHPHQWV
UHSURGXFLQJ SURSHUW\ 'XH WR D ODFN RI VSDFH ZH
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
6LQFH WKH QXPEHU RI PHDVXUHPHQWV JURZV OLQHDUO\ HPEHGGHG GHYLFHV LV FRQVLGHUHG XQIHDVLEOH GXH WR
ZLWKnZHWDNHLQWRDFFRXQWRQO\WKHPRVWUHOHYDQW XQSUHGLFWDEOH WHUPLQDWLRQ WLPHV DQG LQFDOFXODEOH
GDWDZKLFKLVFRQWDLQHGLQWKHGLFWLRQDU\^xi,yi`nא,n ORVVRIHDUO\VWRSSLQJ ,QWKLVUHJDUGDSURYLVLRQDO
ZKHUHȤn ^كn,n í,...,`LVWKHGLFWLRQDU\LQGH[VHW VROXWLRQ DLPHG DW ODUJHVFDOH PHDVXUHPHQW
DW WLPH n 7KH FDUGLQDOLW\ In _In_ RI WKH GLFWLRQDU\ FDPSDLJQV DQG XWLOL]LQJ EODFNER[ GDWDGULYHQ
PXVW EH VXIILFLHQWO\ VPDOO WR VDWLVI\ WKH KDUGZDUH PDFKLQH OHDUQLQJ WHFKQLTXHV :KLOH WKLV DSSURDFK
OLPLWDWLRQV RQ PHPRU\ VL]H DQG SURFHVVRU VSHHG ILWVZHOOZLWKPDQ\LPDJLQJSUREOHPVLWZDVVRRQ
:LWK WKHVH GHILQLWLRQV IRU DQ DUELWUDU\ WLPH n WKH VWULSSHG RI LWV HQFKDQWPHQW IRU FRPPXQLFDWLRQ
HVWLPDWH݂መn xRIWKHSDWKORVVDWSRVLWLRQx FDQEH V\VWHPV GXH WR WKH QHFHVVLW\ RI PHDVXULQJ DQG
ZULWWHQDVDZHLJKWHGVXPRINHUQHOIXQFWLRQV݂መn x SUHSURFHVVLQJ 5) VLJQDOV XQGHU GLYHUVH VHWV RI
ܣۃ , ܭ ۄWUDFHܣT , ܭ )+HUHKn Knx אMîIn HQYLURQPHQWDO FRQGLWLRQV UHVXOWLQJ LQ H[WUHPHO\
LVDJLYHQNHUQHOPDWUL[HYDOXDWHGDWxZLWK>Kn@i,m ODUJHWUDLQLQJWLPHVDQGGLVDSSRLQWLQJSHUIRUPDQFH
țmx,xiDQGAn אMîIn LVDSDUDPHWHUPDWUL[WKDW JDLQV ,Q DGGLWLRQ WKHUH LV VWLOO QR FRPPRQO\
QHHGVWREHRSWLPL]HG:HSRLQWRXWWKDWVLQFHWKH DFFHSWHG QHXUDO QHWZRUN GHIDFWR VWDQGDUG RU
NHUQHO PDWUL[ GHSHQGV RQ WKH SRVLWLRQ x אWKH EDVHOLQH DUFKLWHFWXUH IRU SDUWLFXODU FRPPXQLFDWLRQ
SDUDPHWHUPDWUL[VKRXOGEHRSWLPL]HGIRUGLIIHUHQW SUREOHPV DNLQ WR $OH[1HW RU *RRJOH1HW LQ WKH
JHRJUDSKLFDOSRVLWLRQV LPDJLQJ GRPDLQV 2QH VWHS WR FORVH WKLV LPSRUWDQW
7KH PRVW REYLRXV UHTXLUHPHQW RQ WKH SDUDPHWHU JDS ZDV PDGH LQ >@ E\ XVLQJ PXOWLGLPHQVLRQDO
PDWUL[A LVWKDWLWPXVWEHFKRVHQWRILWWKHHVWLPDWH /DSODFH WUDQVIRUP WHFKQLTXHV WR GHVLJQ RSWLPDO
WR WKH PHDVXUHPHQWV 7KLV FDQ EH DFKLHYHG E\ QHXUDO QHWZRUNV IRU SDUWLFXODU VSDUVH UHFRYHU\
PLQLPL]LQJWKHGLVWDQFHZLWKVRPHVXLWDEO\FKRVHQ SUREOHPV UHYHDOLQJ D YHU\ LQWULJXLQJ FRQQHFWLRQ
PHWULF RI A IURP WKH VHW Sn ^A אMîIn EHWZHHQ FRPPRQO\ HPSOR\HG QHXUDO QHWZRUNV
|ܣۃ , ܭ ۄെ ݕn| ߳` IRU VRPH VXIILFLHQWO\ VPDOO߳ FRPSULVLQJ ZHLJKWV WKUHVKROG IXQFWLRQV UHFWLILHG
! 6LQFH M LV ODUJH WKH SUREOHP LV KRZHYHU OLQHDU 5H/8 DQG UHFWLILHG SRO\QRPLDO 5H3
FRPSXWDWLRQDOO\SURKLELWLYHIRUPDQ\DSSOLFDWLRQVLQ DFWLYDWLRQ IXQFWLRQV DQG YROXPH DQG FHQWURLG
ZLUHOHVV QHWZRUNV 7KHUHIRUH WKH DXWKRUV RI >@ FRPSXWDWLRQ SUREOHPV RYHU VSDUVLW\ LQGXFLQJ VHWV
H[WHQGHG WKH REMHFWLYH IXQFWLRQ E\ DGGLQJ WR WKH :H UHIHU WKH UHDGHU WR )LJXUH IRU D JHRPHWULF
GLVWDQFHPHWULFWZRUHJXODUL]DWLRQWHUPVWKDWLPSRVH LOOXVWUDWLRQRIDVPDOOVSDUVHUHFRYHU\SUREOHP+HUH
VRPH VSDUVLW\ LQ A ZKHQ WKH QHZ UHJXODUL]HG [ LV WR EH UHFRYHUHG IURP GLPHQVLRQDOLW\ UHGXFHG
REMHFWLYH IXQFWLRQ LV PLQLPL]HG $V D UHVXOW WKH PHDVXUHPHQW \ $[ JLYHQ WKDW [ EHORQJV WR D
DSSURDFK QRW RQO\ ILWV WKH HVWLPDWH IXQFWLRQ WR WKH SDUWLFXODU VSDUVLW\ LQGXFLQJ VHW EOXH 7KHQ WKH
PHDVXUHPHQWVEXWDOVRGLVFDUGVLUUHOHYDQWGDWDLQWKH QHXUDO QHWZRUN RI >@ RXWSXWV WKH HVWLPDWHईƸ WKDW
GLFWLRQDU\ DQG UHGXFHV WKH LPSDFW RI XQVXLWDEOH PLQLPL]HVWKHH[SHFWHGHUURURYHUWKHXQFHUWDLQW\VHW
NHUQHOV LQWHUVHFWLRQ EHWZHHQ UHG DQG EOXH 8VLQJ VXFK
7KHUHJXODUL]HGREMHFWLYHIXQFWLRQSURYLGHVDEDVLV JHRPHWULF LGHDV LQ WKH GHVLJQ RI QHXUDO QHWZRUNV
IRU WKH GHYHORSPHQW RI QHZ LWHUDWLYH DOJRULWKPV LQ DOORZVIRUE\SDVVLQJFRVWO\VHDUFKRYHUH[SRQHQWLDO
>@ EDVHG RQ WKH IRUZDUGEDFNZDUG VSOLWWLQJ FDQGLGDWH QHWZRUNV WKDW FRQVXPH ODUJH SRUWLRQV RI
PHWKRGV DQG VSDUVLW\EDVHG LWHUDWLYH ZHLJKWLQJ DYDLODEOHFRPSXWLQJUHVRXUFHV,QGHHGSUDFWLWLRQHUV
PHWKRGV 7KH DOJRULWKPV SURYLGH JRRG WUDFNLQJ FDQVWLOODSSO\ILQHWXQLQJWRUHGXFHDSRVVLEOHPRGHO
FDSDELOLWLHV IRU WKH SUREOHP RI UHFRQVWUXFWLQJ DQG PLVPDWFK DQG UHGXFH UHFRQVWUXFWLRQ HUURUV HYHQ
WUDFNLQJ WLPHYDU\LQJ SDWK ORVV PDSV )RU PRUH IXUWKHU
GHWDLOVZHUHIHUWKHUHDGHUWR>@
3.2. Deep neural networks for sparse recovery
5HFHQWO\ FRPSUHVVHG VHQVLQJ DQG GHHS OHDUQLQJ
KDYHHPHUJHGDVWKHRUHWLFDODQGSUDFWLFDOWRROVHWVWR
XQOHDVK IXOO SRWHQWLDO DQG DSSURDFK IXQGDPHQWDO
WKHRUHWLFDO ERXQGV ZKHWKHU LW EH IRU SLORW
GHFRQWDPLQDWLRQ LQ FKDQQHO HVWLPDWLRQ XVHU
LGHQWLILFDWLRQDFWLYLW\GHWHFWLRQRU3$35UHGXFWLRQ
)LJ*HRPHWU\RIVSDUVHUHFRYHU\
:KLOHLQPDQ\FDVHVUHVHDUFKHUVDUHZHOODZDUHRI
RSWLPDO VROXWLRQV HJ LQ WHUPV RI RSWLPL]DWLRQ
SUREOHPV IRU FKDQQHO HVWLPDWLRQ XVLQJ D PLQLPDO
QXPEHU RI SLORWV LPSOHPHQWLQJ WKHVH VROXWLRQV LQ
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
5. CONCLUSION [6] 6 %RVVH .5 0OOHU 7 :LHJDQG DQG :
6DPHN %UDLQFRPSXWHU LQWHUIDFLQJ IRU
7KLVSDSHUGLVFXVVHGWKHLQFUHDVLQJPXWXDOLQIOXHQFH PXOWLPHGLD TXDOLW\ DVVHVVPHQW ,Q ,((( 6\VW
RIPDFKLQHOHDUQLQJDQGFRPPXQLFDWLRQWHFKQRORJ\ 0DQ&\EHUSDJHV±
/HDUQLQJDOJRULWKPVZHUHQRWRQO\VKRZQWRH[FHOLQ
WUDGLWLRQDO QHWZRUN PDQDJHPHQW WDVNV VXFK DV [7] -$%R\DQDQG0//LWWPDQ3DFNHWURXWLQJ
URXWLQJFKDQQHOHVWLPDWLRQRU3$35UHGXFWLRQEXW LQ G\QDPLFDOO\ FKDQJLQJ QHWZRUNV $
DOVRWREHDFRUHSDUWRIPDQ\HPHUJLQJDSSOLFDWLRQ UHLQIRUFHPHQW OHDUQLQJ DSSURDFK 1,36 SDJHV
ILHOGVRIFRPPXQLFDWLRQWHFKQRORJ\HJVPDUWFLWLHV ±
RU ,QWHUQHW RI WKLQJV 7KH DYDLODELOLW\ RI ODUJH
DPRXQWV RI GDWD DQG UHFHQW LPSURYHPHQWV LQ GHHS [8] 5/&DYDOFDQWHDQG66WDQF]DN$GLVWULEXWHG
OHDUQLQJ PHWKRGRORJ\ ZLOO IXUWKHU IRVWHU WKH VXEJUDGLHQW PHWKRG IRU G\QDPLF FRQYH[
FRQYHUJHQFHRIWKHVHWZRILHOGVDQGZLOORIIHUQHZ RSWLPL]DWLRQSUREOHPVXQGHUQRLV\LQIRUPDWLRQ
ZD\VWRRSWLPL]HWKHZKROHFRPPXQLFDWLRQSLSHOLQH H[FKDQJH,(((-6HO7RSLFV6LJQDO3URFHVV
LQDQHQGWRHQGPDQQHU>@ ±
+RZHYHUEHIRUHUHVRXUFHLQWHQVLYHPRGHOVVXFKDV
GHHSQHXUDOQHWZRUNVFDQEHDSSOLHGRQDODUJHVFDOH [9] 5 / * &DYDOFDQWH DQG 6 6WDQF]DN 5REXVW
LQ FRPPXQLFDWLRQ DSSOLFDWLRQV VHYHUDO SUDFWLFDO VHWWKHRUHWLF GLVWULEXWHG GHWHFWLRQ LQ GLIIXVLRQ
FKDOOHQJHVHJFRPSOH[LW\VHFXULW\SULYDF\QHHG QHWZRUNV,Q,(((,&$663
WREHVROYHG)XUWKHUPRUHPRUHUHVHDUFKLVUHTXLUHG
RQ WKHRUHWLFDO WRSLFV DW WKH LQWHUVHFWLRQ RI [10] 5/*&DYDOFDQWHDQG,<DPDGD$IOH[LEOH
FRPPXQLFDWLRQV DQG PDFKLQH OHDUQLQJ HJ SHDNWRDYHUDJH SRZHU UDWLR UHGXFWLRQ VFKHPH
LQFUHPHQWDO OHDUQLQJ OHDUQLQJ LQ QRQVWDWLRQDU\ IRU RIGP V\VWHPV E\ WKH DGDSWLYH SURMHFWHG
HQYLURQPHQWVRUOHDUQLQJZLWKVLGHLQIRUPDWLRQ VXEJUDGLHQW PHWKRG ,((( 7UDQV 6LJQDO
3URFHVV±
REFERENCES
[11] 5 / * &DYDOFDQWH , <DPDGD DQG %
[1] 5$JUDZDODQG56ULNDQW3ULYDF\SUHVHUYLQJ 0XOJUHZ $Q DGDSWLYH SURMHFWHG VXEJUDGLHQW
GDWDPLQLQJ,Q$&06,*02'0DQDJ'DWD DSSURDFK WR OHDUQLQJ LQ GLIIXVLRQ QHWZRUNV
SDJHV± ,(((7UDQV6LJQDO3URFHVV±
[2] 2 * $OLX $ ,PUDQ 0 $ ,PUDQ DQG %
(YDQV $ VXUYH\ RI VHOI RUJDQLVDWLRQLQ IXWXUH [12] <&KHQ;<DQJ%=KRQJ63DQ'&KHQ
FHOOXODU QHWZRUNV ,((( &RPPXQ 6XUYH\V DQG + =KDQJ &QQWUDFNHU RQOLQH
7XWV± GLVFULPLQDWLYH REMHFW WUDFNLQJ YLD GHHS
FRQYROXWLRQDO QHXUDO QHWZRUN $SSO 6RIW
[3] 6%DFK$%LQGHU*0RQWDYRQ).ODXVFKHQ &RPSXW±
.5 0OOHU DQG : 6DPHN 2Q SL[HOZLVH
H[SODQDWLRQVIRUQRQOLQHDUFODVVLILHUGHFLVLRQV [13] &+ &KHQJ <+ +XDQJ DQG +& &KHQ
E\ OD\HUZLVH UHOHYDQFH SURSDJDWLRQ 3/26 &KDQQHO HVWLPDWLRQ LQ RIGP V\VWHPV XVLQJ
21(H QHXUDO QHWZRUN WHFKQRORJ\ FRPELQHG ZLWK D
JHQHWLFDOJRULWKP6RIW&RPSXW±
[4] 5%%DVQHW60XNNDPDODDQG$+6XQJ
'HWHFWLRQ RI SKLVKLQJ DWWDFNV $ PDFKLQH
OHDUQLQJ DSSURDFK 6RIW &RPS $SSO ,QGXVW [14] /&LDEDWWRQL*,SSROLWL$%HQLQL6/RQJKL
± DQG 0 3LUUR 'HVLJQ RI D KRPH HQHUJ\
PDQDJHPHQWV\VWHPE\RQOLQHQHXUDOQHWZRUNV
[5] 6 %RVVH ' 0DQLU\ 7 :LHJDQG DQG : ,)$&3URF9ROXPHV±
6DPHN $ GHHS QHXUDO QHWZRUN IRU LPDJH
TXDOLW\DVVHVVPHQW,Q,(((,&,3SDJHV± [15] 0 &RXUEDULDX[ , +XEDUD ' 6RXGU\ 5 (O
<DQLY DQG < %HQJLR %LQDUL]HG QHXUDO
QHWZRUNV7UDLQLQJ GHHSQHXUDOQHWZRUNV ZLWK
ZHLJKWVDQGDFWLYDWLRQVFRQVWUDLQHGWRRU
DU;LY
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
[16] 0 (JPRQW3HWHUVHQ ' GH 5LGGHU DQG + [27] 6 .XPDU DQG 5 0LLNNXODLQHQ 'XDO
+DQGHOV ,PDJH SURFHVVLQJ ZLWK QHXUDO UHLQIRUFHPHQW TURXWLQJ $Q RQOLQH DGDSWLYH
QHWZRUNVD UHYLHZ 3DWWHUQ 5HFRJQLW URXWLQJDOJRULWKP,Q,&$11(
±
[28] </LDQJ5HDOWLPHYEUYLGHRWUDIILFSUHGLFWLRQ
[17] $(VZDUDGDVV;+6XQDQG0:X$QHXUDO IRUG\QDPLFEDQGZLGWKDOORFDWLRQ,(((7UDQV
QHWZRUN EDVHG SUHGLFWLYH PHFKDQLVP IRU 6\VW0DQ&\EHUQ&±
DYDLODEOHEDQGZLGWK,Q,3'36SDJHVD±D
[29] 6 /LPPHU DQG 6 6WDQF]DN 2SWLPDO GHHS
QHXUDOQHWZRUNVIRUVSDUVHUHFRYHU\YLDODSODFH
[18] =0)DGOXOODK00)RXGD1.DWR;6KHQ WHFKQLTXHVDU;LY
DQG<1R]DNL$QHDUO\ZDUQLQJV\VWHPDJDLQVW
PDOLFLRXV DFWLYLWLHV IRU VPDUW JULG [30] 7/XDQG-=KX*HQHWLFDOJRULWKPIRUHQHUJ\
FRPPXQLFDWLRQV,(((1HWZ HIILFLHQWTRVPXOWLFDVWURXWLQJ,(((&RPPXQ
/HWW±
[19] $ *DOLQGR6HUUDQR DQG / *LXSSRQL
'LVWULEXWHG TOHDUQLQJ IRU DJJUHJDWHG [31] 3 0HUWLNRSRXORV DQG $ / 0RXVWDNDV
LQWHUIHUHQFHFRQWUROLQFRJQLWLYHUDGLRQHWZRUNV /HDUQLQJ LQ DQ XQFHUWDLQ ZRUOG 0LPR
,(((7UDQV9HK7HFKQRO± FRYDULDQFHPDWUL[RSWLPL]DWLRQZLWKLPSHUIHFW
IHHGEDFN,(((7UDQV6LJQDO3URF±
[20] /*XELQ%3RO\DNDQG(5DLN7KHPHWKRG
RISURMHFWLRQVIRUILQGLQJWKHFRPPRQSRLQWRI [32] - 0R 3 6FKQLWHU 1 * 3UHOFLF DQG 5 :
FRQYH[VHWV8665&RPSXW0DWK0DWK3K\V +HDWK &KDQQHO HVWLPDWLRQ LQ PLOOLPHWHU ZDYH
± PLPR V\VWHPV ZLWK RQHELW TXDQWL]DWLRQ ,Q
$VLORPDU 6LJQDOV 6\VW &RPSXW SDJHV ±
[21] 76*X]HOODDQG:0&DPLQKDV$UHYLHZRI
PDFKLQHOHDUQLQJDSSURDFKHVWRVSDPILOWHULQJ
([SHUW6\VW$SSO± [33] * 0RQWDYRQ : 6DPHN DQG .5 0OOHU
0HWKRGV IRU LQWHUSUHWLQJ DQG XQGHUVWDQGLQJ
[22] 6 +DQ + 0DR DQG : - 'DOO\ 'HHS GHHSQHXUDOQHWZRUNVDU;LY
FRPSUHVVLRQ &RPSUHVVLQJ GHHS QHXUDO
QHWZRUNVZLWKSUXQLQJWUDLQHGTXDQWL]DWLRQDQG [34] 0 0XQHWRPR < 7DNDL DQG < 6DWR $
KXIIPDQFRGLQJDU;LY PLJUDWLRQ VFKHPH IRU WKH JHQHWLF DGDSWLYH
URXWLQJ DOJRULWKP ,Q ,((( 6\V 0DQ &\EHU
[23] <-DEUDQH93*-LPHQH]$*$UPDGD% YROXPHSDJHV±
$(6DLGDQG$$2XDKPDQ5HGXFWLRQRI
SRZHUHQYHORSHIOXFWXDWLRQVLQRIGPVLJQDOVE\ [35] 7 7 1JX\HQ DQG * $UPLWDJH $ VXUYH\ RI
XVLQJ QHXUDO QHWZRUNV ,((( &RPPXQ /HWW WHFKQLTXHV IRU LQWHUQHW WUDIILF FODVVLILFDWLRQ
± XVLQJ PDFKLQH OHDUQLQJ ,((( &RPPXQ
6XUYH\V7XWV±
[24] - -LDQJ ,PDJH FRPSUHVVLRQ ZLWK QHXUDO
QHWZRUNV±D VXUYH\ 6LJQDO 3URFHVV ,PDJH [36] 7-2¶6KHD7(USHNDQG7&&ODQF\'HHS
± OHDUQLQJ EDVHG PLPR FRPPXQLFDWLRQV
DU;LY
[25] - -RXQJ 0DFKLQH OHDUQLQJEDVHG DQWHQQD
VHOHFWLRQ LQ ZLUHOHVV FRPPXQLFDWLRQV ,((( [37] & 3HUHUD $ =DVODYVN\ 3 &KULVWHQ DQG '
&RPPXQ/HWW± *HRUJDNRSRXORV&RQWH[WDZDUHFRPSXWLQJIRU
WKHLQWHUQHWRIWKLQJV$VXUYH\,(((&RPPXQ
[26] 0.DVSDULFN5/*&DYDOFDQWH69DOHQWLQ 6XUYH\V7XWV±
6 6WDQF]DN DQG 0 <XNDZD .HUQHOEDVHG
DGDSWLYH RQOLQH UHFRQVWUXFWLRQ RI FRYHUDJH [38] 7 : 5RQGHDX $SSOLFDWLRQ RI $UWLILFLDO
PDSVZLWKVLGHLQIRUPDWLRQ,(((7UDQV9HK ,QWHOOLJHQFHWR:LUHOHVV&RPPXQLFDWLRQV3K'
7HFKQRO± WKHVLV9LUJLQLD7HFK
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
7RPR\XNL2WDQL+LGHNL7RXEH7DWVX\D.LPXUD0DVDQRUL)XUXWDQL
'2&2027HFKQRORJ\,1&177'2&202,1&-DSDQ
Abstract – With the introduction of network virtualization and the implementation of 5G/IoT, mobile networks
will offer more diversified services and be more complex. This raises a concern about a significant rise in network
operation workload. Meanwhile, artificial intelligence (AI) technology is making remarkable progress and is
expected to solve human resource shortages in various fields. Likewise, the mobile industry is gaining momentum
toward the application of AI to network operation to improve the efficiency of mobile network operation
[1][2].This paper will discuss the possibility of applying AI technology to network operation and presents some
use cases to show good prospects for AI-driven network operation.
.H\ZRUGV±$UWLILFLDOLQWHOOLJHQFH$,PRELOHQHWZRUNQHWZRUNRSHUDWLRQ
1. INTRODUCTION x $QDO\]HWKHWLPHFKDUDFWHULVWLFVRIWKHGDWDDQG
SUHGLFWIXWXUHWHQGHQFLHV
1.1. Characteristics of artificial intelligence (AI) x 0DNHDQGH[HFXWHDQRSWLPXPSODQZKLFKLV
EDVHGRQWKHLGHQWLILHGSUHGLFWHGGDWD
%XVLQHVVHV WRGD\ DUH IDFHG ZLWK D JUHDW GHDO RI
LQIRUPDWLRQDQGDVKRUWDJHRIKXPDQUHVRXUFHV7R $VVKRZQLQWKHZKLWHSDSHU$,LVH[SHFWHGWREH
VROYHWKHVHLVVXHVWKH\DUHLQWURGXFLQJ$,ELJGDWD XWLOL]HGLQYDULRXVEXVLQHVVILHOGVDQGSHUIRUPKLJKO\
WHFKQRORJLHV DW DQ DFFHOHUDWHG SDFH WR LPSURYH WKH DGYDQFHG DQDO\VLV IRU LPSURYLQJ RSHUDWLRQDO
HIILFLHQF\RIEXVLQHVVRSHUDWLRQ HIILFLHQF\XVLQJELJGDWDLQDVKRUWSHULRGRIWLPH
$VWKHZRUOGWRGD\LVH[SHULHQFLQJWKHWKLUG$,ERRP ZLWKRXWKXPDQPDQXDORSHUDWLRQ
WKH SUDFWLFDO XVH RIPDFKLQH OHDUQLQJ KHOSV XV WR
DXWRPDWLFDOO\ LGHQWLI\ DQG OHDUQ WKH SDWWHUQV DQG 1.2. Trends of mobile network
UXOHVIURPODUJHDPRXQWVRIGDWDWKHVRFDOOHGELJ
GDWD EDVHG RQ VSHFLILF FULWHULD 7KLV WHFKQRORJ\ 7RGD\ WKH DSSOLFDWLRQ RI YLUWXDOL]HG QHWZRUN
ZLOOHQDEOHXVWRVHWPRUHDSSURSULDWHUXOHVEDVHGRQ IXQFWLRQV 1)9 WR PRELOH FRUH QHWZRUNV LV LQ
OHDUQLQJ IURP GDWD DQG PDNH PRUH DFFXUDWH SURJUHVV >@ )RU \HDUV YDULRXV QHWZRUN IXQFWLRQV
MXGJPHQWV RQFH HYDOXDWLRQ FULWHULD DUH JLYHQ VXFKDVWKHFRQYHQWLRQDO(YROYHG3DFNHW&RUH(3&
)ROORZLQJ WKLV ³GHHS OHDUQLQJ´ KDV HPHUJHG LQ KDYHEHHQSURYLGHGLQWKHLUGHGLFDWHGKDUGZDUH+:
ZKLFK $, OHDUQV E\ LWVHOI DQG DFFXPXODWHV WKH VXFKDV$GYDQFHG7HOHFRP&RPSXWLQJ$UFKLWHFWXUH
NQRZOHGJH RI SDWWHUQV DQG UXOHV ZLWK QR VSHFLILF $7&$ KDUGZDUH :LWK WKH LQWURGXFWLRQ RI 1)9
FULWHULDJLYHQ VRIWZDUHZLOOEHDEOHWRUXQRQDYLUWXDOL]HGRSHUDWLQJ
$FFRUGLQJWRWKH:KLWH3DSHURQ,QIRUPDWLRQ V\VWHP26RIJHQHULF,QWHODUFKLWHFWXUH,$VHUYHUV
DQG &RPPXQLFDWLRQV LQ -DSDQ SXEOLVKHG E\ WKH DQG EH SURYLGHG VHSDUDWHO\ IURP KDUGZDUH >@
0LQLVWU\ RI ,QWHUQDO $IIDLUV DQG &RPPXQLFDWLRQV )XUWKHUPRUH WKH 1)9 DUFKLWHFWXUH HQDEOHV
WKHUHDUHWKUHHPDMRUW\SHVRIIXQFWLRQVWKDW$,SOD\V LQWHJUDWHG PDQDJHPHQW DQG FRQWURO RUFKHVWUDWLRQ
LQDFWXDOVHUYLFHVLGHQWLILFDWLRQSUHGLFWLRQDQG RIQHWZRUNVHUYLFHVDQGUHVRXUFHVLQWHUZRUNLQJZLWK
H[HFXWLRQ>@7KHVHIXQFWLRQVFDQEHXWLOL]HGDQG 0DQDJHPHQW DQG 2UFKHVWUDWLRQ 0$12 DQG D
DSSOLHGDFURVVDOOLQGXVWULHV6WDQGDUGXVDJHVRIHDFK VRIWZDUHGHILQHGQHWZRUN6'1
IXQFWLRQDUHDVIROORZV 7KHVH WHFKQRORJLHV ZLOO HQDEOH PRVW RI WKH
FRQVWUXFWLRQDQGLQFUHDVHGHFUHDVHZRUNRIQHWZRUN
x ,GHQWLI\WKHFXUUHQWVLWXDWLRQFKDUDFWHULVWLFV HOHPHQWV 1(V WR EH SHUIRUPHG UHPRWHO\ E\
IURPDODUJHDPRXQWRIGDWDELJGDWD VRIWZDUH FRQWURO ZLWKRXW PDQXDO RSHUDWLRQ ,Q
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
DGGLWLRQRQFHVRIWZDUHDQGKDUGZDUHDUHVHSDUDWHG
WKH\ FDQ EH FRQVWUXFWHG DQG LQFUHDVHG RU UHGXFHG 2. ISSUES OF MOBILE NETWORK
LQGHSHQGHQWO\ DW GLIIHUHQW WLPLQJV )RU LQVWDQFH OPERATION
RQFH WKH KDUGZDUH HJ WKH ,$ VHUYHU LV SUHSDUHG
VRIWZDUH FDQ EH UHDGLO\ LQFUHDVHGUHGXFHG RQ WKH 1HWZRUNRSHUDWLRQLQJHQHUDOFDQEHLOOXVWUDWHGDVD
VHUYHU5HVRXUFHVFDQEHDOORFDWHGZKHQHYHUWKH\DUH F\FOH RI DFWLYLWLHV WKDW FRQVLVW RI SODQQLQJ
QHHGHG WR DFFRPPRGDWH WKH WUDIILF UHGXFLQJ WKH FRQVWUXFWLRQDQGPDLQWHQDQFHDVVKRZQLQ)LJ
VXUSOXV QHWZRUN IDFLOLWLHV )LJ ,Q WKH
FRQYHQWLRQDO PHWKRG QHWZRUN IDFLOLWLHV EOXH OLQH
DUH HVWDEOLVKHG LQ DGYDQFH EDVHG RQ WKH VSHFLILF
QHWZRUN WUDIILF YROXPH SUHGLFWHG UHG OLQH ,Q
FRQWUDVW LQ WKH YLUWXDOL]HG QHWZRUN ORWV RI
HTXLSPHQWXQLWVFDQEHIOH[LEO\DUUDQJHGDVYLUWXDO
PDFKLQHV90VRQWKHVHUYHUVFORXGDQGVXFK90V
FDQ EH DOORFDWHG G\QDPLFDOO\ WR DOORZ G\QDPLF
FKDQJHVLQWKHQHWZRUNUHVRXUFHVDOORFDWHG
)LJ1HWZRUNRSHUDWLRQF\FOH
,Q OLJKW RI FRQYHQWLRQDO PRELOH QHWZRUN WUHQGV
ZKHWKHUWRDFKLHYHWKHIROORZLQJREMHFWLYHVFDQKDYH
DQLPSDFWRQWKHQHWZRUNRSHUDWLRQ
DFFHOHUDWH WKH QHWZRUN RSHUDWLRQ F\FOH WR
SURYLGHVHUYLFHVTXLFNO\DQG
HVWDEOLVK DQ DQDO\VLV DQG RSHUDWLRQ PHWKRG IRU
)LJ1HWZRUNUHVRXUFHDOORFDWLRQZLWKQHWZRUN DGYDQFHGDQGFRPSOLFDWHGQHWZRUNV
YLUWXDOL]DWLRQ
7KH LVVXHV WRZDUGV DFKLHYLQJ WKH DERYH REMHFWLYHV
0RUHRYHUWKHLQWURGXFWLRQRI*VFKHGXOHGIRU DUHGHVFULEHGEHORZ
ZLOOEULQJZLWKLWDYDULHW\RIQHWZRUNVHUYLFHVVXFK 3ODQQLQJ LV WKH VWHS WR DQDO\]H WKH QHWZRUN WUDIILF
DV ,R7 ZLWK WUDIILF FKDUDFWHULVWLFV DQG QHWZRUN DQG IRUPXODWH IXWXUH SODQV IRU QHWZRUN IDFLOLW\
UHTXLUHPHQWV GLIIHUHQW IURP WKRVH RI H[LVWLQJ UHVRXUFHV 7KH PDLQ DFWLYLW\ RI WKH FRQYHQWLRQDO
VPDUWSKRQHV>@ SODQQLQJ SURFHVV LV WKH DQDO\WLF ZRUN FRPSDUDEOH
)RUH[DPSOHDIDFWRU\HTXLSPHQWPRQLWRULQJV\VWHP SUHGLFWLRQZKLFKLVSHUIRUPHGWRDQDO\]HWKHSDVW
LQ ZKLFK PDVV GDWD IURP VHQVRUV DUH VHQW WR WKH QHWZRUN WUDIILF DQG FDOFXODWH WKH DPRXQWV RI ORQJ
DGPLQLVWUDWRU SHULRGLFDOO\ ZLOO UHTXLUH D KLJKO\ WHUP \HDUO\ QHWZRUN UHVRXUFHV VXFK DV
VHFXUH DQG UHOLDEOH QHWZRUN QR GDWD ORVV 2Q WKH EDQGZLGWKV+RZHYHUZKHQQHWZRUNYLUWXDOL]DWLRQ
RWKHU KDQG DWUDIILF V\VWHP LQ ZKLFKLQWHUYHKLFOH DQG YDULRXV *,R7 VHUYLFHV FRPH LQWR SOD\ DQG
FRPPXQLFDWLRQ SUHYHQWV WUDIILF FRQJHVWLRQ ZLOO GLIIHUHQW VHUYLFHV DUH VXSHULPSRVHG RQ WKH VDPH
UHTXLUH D ORZODWHQF\ DQG KLJKO\ VHFXUH QHWZRUN SK\VLFDOQHWZRUNKDUGZDUHLWZLOOEHQHFHVVDU\WR
$OWKRXJK WKH QHWZRUNV ZLWK GLIIHUHQW UHTXLUHPHQWV IDFWRULQWKHWUDIILFRIDOOVHUYLFHVLQWUDIILFYROXPH
QHHG WR EH VHSDUDWHG LW LV LQHIILFLHQW WR GR VR SUHGLFWLRQIRUDVLQJOHQHWZRUNKDUGZDUHXQLW7KLV
SK\VLFDOO\ ,QVWHDG ZH QHHG WR XWLOL]H WKH QHWZRUN ZLOO PDNH WKH DQDO\VLV YHU\ GLIILFXOW DQG WLPH
VOLFLQJ WHFKQRORJ\ WR YLUWXDOO\ FRQVWUXFW VHSDUDWH FRQVXPLQJLILWLVGRQHPDQXDOO\E\KXPDQVRUEDVHG
QHWZRUNV ZLWK GLIIHUHQW UHTXLUHPHQWV RQ WKH VDPH RQ WKH H[SHUWLVH RI VSHFLDOLVWV DV EHIRUH 6SHFLILF
SK\VLFDOQHWZRUN LVVXHV IRU DFFHOHUDWLQJ WKH SODQQLQJ SURFHVV DUH
:LWKQHZWHFKQRORJLHVVXFKDV1)9DQGWKHQHWZRUN GHVFULEHGLQFODXVH
VOLFLQJ WHFKQRORJ\ PHQWLRQHG DERYH WKH SK\VLFDO *HQHUDOO\ VSHDNLQJ WKH FRQVWUXFWLRQ SURFHVV
KDUGZDUH FRQILJXUDWLRQ ZLOO UHPDLQ XQFKDQJHG RU LQYROYHVGHVLJQLQJEXLOGLQJDQGWHVWLQJWKHQHWZRUN
EHFRPH VLPSOHU +RZHYHU WKLV ZLOO EULQJ DERXW HTXLSPHQW:KHQQHWZRUNYLUWXDOL]DWLRQLVDSSOLHG
PRUH LVVXHV IRU PDQXDO QHWZRUN RSHUDWLRQ DV WKH LWZLOOEHSRVVLEOHWRLQFUHDVHRUUHGXFHWKHQXPEHU
ORJLFDO QHWZRUN FRQILJXUDWLRQ XVHG IRU VHUYLFH RI 90V XVHG DV 1( HTXLSPHQW DW DQ\ WLPH LI ,$
SURYLVLRQZLOOEHFRPHFRPSOLFDWHGGXHWRWKHXVHRI VHUYHUV DUH LQ SODFH DV KDUGZDUH 7KH QHWZRUN
PXOWLSOHYLUWXDOL]HGORJLFDOUHVRXUFHV UHVRXUFHVFDQEHFUHDWHGE\VRIWZDUHRSHUDWLRQRQO\
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
WRSUHGLFWERWKVKRUWORQJWHUPWUDIILFGHPDQGV$Q 8QGHUVXFKFLUFXPVWDQFHVLWLVQHFHVVDU\WRUHDOL]H
H[DPSOH RI $,GULYHQ WUDIILF GHPDQG SUHGLFWLRQ LV DVHUYLFHPRQLWRULQJV\VWHPWKDWLVDEOHWRGHWHFWWKH
VKRZQLQ)LJ TXDOLW\ FORVH WR ZKDW FXVWRPHUV DUH DFWXDOO\
H[SHULHQFLQJ HVWLPDWLQJ LW IURP WKH QHWZRUN GDWD
,QSXW WUDIILF LQIRUPDWLRQ DQG GDWH DQG WLPH LQGHSHQGHQWRIDODUPLQIRUPDWLRQ,PDJHRI6HUYLFH
LQIRUPDWLRQRIHYHQWVLQHDFKDUHDDVWKHGDWDIRU PRQLWRULQJLVVKRZQLQ)LJ
$,OHDUQLQJ 7KLVFDQEHDFKLHYHGE\FROOHFWLQJYDULRXVGDWDIURP
+DYH $, OHDUQ ORQJWHUP WUDIILF LQFUHDVH WKHQHWZRUNLQFOXGLQJHTXLSPHQWDODUPLQIRUPDWLRQ
WHQGHQFLHV H[FOXGLQJ WHPSRUDU\ WUDIILF VXUJHV DQGLQWHJUDWLQJWKHPLQWRWKHELJGDWDIRUPXOWLDQJOH
VXFK DV WKRVH GXULQJ HYHQWV IRU JHQHUDWLRQ RI DQDO\VLV$,DQDO\VLV
ORQJWHUP WUDIILF GHPDQG SUHGLFWLRQ PRGHO ,I VHUYLFH PRQLWRULQJ LV UHDOL]HG WKH PDLQWHQDQFH
)XUWKHUPRUH KDYH $, OHDUQ WKH FRUUHODWLRQ SURFHVVZLOOEHLQQRYDWHGIURPIDFLOLW\PDLQWHQDQFH
EHWZHHQWKHWLPHRIHYHQWVDQGWHPSRUDU\WUDIILF FHQWHUHG RQ GHYLFH DODUP WR QHWZRUN TXDOLW\
VXUJHVPHQWLRQHGDERYHWROHDUQWKHRFFXUUHQFH PDLQWHQDQFHEDVHGRQFXVWRPHUH[SHULHQFH7DNLQJ
WHQGHQFLHV WLPLQJ LQFUHPHQW RI VKRUWWHUP WKH LQLWLDO UHDFWLRQ DPRXQW IRU H[DPSOH LQ WKH
WUDIILF LQFUHDVHV GXH WR HYHQWV HWF IRU FRQYHQWLRQDOPHWKRGLWFRUUHVSRQGVWRWKHQXPEHU
JHQHUDWLRQ RI WHPSRUDU\ WUDIILF GHPDQG RI DODUPV QRWLILHG IURP WKH QHWZRUN :KLOH LQ WKH
SUHGLFWLRQPRGHO VHUYLFH PRQLWRULQJ PHWKRG LW FRUUHVSRQGV WR WKH
+DYH$,RXWSXWORQJVKRUWWHUPWUDIILFGHPDQG QXPEHURILQIOXHQFHVRQFXVWRPHUVHUYLFHFDXVHGE\
SUHGLFWLRQPRGHOVIRUHDFKDUHD WKH HTXLSPHQW IDLOXUH ZKLFK LV H[SHFWHG WR EH
UHGXFHGGUDVWLFDOO\
5HJDUGLQJWKHZRUNORDGRIIL[LQJWKHIDLOXUHIURPWKH
PDLQWHQDQFH YLHZSRLQW VLQFH WKH QHFHVVLW\ RI
UHSDLULQJ WKH HTXLSPHQW LV LUUHOHYDQW WR WKH VHUYLFH
HIIHFWRFFXUUHQFHWKHUHZLOOQRWEHDJUHDWGLIIHUHQFH
LQ WKH PDLQWHQDQFH ZRUNORDG ,Q WKH PDLQWHQDQFH
SURFHVV WKHUH LV DOVR D SRVVLELOLW\ WR DUUDQJH WKH
PDLQWHQDQFHDXWRPDWLFDOO\E\FRQYHUWLQJWKHGHYLFH
)LJ3URFHVVRIWUDIILFGHPDQGSUHGLFWLRQZLWK$,
DODUP LQIRUPDWLRQ DQG ZRUN ORJ LQWR ELJ GDWD IRU
3.2. Approach to applying AI to maintenance PDFKLQHOHDUQLQJ
process
7KLV VHFWLRQ H[SODLQV WKH DSSOLFDWLRQ RI $, WR
QHWZRUNPRQLWRULQJQHWZRUNDEQRUPDOLW\GHWHFWLRQ
3.2.1. Application of AI to network monitoring
3.2.1.1. Necessity of service monitoring
$VGHVFULEHGLQFODXVHWKHQHWZRUNPDLQWHQDQFH
SURFHVVZLOOEHFRPHFRPSOLFDWHG$ERYHDOOLWZLOO )LJ,PDJHRI6HUYLFHPRQLWRULQJPHWKRG
EH PXFK PRUH GLIILFXOW WR DQDO\]H DQG JUDVS WKH
LPSDFW RQ FXVWRPHU VHUYLFHV DFFXUDWHO\ LQ WKH 3.2.1.2. Application of AI to service monitoring
QHWZRUN PRQLWRULQJ SURFHVV LQ ZKLFK VSHHG LV WKH
NH\ ,Q RUGHU WR UHDOL]H WKH QHWZRUN VHUYLFH PRQLWRULQJ
:LWK WKH FRQYHQWLRQDO PHWKRG RI LGHQWLI\LQJ WKH EDVHG RQ FXVWRPHU H[SHULHQFH LQGHSHQGHQW RI
LPSDFWRQFXVWRPHUVHUYLFHVIURPHTXLSPHQWDODUP HTXLSPHQWDODUPLQIRUPDWLRQDPHWKRGRIDQDO\VLV
LQIRUPDWLRQLWLVGLIILFXOWWRLGHQWLI\WKHLPSDFWZKHQ WKDWFRQVLVWVRIWKHIROORZLQJWZRVWDJHVFDQEHXVHG
QR DODUP LV JLYHQ DQG LQIRUPDWLRQ LV LQVXIILFLHQW
HVSHFLDOO\LQWKHFDVHRIVLOHQWDODUPV $ +DYH $, DQDO\]H WKH QHWZRUN GDWD DQG
,QDGGLWLRQDVWKHFRQYHQWLRQDOPHWKRGRIWHQUHOLHV HVWLPDWH WKH LQGH[ ZKLFK FDQ H[SUHVV WKH
RQ WKH VNLOO DQG H[SHUWLVH RI PDLQWHQDQFH VWDII TXDOLW\ RI FXVWRPHU H[SHULHQFH 4R( IRU
VRPHWLPHV WKH LPSDFW RQ VHUYLFH FDQQRW EH HDFKVHUYLFH>@
UHDVRQDEO\JUDVSHGIURPWKHVWDQGSRLQWRIFXVWRPHU % &ROOHFWWKHHVWLPDWHG4R(IRUHDFKVHUYLFH
H[SHULHQFH SURYLVLRQDUHDFHOOH1%DUHDDQGKDYH$,
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
OHDUQWKHIHDWXUHYDOXHRIGLVWULEXWLRQ+DYH 7KHIROORZLQJVWHSVH[SODLQWKHPHWKRGRIXVLQJ$,
$,GHWHFWDQ\XQXVXDOVWDWHGHWHULRUDWLRQRI DQDO\VLV WR HVWLPDWH WKH DSSOLFDWLRQ 4R6 IURP WKH
QHWZRUNTXDOLW\EDVHGRQWKHIHDWXUHYDOXH QHWZRUN4R6REWDLQDEOHIURPWKHQHWZRUNXVLQJWKH
DQG PDNH D MXGJHPHQW RQ WKH GLVWULEXWLRQ ORDGLQJ WLPH RI ZHE DFFHVV DV DQ H[DPSOH
VWDWHWRGHFLGHZKHWKHULWLVGLIIHUHQWIURP +HUHLQDIWHU4R(PHDQVDSSOLFDWLRQ4R6
WKHXVXDOVWDWHRUQRW>@>@
0HDVXUH DQGDFTXLUH LQIRUPDWLRQ RQWKHDFWXDO
7KHLOOXVWUDWLRQRIWKHSURSRVHGPHWKRGLVVKRZQLQ ZHESDJHORDGLQJWLPHE\WKHWHVWWHUPLQDOHWFDV
)LJ WUDLQLQJGDWD
&ROOHFW FRPPXQLFDWLRQ TXDOLW\ LQIRUPDWLRQ DW
QHWZRUN OHYHO REVHUYDEOH RQ WKH QHWZRUN
WKURXJKSXW HWF RU HTXLSPHQW WUDIILF
LQIRUPDWLRQ VWDWLVWLFDO YDOXHV VXFK DV WKH
QXPEHU RI HVWDEOLVKHG FRQQHFWLRQV IRU HDFK
HTXLSPHQW XQLW +DYH $, OHDUQ WKH
LQIRUPDWLRQ¶V FRUUHODWLRQ ZLWK WKH ZHESDJH
ORDGLQJWLPHPHQWLRQHGDERYHLQDQGGHWHFW
KLJKO\FRUUHODWHG LQIRUPDWLRQ IURP WKH ZHE
DFFHVVVHVVLRQLQIRUPDWLRQDQGHTXLSPHQWWUDIILF
LQIRUPDWLRQ7KHQKDYH$,JHQHUDWHDQDQDO\VLV
PRGHO $, PRGHO IRU FDOFXODWLQJ DQ HVWLPDWHG
YDOXH RI ZHESDJH ORDGLQJ WLPH XVLQJ KLJK
FRUUHODWHG LQIRUPDWLRQ LQ RWKHU ZRUGV
LQIRUPDWLRQ ZKLFK FDQ EH DFTXLUHG RQ WKH
)LJ$SSO\$,WRVHUYLFHPRQLWRULQJPHWKRG QHWZRUNVLGH
8VLQJ WKH JHQHUDWHG $, PRGHO HVWLPDWH WKH
7KH TXDOLW\ RI FXVWRPHU H[SHULHQFH 4R( ZHESDJHORDGLQJWLPHIURPWKHFRPPXQLFDWLRQ
HVWLPDWLRQ DQG VHUYLFH DEQRUPDOLW\ GHWHUPLQDWLRQ TXDOLW\ LQIRUPDWLRQ DW D QHWZRUN OHYHO
PHWKRGVDUHGHVFULEHGEHORZ WKURXJKSXW HWF RU HTXLSPHQW WUDIILF
LQIRUPDWLRQ
(A) (QoE) estimation
4R( LV DQ LQGH[ RI FXVWRPHUV¶ VXEMHFWLYH IHHOLQJ 7KH H[SODQDWLRQ DERYH XVHV DQ H[DPSOH RI
FRPIRUWDEOH FOHDQ HWF ZKLFK LV GLIILFXOW WR FRPPXQLFDWLRQTXDOLW\LQZKLFK4R(LVGLIILFXOWWR
PHDVXUHGLUHFWO\RQWKHQHWZRUN PHDVXUH,QFRQWUDVWZKHQWKHFRQQHFWLRQTXDOLW\LV
7KHUHIRUHZHXVHDQRWKHUTXDOLW\LQGH[IRUH[DPSOH GHWHUPLQHGVLPSO\E\ZKHWKHUWKHFRQQHFWLRQLV2.
DQ DSSOLFDWLRQ TXDOLW\ RI VHUYLFH 4R6 VXFK DV VXFFHVVIXO RU 1* XQVXFFHVVIXO VXFK QHWZRUN
ZHESDJHORDGLQJWLPHDVDQDOWHUQDWLYHIRU4R($V LQIRUPDWLRQ GLVFRQQHFWLRQ LQIRUPDWLRQ FDQ EH
LWLVDOVRGLIILFXOWWRPHDVXUHWKHDSSOLFDWLRQ4R6RQ GLUHFWO\ DSSOLHG DV WKH 4R( LQGH[ ,Q WKLV FDVH $,
WKH QHWZRUN GLUHFWO\ ZH HVWLPDWH WKH DSSOLFDWLRQ DQDO\VLVLVQRWQHFHVVDULO\QHHGHGIRUHVWLPDWLQJ4R(
4R6IURPWKHQHWZRUN4R67&3WKURXJKSXWHWF
ZKLFKFDQEHPHDVXUHGRQWKHQHWZRUNDQGXVHWKH
HVWLPDWHG DSSOLFDWLRQ 4R6 DV D VXEVWLWXWH RI 4R(
)LJ
)LJ3URFHVVRI4R(HVWLPDWLRQZLWK$,
(B) QoE anomaly analysis
8VLQJWKHIROORZLQJVWHSVZHH[SODLQVHUYLFHTXDOLW\
DEQRUPDOLW\ DQDO\VLV LQ ZKLFK TXDOLW\ GHJUDGDWLRQ
)LJ5HODWLRQEHWZHHQ4R6DQG4R( FDXVHGE\WKHQHWZRUNLVGHWHFWHGEDVHGRQWKH4R(
LQGH[RXWSXWLQ$
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
Layer 3: (DFKQRGHLVFRQVWDQWLQWKLVOD\HUZLWKWKH
RXWSXWJLYHQE\
௪
ܮଷ ൌ ݓ ൌ σ ǡ ݅ ൌ ͳǡʹ
௪
Layer 4: 7KHDGDSWDEOHRXWSXWRIWKLVOD\HULVJLYHQE\
ܮସ ൌ ݓ ݂ ൌ ݓ ሺ ݔ ݍ ݕ ݎ ǡ ݅ ൌ ͳǡʹ
Layer 5: 7KHRXWSXWRIWKLVOD\HULVWKHVXPPDWLRQRI
DOOLQFRPLQJVLJQDOVDQGLVJLYHQE\
σ௪
ܮ௦ ൌ σଶୀଵ ݓ ݂ ൌ σ
௪
)LJ1HXURIX]]\VWUXFWXUH
5XOH
7KHRSWLPL]DWLRQPHWKRGXVHGIRUWUDLQLQJWKHQHWZRUN
LQWKLVZRUNLVWKHK\EULGPHWKRGZKLFKFRPELQHVERWK
,Ix LV$DQGy LV%WKHQf1 = p1x + q1y + r1
WKH EDFN SURSDJDWLRQ JUDGLHQW GHVFHQW DOJRULWKP DQG
WKH OHDVW VTXDUH HUURUV HVWLPDWH XVHG WR HVWDEOLVK WKH
5XOH
LQSXW DQG RXWSXW SDUDPHWHUV UHVSHFWLYHO\ 7KH RXWSXW
SDUDPHWHUV DUH DGMXVWHG ILUVW XVLQJ WKH OHDVW VTXDUHV
,Ix LV$DQGy LV%WKHQf2 = p2 x + q2y + r2 DOJRULWKP DQG WKRVH RI LQSXW SDUDPHWHUV E\ EDFN
SURSDJDWLQJ WKH IDXOWV IURP WKH RXWSXW XVLQJ WKH
Layer 1: $QRGHLQWKLVOD\HULVDGDSWDEOHDQGLVJLYHQ JUDGLHQWGHVFHQWPHWKRGXQWLOWKHWUDLQLQJLVFRPSOHWHG
DV
3. RESULTS AND DISCUSSION
ܮଵ ൌ Ɋܣ ሺݔሻ݅ ൌ ͳǡ ʹ
)LJV WR VKRZ WKH JUDSKLFDO GHSLFWLRQ RI WKH
x LV WKHLQSXWWR ith QRGHAi LV WKH DOWHUDEOH ODQJXDJH PHDVXUHG DQG SUHGLFWHG SDWK ORVVHV DV D IXQFWLRQ RI
UHODWHGWRWKLVQRGHDQGWKHPHPEHUVKLSIXQFWLRQRI Ai GLVWDQFH IRU HDFK RI WKH IRXU URXWHV FRQVLGHUHG ,W LV
LVȝAi(x) DQGQRUPDOO\WDNHQ DV ZRUWKSRLQWLQJRXWWKDWIURPWKHILJXUHVWKHSUHGLFWLRQ
E\WKH1)PRGHOLQDOOWKHIRXUURXWHVSHUIRUPHGWKH
ଵ
Ɋܣ ሺݔሻ ൌ ೣష మ EHVWDPRQJDOOWKHFRQVLGHUHGPRGHOVDVLWPLPLFNHG
ଵାሾሺ ሻ ሿ
WKHPHDVXUHGGDWD,Q)LJWKHYDULDWLRQRISDWKORVV
ZLWKGLVWDQFHIRU0857$/$DORQJWKHURXWHDQGWKH
^di, ei, fi` LV WKH DQWHFHGHQW SDUDPHWHUV VHW (TQ SUHGLFWLRQV RI WKH IRXU HPSLULFDO PRGHOV ZHUH
UHSUHVHQWV WKH JHQHUDOL]HG EHOO PHPEHUVKLS IXQFWLRQ VXSHULPSRVHGRQWKHPHDVXUHGORVV7KH(JOL&267
0) ZKLFK ZDV FKRVHQ IRU WKLV ZRUN EHFDXVH LW DQG +DWD PRGHOV XQGHUSUHGLFWHG WKH SDWK ORVV
SURGXFHGWKHEHVWDFFXUDF\ZKHQFRPSDUHGWRWKHRWKHU WKURXJKRXW WKH PHDVXUHPHQW URXWH H[FHSW ZLWKLQ
PHPEHUVKLSIXQFWLRQV NPZKHUHWKH+DWDPRGHOSURYLGHGJRRGILWQHVV
7KH(&&PRGHOJHQHUDOO\IOXFWXDWHGEHWZHHQRYHU
Layer 2: 7KLV OD\HU FRPSULVHV RI IL[HG QRGHV DQG LW DQGXQGHUSUHGLFWLRQRIWKHSDWKORVVHVZLWKUHVSHFWWR
VROYHVWKHILULQJSRZHUwi RIDUXOH7KHPXOWLSOLFDWLRQ WKH PHDVXUHG SDWK ORVVHV $ORQJ WKLV URXWH LW FDQ EH
RIWKHLQFRPLQJVLJQDOVLVWKHRXWSXWRIHDFKQRGHDQG FRQFOXGHGWKDWWKH(JOLPRGHOKDVWKHZRUVWSUHGLFWLRQ
LVJLYHQE\ ZLWK D PHDQ HUURU RI í G% ZKHQ FRPSDUHG WR
íG%IRUWKH(&&PRGHODQGí(G%IRU
ܮଶ ൌ ݓ ൌ Ɋ݅ܣሺݔሻ ൈ Ɋ݅ܤሺݕሻǡ ݅ ൌ ͳǡʹ WKH QHXURIX]]\ PRGHO 7KH PHDQ HUURU IRU WKH 1)
PRGHOLVLQVLJQLILFDQWDQGWKLVUHVXOWLQGLFDWHGWKHJRRG
^p, q and r `LVWKHFRQVHTXHQWSDUDPHWHUVVHWZKLFKDUH ILWQHVVRIWKHPRGHODORQJWKLVURXWH
HVWDEOLVKHGE\WKHOHDVWVTXDUHVPHWKRG
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
)LJ &RPSDULVRQRI1)PRGHOSDWKORVVZLWKPHDVXUHG
SDWKORVVDQGRWKHUHPSLULFDOPRGHOVSDWKORVVIRUWKH
0857$/$ URXWH
)LJ &RPSDULVRQRI1)PRGHOSDWKORVVZLWKPHDVXUHG
)LJGHSLFWVWKHUHVXOWIRUWKH3,3(/,1(URXWH$JDLQ SDWKORVVDQGRWKHUHPSLULFDOPRGHOVSDWKORVVIRUWKH
2/'-(%%$URXWH
WKH (&& PRGHO JDYH RSWLPXP SUHGLFWLRQ XS WR
NP WKHUHDIWHU LW RYHUHVWLPDWHG WKH SDWKORVVHV ZKLOH )URP WKH ILJXUHV LW ZDV REVHUYHG WKDW WKH 1) PRGHO
WKH +DWD PRGHO SURYLGHG JRRG ILWQHVV DW GLVWDQFHV SURYLGHGEHWWHUSUHGLFWLRQDVLWIROORZHGWKHPHDVXUHG
DERYH NP 2WKHU PRGHOV XQGHUHVWLPDWHG WKH SDWK ORVVHV,Q7DEOHWKHVWDWLVWLFDODQDO\VLVRIWKHHUURUV
ORVVHV WKURXJKRXW WKH PHDVXUHPHQW GLVWDQFHV ,Q IRUHDFKPRGHODFURVVDOOWKHURXWHVLVSURYLGHG7DEOH
)LJXUHV DQG WKH (&& PRGHO SURYLGHG JRRG VKRZVKRZHDFKRIWKHPRGHOVSHUIRUPHGLQWHUPVRI
ILWQHVV ZKLOH DOO RWKHU HPSLULFDO PRGHOV WKHLU506(6&506(0(DQG6'(506(EHWZHHQ
XQGHUHVWLPDWHGWKHORVVHVZLWKYDULRXVRIIVHWYDOXHV G%LVFRQVLGHUHGDFFHSWDEOHIRUXUEDQDUHDV>@
DOWKRXJK IRU W\SLFDO VXEXUEDQ DQG UXUDO DUHDV XS WR
G%>@FDQVWLOOEHDFFHSWDEOH
)RUWKH506(DQG0(WKH1)PRGHOLVWKHORZHVWLQ
DYHUDJH DFURVV DOO WKH URXWHV ZLWK G% DQG
íG%UHVSHFWLYHO\ZKLFKSURYHGWREHWKH
ILWWHVWDPRQJDOOWKHPRGHOV7KHVHYDOXHVIHOOZLWKLQ
WKH DFFHSWDEOH UDQJH IRU XUEDQ HQYLURQPHQWV DQG DV
VXFK WKH PRGHO GLG QRW HLWKHU XQGHUHVWLPDWH RU
RYHUHVWLPDWH WKH ORVVHV DV WKH 0( ZDV IRXQG WR EH
LQVLJQLILFDQW7KH(&&PRGHOJDYHWKHOHDVWYDOXHV
ZKHQFRPSDUHGWRRWKHUHPSLULFDOPRGHOV7KHDYHUDJH
506(DQG0(ZHUHG%DQGG%UHVSHFWLYHO\
DOWKRXJKWKH506(ZDVIRXQGWREHDELWKLJKHUWKDQ
WKHWKUHVKROGOLPLWIRUXUEDQHQYLURQPHQWVDQGWKH0(
FOHDUO\ LQGLFDWHG WKDW WKH PRGHO XQGHUHVWLPDWHG WKH
)LJ &RPSDULVRQRI1)PRGHOSDWKORVVZLWKPHDVXUHG
ORVVHV6XUSULVLQJO\WKLVPRGHOZDVGHYHORSHGWRVXLW
SDWKORVVDQGRWKHUHPSLULFDOPRGHOVSDWKORVVIRUWKH IL[HGZLUHOHVVV\VWHPVDQGUHFRPPHQGHGIRU(XURSHDQ
3,3(/,1(URXWH FLWLHV EXW LV IRXQG WR SURYLGH RSWLPXP SUHGLFWLRQV
ZKHQFRPSDUHGWRRWKHUFRQWHQGLQJHPSLULFDOSDWKORVV
SURSDJDWLRQPRGHOV
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
7DEOH3HUIRUPDQFHPHWULFVIRUWKHPHDVXUHPHQWURXWHV
ROUTES
MODEL OGBOMOSO MURTALA PIPELINE OLD AVERAGE
JEBBA
506(G%
1) 6&506(G%
0(G% í( í( í( í( í(
6'(G%
506(G%
6&506(G%
&267
0(G% í í í í í
6'(G%
506(G%
6&506(G%
+$7$
0(G% í í í í í
6'(G%
506(G%
6&506(G%
(*/, 0(G% í í í í í
6'(G%
506(G%
6&506(G%
(&&
0(G% í í
6'(G%
'HVSLWHWKHIDFWWKDWWKHV\VWHPSDUDPHWHUVVXFKDVWKH WRDQRLV\OLQN)RURWKHUPRGHOVWKH6&506(ZDV
RSHUDWLQJ IUHTXHQF\ KHLJKW RI WKH WUDQVPLWWHU DQG YHU\ VLJQLILFDQW DV WKHLU UHVSHFWLYH PHDQ SUHGLFWLRQ
GLVWDQFH RI WKH PHDVXUHPHQW URXWHV IHOO ZLWKLQ WKH HUURUV ZHUH TXLWH KLJK 7KH SUHGLFWLRQ HUURUV DV D
YDOLGLW\RIWKH+DWD&267DQG(JOLPRGHOVWKH IXQFWLRQRIUDGLDOGLVWDQFHIURPWKHWUDQVPLWWHUIRUHDFK
PRGHOVSHUIRUPHGZRHIXOO\ZLWKDQ506(DQG0(RI URXWH ZHUH HTXDOO\ LQYHVWLJDWHG DQG WKH UHVXOWV DUH
G%DQGíG%G%DQGíG%DQG SUHVHQWHGLQ)LJXUHVWR
G% DQG í G% UHVSHFWLYHO\ 7KH DYHUDJH
VWDQGDUG GHYLDWLRQ HUURU 6'( IRU WKH 1) PRGHO LV ,Q)LJLWZDVREVHUYHGWKDWWKHVKDGRZLQJHIIHFWVRQ
G% ZKLOH G% G% G% DQG WKH3(IRUWKH1)PRGHODORQJWKH0857$/$URXWH
G%IRU&267+DWD(JOLDQG(&&PRGHOV DV WKH 3( XQGXODWHG DORQJ WKH G% EDVHOLQH ZLWK D
UHVSHFWLYHO\ +RZHYHU WKH H[FHOOHQW SHUIRUPDQFH RI YDU\LQJGHJUHHRILPSDFWGXHWRGLIIHUHQWFOXWWHUW\SHV
WKH1)LQWHUPVRIWKHPHDQSUHGLFWLRQHUURUDQG506( DORQJWKHURXWH2WKHUPRGHOVDOVRXQGXODWHGEXWZLWK
PD\QRWEHRYHUHPSKDVL]HGDVWKHURXWHVSHFLILF6'(V KLJK DPSOLWXGHV RI 3( ZLWK YDU\LQJ RIIVHWV
ZHUH G% G% G% DQG G% IRU ,QWHUHVWLQJO\DOOWKHHPSLULFDOPRGHOVWHQGWRKDYHKLJK
2*%20262 0857$/$ 3,3(/,1( DQG 2/' SUHGLFWLRQ HUURUV EHWZHHQ WKH NP GLVWDQFH DQG
-(%%$URXWHV7KHVHDUHTXLWHKLJKDQGWKLVLVEHFDXVH ZKLFKLVGXHWRWKHLULQLWLDORIIVHWYDOXHVIRUWKHPRGHOV
WKH PRGHO PLPLFNHG WKH PHDVXUHG GDWD DQG WKH %HWZHHQ NP WKH 3(V RI &267 DQG +DWD
GHYLDWLRQVDUHQRWLFHDEOHDORQJHDFKURXWHZLWKYDU\LQJ PRGHOVZHUHFORVHWRWKHG%EDVHOLQHWKLVFRQIRUPHG
GHJUHH RI FOXWWHU HIIHFWV )XUWKHUPRUH LQ WHUPV RI WRWKHHDUOLHUILQGLQJVUHSRUWHGLQ)LJ7KH(&&
6&506( QR VLJQLILFDQW LPSDFWV ZHUH REVHUYHG IRU PRGHOSURYLGHGWKHOHDVWHUURUVZKHQFRPSDUHGWRRWKHU
WKH1)PRGHOZKHQFRPSDUHGWR506(DSDUWIURPWKH HPSLULFDO PRGHOV EXW ZLWK D KLJK SUHGLFWLRQ HUURU
0857$/$URXWH2UGLQDULO\6&506(QHJDWHVWKH ZLWKLQDQGNP
LPSDFWRIGLVSHUVLRQIURPWKHRYHUDOOHUURUVDWWULEXWHG
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
)LJ &RPSDULVRQRI1)PRGHOSUHGLFWLRQHUURUVZLWK
RWKHUHPSLULFDOPRGHOVSUHGLFWLRQHUURUVIRUWKH
)LJ &RPSDULVRQRI1)PRGHOSUHGLFWLRQHUURUVZLWK
0857$/$URXWH
RWKHUHPSLULFDOPRGHOVSUHGLFWLRQHUURUVIRUWKH2/'
-(%%$URXWH
*HQHUDOO\WKH1)PRGHOFDQEHVDLGWRKDYHWKHEHVW
3(LQDOOWKHURXWHVDPRQJWKHFRQVLGHUHGPRGHOVDVLW
ZDYHUHGFORVHWRWKHG%OLQHEHWZHHQRYHUDQGXQGHU
SUHGLFWLRQ LQ D XQLIRUP PDQQHU WKURXJKRXW WKH
GLVWDQFHV 7KH UHVXOW REWDLQHG LQ )LJ IRU WKH
2*%20262URXWHVKRZHGWKDWWKH3(VIRUWKH(JOL
DQG&267DUHDOPRVWVLPLODU7KH\ODUJHO\XQGHU
SUHGLFWHGDQGVKRZHGVOLJKWRYHUSUHGLFWLRQVEHWZHHQ
NP DQG NP 7KH 1) DQG WKH (&&
PRGHOV¶SUHGLFWLRQVDUHVLPLODUDV ZHOO
)LJ &RPSDULVRQRI1)PRGHOSUHGLFWLRQHUURUVZLWK
RWKHUHPSLULFDOPRGHOVSUHGLFWLRQHUURUVIRUWKH
3,3(/,1(URXWH
,Q)LJLWZDVVKRZQWKDWWKH1)PRGHOSURYLGHGWKH
OHDVW3(DORQJWKHURXWH+RZHYHUWKH(&&PRGHO
WULHG WR HPXODWH WKH 1) PRGHO DVLGH WKH LQLWLDO VSLNH
EHWZHHQNPDQGd!NPZKLOHDOORWKHUPRGHOV
FRQYHUJHGWRZDUGVWKHG%EDVHOLQHDIWHUZDUGV7KH
VLWXDWLRQLQ)LJVDQGZHUHTXLWHGLIIHUHQWDVVHYHUH
FOXWWHUHIIHFWVRQWKH3(ZHUHQRWLFHDEOHZLWKVHYHUDO
VSLNHVDORQJWKHURXWHV
)LJ &RPSDULVRQRI1)PRGHOSUHGLFWLRQHUURUVZLWK
RWKHUHPSLULFDOPRGHOVSUHGLFWLRQHUURUVIRUWKH
2*%20262URXWH
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
(PSLULFDO 3DWK /RVV 0RGHOV LQ 9+) DQG 8+) 7HFKQLTXHV RI $XWRPDWLF &RQWURO DQG
%DQGV,QSURF,(((,QWHUQDWLRQDO&RQIHUHQFHRQ &RPSXWHU (QJLQHHULQJ67$ 7XQLVLD
,QIRUPDWLRQ DQG &RPPXQLFDWLRQ 6\VWHPV SS'HFHPEHU
-RUGDQ$SULO±SS
>@(' 7XUNDQ <+ %HUQD $ $\VHQ ³)X]]\
>@1)DUXN$$$GHVHNR<$$GHGLUDQ³2QWKH $GDSWLYH 1HXUDO 1HWZRUN $SSURDFK WR 3DWK
6WXG\ RI (PSLULFDO 3DWK /RVV 0RGHOV IRU /RVV 3UHGLFWLRQ LQ 8UEDQ $UHDV DW *60
$FFXUDWH3UHGLFWLRQRI796LJQDOIRU6HFRQGDU\ EDQG´YRO1RSS
8VHUV´ 3URJUHVV LQ (OHFWURPDJQHWLF 5HVHDUFK
3,(5%YROSS >@&'-RHO3'(OPHU³1HXUDO1HWZRUN%DVHG
3DWK/RVV3UHGLFWLRQIRU'LJLWDO790DFURFHOOV´
>@6, 3RSRROD $$ $WD\HUR 1 )DUXN &7 WK ,((( ,QWHUQDWLRQDO &RQIHUHQFH +XPDQRLG
&DODIDWH /$ 2ODZR\LQ DQG 92 0DWWKHZV 1DQRWHFKQRORJ\ ,QIRUPDWLRQ 7HFKQRORJ\
³6WDQGDUG3URSDJDWLRQ0RGHO7XQLQJIRU &RPPXQLFDWLRQDQG&RQWURO(QYLURQPHQWDQG
3DWK /RVV 3UHGLFWLRQV LQ %XLOW8S 0DQDJHPHQW +1,&(0 3KLOOLSLQHV
(QYLURQPHQWV´ LQ International Conference on 'HFHPEHU
Computational Science and Its Applications
SS >@$5 2]GHPLU 0XVWDSKD $ONDQ 0HKPHW
>@6, 3RSRROD $$ $WD\HUR 1 )DUXN &7 .DEDN0*XOVHQ0+6D]OL³7KH3UHGLFWLRQ
&DODIDWH($GHWLEDDQG920DWWKHZV RI3URSDJDWLRQ/RVVRI)05DGLR6WDWLRQ8VLQJ
³&DOLEUDWLQJ WKH 6WDQGDUG 3DWK /RVV 0RGHO IRU $UWLILFLDO 1XHUDO 1HWZRUN´ -RXUQDO RI
8UEDQ(QYLURQPHQWVXVLQJ)LHOG0HDVXUHPHQWV (OHFWURPDJQHWLF $QDO\VLV DQG $SSOLFDWLRQV
DQG *HRVSDWLDO 'DWD´ LQ /HFWXUH 1RWHV LQ YROSS
(QJLQHHULQJDQG&RPSXWHU6FLHQFH3URFHHGLQJV
RI 7KH :RUOG &RQJUHVV RQ (QJLQHHULQJ >@5XSDQZLWD 'DV0DKDSDWUD ³2SWLPDO 3RZHU
-XO\ /RQGRQ 8. SS &RQWURO IRU &RJQLWLYH 5DGLR LQ 6SHFWUXP
'LVWULEXWLRQ8VLQJ$1),6´,(((
>@1 )DUXN $$$\HQL <$ $GHGLUDQ DQG 17 >@* 9LVKDO 6& 6KDUPD ³6HFXUH 3DWK /RVV
6XUDMXGHHQ%DNLQGH ³,PSURYHG 3DWK 3UHGLFWLRQ LQ)ULQJH $UHDV 8VLQJ)X]]\ /RJLF
/RVV 0RGHO IRU 3UHGLFWLQJ '79 &RYHUDJH IRU $SSURDFK´ ,((( ,QWHUQDWLRQDO &RQIHUHQFH RI
6HFRQGDU\ $FFHVV´ ,QW - :LUHOHVV DQG 0RELOH $GYDQFHV LQ &RPSXWLQJ &RQWURO DQG
&RPSXWLQJ9RO1RSS 7HOHFRPPXQLFDWLRQ7HFKQRORJLHVSS
>@': .LÀH /& *LPHQH] % :HJPDQQ
,9LHULQJDQG$.OHLQ&RPSDULVRQDQG >@0- -DIUL -- (O\ DQG // 9DKDOD
([WHQVLRQ RI ([LVWLQJ ' 3URSDJDWLRQ 0RGHOV ³,QWHUIHUHQFH3DWK/RVV3UHGLFWLRQLQ$
ZLWK5HDO:RUOG(IIHFWV%DVHGRQ5D\7UDFLQJ $LUSODQHV 8VLQJ 0RGXODWHG )X]]\ /RJLF DQG
$%DVLVIRU1HWZRUN3ODQQLQJDQG2SWLPL]DWLRQ 1HXUDO1HWZRUNV´1$),36$QQXDO
:LUHOHVV 3HUVRQDO &RPPXQLFDWLRQ 0HHWLQJ RI WKH 1RUWK $PHULFDQ )X]]\
,QIRUPDWLRQ3URFHVVLQJ6RFLHW\6DQ'LHJR&$
SS
>@(*UHHQEHUJ (.ORG]K³&RPSDULVRQ
RI GHWHUPLQLVWLF HPSLULFDO DQG SK\VLFDO >@63 6RWLURXGLV 6. *RXGRV .$ *RWVLV .
SURSDJDWLRQ PRGHOV LQ XUEDQ HQYLURQPHQWV´ 6LDNDYDUD DQG -1 6DKDORV ³0RGHOLQJ E\
0LFURZDYHV &RPPXQLFDWLRQV $QWHQQDV DQG RSWLPDO $UWLILFLDO 1HXUDO 1HWZRUNV WKH
(OHFWURQLF 6\VWHPV &20&$6 ,((( SUHGLFWLRQ RI SURSDJDWLRQ SDWK ORVV LQ XUEDQ
3,05& ,((( WK ,QW 6\PS RQ HQYLURQPHQWV´ ,((($36 7RSLFDO
YROQRSS6HSW &RQIHUHQFH RQ $QWHQQDV DQG 3URSDJDWLRQ LQ
:LUHOHVV &RPPXQLFDWLRQV $3:& 7RULQR
>@$%7DPPD$5DEELH.60XVWDID³1HXUDO SS
1HWZRUN $SSURDFK WR 0RGHO WKH 3URSDJDWLRQ
3DWK/RVVIRU *UHDW7ULSROL $UHDDW >@-& 'HOD &UX] DQG )6 &DOX\R ³+HXULVWLF
DQG 0+] IUHTXHQF\ EDQGV´ WK PRGHOOLQJRIRXWGRRUSDWKORVVIRUPPDQG
,QWHUQDWLRQDO &RQIHUHQFH RQ 6FLHQFHV DQG P DQWHQQD DW 0+]´ ,(((
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
HQYLVLRQ PRUH HIILFLHQW XVH RI UHVRXUFHV IRU FRRUGLQDWLRQ RU PRUH LQWHUHVWHG LQ H[HUFLVLQJ
RSWLPL]LQJ WKH FRPPXQLFDWLRQ QHWZRUNV ZH KDYH GLVSURSRUWLRQDWH LQIOXHQFH JOREDOO\ WKH $*, ZRXOG
DYDLODEOH RU GHVLJQ DOWRJHWKHU QRYHO DQG EHWWHU SURYLGH VXFK D VWDWH DFWRU ZLWK D SRWHQWLDOO\
DUFKLWHFWXUHV LQFDOFXODEOHDGYDQWDJH
$V ZH GLVFXVV EHORZ WKH SRWHQWLDO GHYHORSPHQW RI &RQWHPSRUDU\ WUHQGV LQ YDULRXV QDWLRQV DFURVV WKH
$*, LV XQOLNHO\ WR EH DQ H[FOXVLYHO\ VWDWHIXQGHG JOREHHYLGHQFHDUHVXUJHQFHRIQDWLRQDOLVWLFWKHPHVLQ
DIIDLU&XUUHQWEUHDNWKURXJK$,V\VWHPVDOODSSHDUWR SROLWLFVZLWKHOHFWLRQVGHOLYHULQJJRYHUQDQFHWRWKRVH
EHSURGXFWVGHVLJQHGE\WHFKQRORJ\FRPSDQLHV ZKR SURPLVH D VWURQJHU QDWLRQ ³DERYH DOO HOVH´ 7KH
*LYHQWKHIDFWWKDWWHFKQRORJ\JLDQWVVXFKDV*RRJOH ZRUOGLVQRWSUHVHQWO\JHDUHGWRVXSSRUWDVLQJOHJOREDO
)DFHERRN DQG RWKHUV DUH EHJLQQLQJ WR RSHQVRXUFH FRPPXQLW\DQGLQDVHWXSZKHUHQDWLRQDOLVWLFLPSXOVHV
WKHLU PDFKLQHOHDUQLQJ WRROV HJ 7HQVRU)ORZ LW LV LQIOXHQFHERWKLQWUDQDWLRQDOSROLWLFVDQGJHRSROLWLFVLW
ZHOO ZLWKLQ WKH UHDOP RI SRVVLELOLW\ WKDW LV QHLWKHU UHDOLVWLF QRU SUXGHQW WR DVVXPH WKDW WKH
QRQFRPPHUFLDO QRQVWDWH DFWRUV LQFOXGLQJ DFKLHYHPHQWRI$*,E\DQ\VLQJOHVWDWHDFWRUZRXOGEH
LQGLYLGXDOVZRXOGEHDEOHWRGHYHORSDSSOLHGDUWLILFLDO EHQHILFLDOWRKXPDQLW\,WVWDQGVWRUHDVRQWKDWPXOWLSOH
LQWHOOLJHQFH VWDWH DFWRUV ZRXOG VHHN XQSUHFHGHQWHG VWUDWHJLF
DGYDQWDJH WKURXJK $*, ,I WKHUHLVQRFRPPHQVXUDWH
2.1. Actors in the AGI race GHYHORSPHQW RQ WKH JOREDO FRRUGLQDWLRQ SUREOHP
ZKLFK UHQGHUV WKH EDODQFH RI SRZHU VWDEOH WKLV
7KH GHYHORSPHQW RI $*, RU $*,V FRXOG EH GXH WR VFHQDULRZRXOGOHDGWRFDWDVWURSKH
WKH DFWLRQV RI PDQ\ DFWRUV DQG HDFK W\SH RI JHQHVLV
ZRXOG OLNHO\ EH OLQNHG WR WKH HPHUJHQFH RI ULVNV 2.1.2. Corporate actors
VKDSHG E\ WKH LQWHQWLRQV RI WKH DFWRUV WKH
FRUUHVSRQGLQJ FRUH REMHFWLYHV RI WKH $*, DQG WKH ,QGXVWU\ UHPDLQV WKH IDFH RI $, UHVHDUFK :LWK
FRQWH[W RI $*, GHSOR\PHQW +HUH ZH H[DPLQH PXOWLSOH FRUSRUDWH HQWLWLHV Y\LQJ WR GHYHORS WUXH
SRVVLEOH VFHQDULRV DV D IXQFWLRQ RI DFWRUV DQG DUWLILFLDOLQWHOOLJHQFHRUDUWLILFLDOJHQHUDOLQWHOOLJHQFH
OLNHOLKRRG WKHUHDOUHDG\LVDUDFHWRKDUQHVVWKHSRZHURI$,IRU
FRPPHUFLDO HQGV ZKLOVW RVWHQVLEO\ LPSDFWLQJ WKH
2.1.1. State actors ZRUOG SRVLWLYHO\ 5HFHQW FDOOV IRU UHVHDUFK RQ $,
VDIHW\ KDYH EHHQ PDGH E\ UHVHDUFKHUV DV ZHOO DV
6WDWHV IXQFWLRQ DV DJHQWVDFWRUV LQ WKH LQWHUQDWLRQDO OHDGHUV LQ WKH WHFK LQGXVWU\ 6XFK D FRQIOXHQFH RI
HQYLURQPHQWDQGSXUVXHSROLFLHVWKDWEHQHILWWKHPDV DFDGHPLF DQG FRUSRUDWHLQGXVWULDO FDPSV RQ
ZHOO DV WKHLU DOOLHV ZKLOVW SRWHQWLDOO\ PLWLJDWLQJ WKH H[LVWHQWLDO ULVN SRVHG E\ $, ERGHV ZHOOIRU UHVHDUFK
ULVNV SRVHG E\ VWDWHV WKDW DUH QRW DOOLHV RU QHXWUDO LI DQG GHYHORSPHQW RQ WKLV IURQW 7KDW VDLG WKH
QRW GLPLQLVKLQJ WKHLU LQIOXHQFH UHJLRQDOO\ FRPSHWLWLYHDQGWHFKQRORJLFDODGYDQWDJHSUHVHQWHGE\
LQWHUQDWLRQDOO\ *OREDO FRRUGLQDWLRQ UHPDLQV D QRQ DFKLHYLQJSULRULW\LQWKHGHYHORSPHQWRI$,LVOLNHO\WR
WULYLDOFKDOOHQJHDQGRQHWKDWLVQRWHDVLO\UHVROYHG LQFHQWLYL]H VRPH FRUSRUDWH DFWRUV WR FRPSURPLVH RQ
,PDJLQHWKURZLQJLQRQHVWDWHZKLFKVXGGHQO\KDGDQ VDIHW\ UHVXOWLQJ LQ XQUHJXODWHG XQVDIH GHYHORSPHQW
$*,2UDFOHWKDWFRXOGH[DPLQHVFHQDULRVH[KDXVWLYHO\ RI $,$*, 2QH LV UHPLQGHG RI WKH UHSRUWHG
IRUDQ\JLYHQVLWXDWLRQDFFHVVDOOUHOHYDQWLQIRUPDWLRQ GLVFUHSDQF\ EHWZHHQ PDQDJHPHQW DQG HQJLQHHULQJ
IURPSDVWVLWXDWLRQVRIWKHVRUWEHLQJFRQVLGHUHGDQG GLYLVLRQV DW 1$6$ RQ WKH ULVN DVVRFLDWHG ZLWK
JOHDQ LQVLJKWV IURP DFWLRQDEOH LQWHO DYDLODEOH WR WKH FRQWLQXHGRSHUDWLRQRIWKHVSDFHVKXWWOHDVGLVFXVVHG
KLJKHVWH[HFXWLYHLQWKHVWDWHWRJXLGHGHFLVLRQPDNLQJ LQ $SSHQGL[ ) RI WKH UHSRUW RQ WKH &KDOOHQJHU
,IWKH2UDFOHKDVQRLQIOXHQFHRQWKHZRUOGSK\VLFDOO\ H[SORVLRQ >@ $OVRVFLHQWLILF DQGHWKLFDOFRQVHQVXV
DQGWKHVWDWHFRQFHUQHGLVRQHZLWKPRUHWRJDLQIURP PD\ QRW EH VXIILFLHQW WR PRWLYDWH WHFKQRORJLFDOO\
D EHWWHU VROXWLRQ WR WKH JOREDO FRRUGLQDWLRQ SUREOHP FDSDEOH HQWHUSULVHV WR IRFXV RQ VDIHW\ SULRU WR
WKHLUXVHRIWKH2UDFOH¶VFRXQVHOZRXOGOLNHO\EHQHILW GHYHORSLQJ$,DFURVVWKHJOREH7KHSUREOHPRIJOREDO
KXPDQLW\ FRRUGLQDWLRQ ZRXOG UHPDLQ D IDFWRU WKDW ZRXOG
LQFUHDVH GHJUHHV RI IUHHGRP LQ DQ\ JLYHQ VFHQDULR
,WLVFRQFHLYDEOHWKDWWKLVPD\QRWEHWKHPRVWOLNHO\ ZKHUHDFWRUVLQWHUDFWLQWHUQDWLRQDOO\
VFHQDULR 3RZHUIXO WHFKQRORJ\ KDV RIWHQ EHHQ D
GULYLQJIRUFHLQWKHSXUVXLWRIDZRUOGRUGHUZKHUHWKH 2.1.3. Rogue actors
QDWLRQVWDWH ZLWK WKH WHFKQRORJ\ LQ TXHVWLRQ LV LQ D
SULYLOHJHGSRVLWLRQWRSXUVXHLWVREMHFWLYHV,IWKHVWDWH 8QOLNHRWKHUGDQJHURXVWHFKQRORJLFDOGHYHORSPHQWVLQ
LQTXHVWLRQLVOHVVLQWHUHVWHGLQDFKLHYLQJEHWWHUJOREDO KLVWRU\ $, EUHDNWKURXJKV PD\ QRW RFFXU H[FOXVLYHO\
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
LQ DFDGHPLF JRYHUQPHQWDO RU LQGXVWULDO FHQWHUV RI RIXWPRVWLPSRUWDQFH 7KH FXUUHQW QHDULPSRVVLELOLW\
UHVHDUFK ,Q SULQFLSOH SRZHUIXO $, V\VWHPV FRXOGEH RI XQLYHUVDO QXFOHDU GLVDUPDPHQW LV DQRWKHU
GHYHORSHGE\LQGLYLGXDOVRUJURXSVZLWKQRQDWLRQDORU ,QWHUQDWLRQDOFRQIOLFWLVQHYHUGHYRLGRIKXPDQFRVW,W
FRUSRUDWH DJHQGDV 6XFK homebrewed $, ZRXOG EH DSSHDUVWREHWKHFDVHWKDWVHYHUDOGHYHORSPHQWVLQWKH
KDUGWRGHDOZLWKSUHFLVHO\GXHWRDODFNRIRYHUVLJKW $, VHFWRU DUH OLNHO\ WR H[DFHUEDWH LQHTXLWLHV LQ WKH
PRQLWRULQJ RU FRQVHQVXV RQ DUFKLWHFWXUHV DQG EDUJDLQLQJ SRZHU RI QDWLRQV RQ WKH LQWHUQDWLRQDO
REMHFWLYHV 0RUH ZRUULVRPH LV WKH SURVSHFW RI VXFK VFHQH DV ZHOO DV WKHLU DELOLW\ WR DGPLQLVWHU FRHUFLYH
URJXH DFWRUV GHYHORSLQJ $, ZLWKRXW VDIHW\ IRUFHYLDDQ$,DXJPHQWHGPLOLWDU\*LYHQWKHODFNRI
FRQVLGHUDWLRQV RU ZLWK PDOLFLRXV LQWHQW IRU H[DPSOH YDOXH DOLJQPHQW ZLWKLQ KXPDQ JURXSV LW ZRXOG EH
VHH WKH FDVH RI FRPPHUFLDOO\ DYDLODEOH XQPDQQHG KLJKO\ SUXGHQW WR VHHN D VROXWLRQ WR WKLV SUREOHP LQ
DHULDO YHKLFOHV EHLQJ UHSXUSRVHGIRU JXHUULOOD ZDUIDUH SDUDOOHO ZLWK LI QRW SULRU WR ZRUNLQJ RQ $*, YDOXH
E\ WHUURU JURXSV >@ ,W FRXOG EH DUJXHG WKDW WKH DOLJQPHQW ,W LV WR EH QRWHG WKDW GLVFXVVLRQV RQ $*,
UHVRXUFHV UHTXLUHG WR GHYHORS D SRZHUIXO DQG WUXO\ HPHUJHQFHDQGJOREDOFRRUGLQDWLRQSRVLWWKHVFHQDULR
JHQHUDODUWLILFLDOLQWHOOLJHQFHPD\ QRW EH DYDLODEOH WR RI D VLQJOHWRQ RQH JOREDO JRYHUQLQJ HQWLW\ ZKLFK
URJXHDFWRUVEXWLWLVIDUIURPFOHDUWKDWWKLVZRXOGEH DSSHDUVPDUNHGO\OHVVOLNHO\WRKDSSHQUHODWLYHWRWKH
WKH FDVH DQG LW PD\ EH XQZLVH WR SUHVXPH WKDW DQ\ ELUWKLQJ RI DQ $*, ,Q DOO OLNHOLKRRG HYHQ WKH PRVW
VXFKREVWDFOHVZRXOGEHLQVXUPRXQWDEOH EHQLJQ$*,ZRXOGEHGHYHORSHGZLWKLQDZRUOGZKHUH
KXPDQJURXSVQDWLRQVWDWHVGRQRWVHHH\HWRH\HRQ
&\EHUDWWDFNV RULJLQDWLQJ IURP LQGLYLGXDOVVPDOO VHYHUDOFUXFLDOLVVXHV*LYHQWKLVLWZRXOGEHZLVHWR
JURXSV DUH FRPPRQSODFH LQ RXU LQFUHDVLQJO\ WHPSHUDQ\RSWLPLVPRQWKH$*,IURQWZLWKDKHDOWK\
LQWHUFRQQHFWHG ZRUOG DQG LW LV FRQFHLYDEOH WKDW WKH DSSUHFLDWLRQIRUULVNVVDIHW\FRQFHUQVDQGWKHQHHGWR
GHYHORSPHQW RI DQ DUWLILFLDO JHQHUDO LQWHOOLJHQFH E\ UHVSHFWUHDOLW\SDUWLFXODUO\ZLWKUHJDUGWRLQWHUQDWLRQDO
URJXH DFWRUV ZRXOG EH VLPLODU LQ WHUPV RI H[HFXWLRQ FRQIOLFWDQGKXPDQIDFWRUV
EXWPRUHKDUPIXOLQWHUPVRILPSDFWRQKXPDQVRFLHW\
DQGOLIH$VDFDVHLQSRLQWFRQVLGHUWKHUHFHQWODUJH 4. SHAPING AGI RESEARCH
VFDOHVSUHDGRIWKH:DQQD&U\UDQVRPZDUHH[SORLWLQJ
D YXOQHUDELOLW\ LQ WKH :LQGRZV RSHUDWLQJ V\VWHP >@ GLVFXVVHV WKH PHDQV DQG PHDVXUHV WR VKDSH $,
SDUWLFXODUO\ YHUVLRQV SDVW ,QYHVWLJDWLRQV VHHP WR DQG SRWHQWLDO $*, UHVHDUFK WR SURPRWH VDIH DQG
VXJJHVWWKDWWKHDUFKLWHFWVRIWKHDWWDFNZHUHQRWZHOO EHQHILFLDO$,GHYHORSPHQWDQGPDNHVWKHGLVWLQFWLRQ
RUJDQL]HGDQGWKHDWWDFNQRWDVQLJKWPDULVKDVLWFRXOG EHWZHHQ H[WULQVLF PHDVXUHV VXFK DV FRQVWUDLQWV RQ
KDYHEHHQ<HWLWSUHFLSLWDWHGDVLJQLILFDQWDPRXQWRI GHVLJQ DQG LQWULQVLF PHDVXUHV VXFK DV LQGXFLQJ D
FKDRV DQG DIIHFWHG QHWZRUNHG FRPSXWHUV ZRUOGZLGH QRUPDWLYHVKLIWWRZDUGVZDQWLQJWREXLOGEHQHILFLDO$,
1RZ UHSODFH WKH UDQVRPZDUH ZLWK DQ $*, WKDW LV DQG FUHDWLQJ D VWLJPD DURXQG GDQJHURXV $, UHVHDUFK
UHOHDVHG LQWR WKH ZLOG E\ KDFNHUV PRWLYDWHG E\ >@ PDNHV WKH FRPSHOOLQJ DUJXPHQW WKDW KDUG
SROLWLFDO LGHRORJ\QRWRULHW\RUFXULRVLW\>@(YHQLI H[WULQVLF PHDVXUHV VXFK DV RXWULJKW EDQV PLJKW KDYH
WKH$*,LVQRWLQKHUHQWO\GDQJHURXVWKHFRQVHTXHQFHV HIIHFWVFRXQWHUWRZKDWZDVLQWHQGHGDVDEDQZRXOG
LQVXFKDVFHQDULRZRXOGEHKDUGWRSUHGLFWRUSODQIRU GUDZDWWHQWLRQWRWKHSUREOHPLQDPDQQHUWKDWHYRNHV
DQGFRXOGEHFDWDVWURSKLF FXULRVLW\ DQG GHVLUH IRU ERXQGDU\ EUHDNLQJ 7KH
LQWHQWLRQDO VKDSLQJ RI $*, UHVHDUFK E\ WDUJHWLQJ WKH
3. AGI AND VALUE ALIGNMENT FXOWXUH LQ WKH UHVHDUFK FRPPXQLWLHV ERWK DFDGHPLF
DQGQRQDFDGHPLFWRPDNHWKHZLVKWREXLOGVDIHDQG
5HVHDUFKHUV ZRUNLQJ RQ PDNLQJ DQ\ SRWHQWLDO $*, EHQHILFLDO $, D VRFLDO QRUP ZLWK VWURQJ QRUPDWLYH
³IULHQGO\´RUFRPSDWLEOHZLWKKXPDQH[LVWHQFHLIQRW IDFWRUV HQFRXUDJLQJ WKH DYRLGDQFH RI XQVDIH GHVLJQV
YDOXHV VSHDN RI WKH $, YDOXH DOLJQPHQW SUREOHP HWFDSSHDUVWREHDQLQWHUHVWLQJVWUDWHJ\DQGRQHWKDW
7KHUH DUH WHFKQLFDO DV ZHOO DV SUDJPDWLF LV OLNHOLHU WR KDYH D VWURQJHU LPSDFW RYHU WLPH
FRQVLGHUDWLRQVDWWHQGDQWXSRQ$*,UHVHDUFKVHH>@ HVSHFLDOO\LQWKHFRQWH[WRIRSHQ$,GHYHORSPHQW
ZKLFK LQFUHDVH WKH FRPSOH[LW\ RI DQ\ SURSRVHG
DWWHPSWWRDOLJQWKHYDOXHVRUREMHFWLYHVRIDSXWDWLYH >@ GLVFXVVHV WKH LPSOLFDWLRQV RI RSHQ $,
$*, ZLWK KXPDQ RQHV 7KH PRVW REYLRXV DQG PRVW GHYHORSPHQW DQG HODERUDWHV RQ WKH FRPSOH[LWLHV
QRQWULYLDOFRQVLGHUDWLRQLIQRWFRQVWUDLQWLVWKHIDFW LQKHUHQWWRWKHSXUVXLWRIRSHQQHVVDVDSROLF\DFURVV
WKDWKXPDQVDFURVVWKHZRUOGDUHQRWFDSDEOHRIYDOXH PXOWLSOH GLPHQVLRQV VXFK DV WKH SROLWLFDO VFLHQWLILF
DOLJQPHQW WR WKH H[WHQW WKDW DFWLRQV ZKLFK LQFUHDVH DQG WHFKQRORJLFDO DQG LW DSSHDUV WKDW WKH VROXWLRQ
H[LVWHQWLDO ULVN IRU DOO KXPDQLW\ ZRXOG EH UHQGHUHG SURSRVHG KHUH ZRXOG PDNH FRQFHUQV UHJDUGLQJ
H[WUHPHO\ XQOLNHO\ &OLPDWH FKDQJH SROLF\ LV RQH ORQJWHUP FRVWV RI RSHQQHVV LUUHOHYDQW JLYHQ WKDW
H[DPSOHRIDIDLOXUHRIJOREDOFRRUGLQDWLRQRQDPDWWHU DVVXPLQJ WKLV VROXWLRQ LV ZRUNDEOH D FRDOLWLRQ RI
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
VWDWHV DQG UHVHDUFKHUV ZRXOG ZRUN RQ $, $*, GHYHORSPHQW RI $*, DV D JOREDO QRQVWUDWHJLF
GHYHORSPHQWDVDSXEOLFRSHQHQWHUSULVHLQVSLUHGE\ KXPDQLWDULDQ REMHFWLYH XQGHU WKH DHJLV RI D VSHFLDO
YHQWXUHVVXFKDV2SHQ$, DJHQF\ZLWKLQWKH8QLWHG1DWLRQVHVWDEOLVKHGIRUWKLV
H[FOXVLYH SXUSRVH ,Q WKLV VFHQDULR FRXQWULHV ZRXOG
>@SUHVHQWVDIRUPDODFFRXQWRIGHWHUPLQLQJD3DUHWR VXSSO\ UHVRXUFHV DQG LQYHVW HTXLWDEO\ LQ WKH FUHDWLRQ
RSWLPDO SROLF\ E\ D PDFKLQH EXLOW DQG GHSOR\HG E\ RI WKH ZRUOG¶V first and only $*, ZLWK VDIHW\
WZR DFWRUV LQGLYLGXDOV FRPSDQLHV RU VWDWHV FRQVLGHUDWLRQVLPSRVHGDWHYHU\OHYHO$VDILUVW VWHS
UHIOHFWLQJ WKH EHOLHIV DQG XWLOLW\ IXQFWLRQV DVVRFLDWHG WRZDUGV VHFXULQJ VXFK JOREDO FRRSHUDWLRQ D
ZLWK HDFK DFWRU DQG GHPRQVWUDWHV WKDW VXFK D SROLF\ FRPSUHKHQVLYH %HQHYROHQW $*, 7UHDW\ PXVW EH
ZRXOG VHTXHQWLDOO\ VKLIW WKH SULRULWL]DWLRQ RI RQH GHYHORSHG DQG UDWLILHG E\ DOO PHPEHU QDWLRQV RI WKH
DFWRU¶V XWLOLW\ IXQFWLRQ RYHU WKH RWKHU¶V DV D 81 5HFHQW FDOOV IRU D EDQ RQ DXWRQRPRXVZHDSRQV
FRQVHTXHQFH RI WKH DFFXUDF\ RI WKH DFWRUV¶ EHOLHIV DUH D VWHS LQ WKLV GLUHFWLRQ VHH >@ 7KH
UHJDUGLQJWKHLQSXWWRWKHPDFKLQHLHWKHVWDWHRIWKH SULQFLSOHV HQXQFLDWHG LQ FRQMXQFWLRQ ZLWK WKH
ZRUOGLQ ZKLFK WKH PDFKLQH IXQFWLRQV7KLVDQDO\VLV $VLORPDU&RQIHUHQFHSURYLGHDIRXQGDWLRQIRUVXFKD
UDLVHV WKH TXHVWLRQ ZKHWKHU WKH IUXLWV RI VWUDWHJLF WUHDW\ VHH >@ ,I VXFK D WUHDW\ VXFFHHGV DQ\
FRRSHUDWLRQ LQ $, GHYHORSPHQW FRXOG VWLOO EH SRWHQWLDOEHQHILFLDO$*,ZRXOGEHWUHDWHGDVDJOREDO
GLVWULEXWHGXQHTXDOO\LIWKHDFWRUVLQYROYHGGRQRWKDYH SXEOLF JRRG ZLWK HTXDO GLVWULEXWLRQ RI FDUHIXOO\
DFFHVV WR HLWKHU WKH VDPH LQIRUPDWLRQUHJDUGLQJ WKH PLQLPL]HG ULVNV DQG FDUHIXOO\ PD[LPL]HGEHQHILWV
PDFKLQH¶VZRUOGDQGLQSXWVRULIRQHRUPRUHDFWRUV DQGQRURRPIRUPRQRSROLHVDGYHUVDULDOFRRSWLQJRI
DFWLYHO\ VKDSH WKH EHOLHIV RI WKH RWKHU DFWRUV WKURXJK WKH V\VWHP¶V SRWHQWLDO HWF 7KH ODWWHU FRQVWUDLQWV DUH
GLVLQIRUPDWLRQ YLWDOWRWKHVXFFHVVRIWKHWUHDW\DVDQLQVWUXPHQWDQG
HYHQ PRUH LPSRUWDQW WR LWV HIILFDFLRXV
5. PERSPECTIVES AND SOLUTIONS LPSOHPHQWDWLRQDVDQ$*,ZRXOGUHSUHVHQWDOHYHORI
SRZHU KLWKHUWR XQSUHFHGHQWHG $GGLWLRQDO VDIHJXDUGV
,Q H[DPLQLQJ WKH SRWHQWLDO IRU DQ $*, ³DUPV UDFH´ QHHG WR EH UHVHDUFKHG RQ DFFRXQW RI WKH IDFW WKDW DQ
DQGWKHWUHQGVREVHUYHGLQWKH SUHVHQWGD\ZRUOGZH $*,ZRXOGEHPXFKHDVLHUWRUHSURGXFHFRPSDUHGWR
VHH WKDW WKHUH DUH PXOWLSOH SDWKV WR DYHUWLQJ VXFK RWKHUGLVUXSWLYHWHFKQRORJLHVKXPDQVKDYHGHYHORSHG
FRQIOLFWLQWKHGHFDGHVWRFRPH7KH\DUHQRWPXWXDOO\ WKXVIDU)XUWKHUUHVHDUFKQHHGVWREHGRQHRQKRZWR
H[FOXVLYH DQG FDQ EH LQWHJUDWHG WR IRUP D FRQYROYH$,VDIHW\DSSURDFKHVVXFKDV³ER[LQJLQWKH
FRPSUHKHQVLYHVWUDWHJ\:HUHFRPPHQGGHYHORSLQJD $,´ ZLWK FROODERUDWLYH $*, GHYHORSPHQW WR SUHYHQW
VROXWLRQ WKDW LV OD\HUHG ZLWK IDLOXUHV DW RQH OHYHO SRVVLEOHXQDXWKRUL]HGXQGHVLUDEOHUHSURGXFWLRQRIWKH
FRPSHQVDWHGIRUE\SROLFLHVDQGPHFKDQLVPVLQSODFH $*,E\DFWRUVQRWVDQFWLRQHGE\WKHWUHDW\
DW DQRWKHU IRU UHGXQGDQFLHV DQG PXOWLSOH GHIHQVHV
ZRXOGUHQGHUWKHVROXWLRQUREXVW 7KHJDPHWKHRUHWLFDQDO\VLVSUHVHQWHGE\>@DSSHDUV
WR VXSSRUW D FRRSHUDWLYH DSSURDFK DV WHDPV ZRUNLQJ
5.1. Solution 1: Global collaboration on AGI WRJHWKHU KDG SRVLWLYH LPSOLFDWLRQV IRU VDIHW\ DV
development and safety RSSRVHG WR WHDPV UDFLQJ WR VXFFHHG +RZHYHU WKH\
DOVR SUHVHQW DQ LQWULJXLQJ UHVXOW WKDW LQFUHDVHG
3RVWZDUDGYDQFHPHQWVLQVSDFHVFLHQFHOHGWRERWKWKH NQRZOHGJH RI WKH ZRUN EHLQJ GRQH E\ RWKHU WHDPV
6SDFH $JH FKDUDFWHUL]HG E\ WKH UDFH IRU VSDFH 7KH LQFUHDVHGULVN,WLVWREHQRWHGWKDWWKLVLQIRUPDWLRQDO
HUVWZKLOH 6RYLHW 8QLRQ DQG WKH 8QLWHG 6WDWHV RI KD]DUG ZRXOG DSSO\ RQO\ LI QDWLRQV VHHN WR JDLQ
$PHULFD YLHG ZLWK HDFK RWKHU IRU SULRULW\ LQ VSDFH VWUDWHJLF GRPLQDQFH RU DGYDQWDJH DQG D FRQFHUWHG
H[SORUDWLRQ DQG VXFFHVVIXO PDQQHG PLVVLRQV :KLOH WUDQVSDUHQWHIIRUWWREXLOGDQ$*,IRUJOREDO ZHOIDUH
VSDFHIDULQJ QDWLRQ VWDWHV SXUVXH VSDFH SURJUDPV RI LV H[SHFWHG WR LPSURYH VDIHW\ DQG ULVNPLWLJDWLRQ
WKHLU RZQ ZLWK QDWLRQDO DJHQGDV DQG VWUDWHJLF JRDOV HIIRUWV
VHYHUDOKDYHDOVRFRPHWRJHWKHUWRFUHDWHDQGVXVWDLQ
DQLQWHUQDWLRQDOVSDFHVWDWLRQ,66ZKLFKKDVEHFRPH 5.2. Solution 2: Global Task Force on AGI to
D QHZ EHQFKPDUN IRU LQWHUQDWLRQDO FRRSHUDWLRQ >@ monitor, delay and enforce safety guidelines
7DNLQJ WKLV DV D SDUDGLJPDWLF FDVH RI VXFFHVVIXO
LQWHUQDWLRQDO FRRSHUDWLRQ ZH UHIHU WR WKLV DV WKH ,66 >@ SURSRVHV JHQHUDO SROLF\ GHVLGHUDWD IRU D ZRUOG
SDWKZD\ DERXW WR FRXQWHQDQFH $*,$6, DQG UHFRPPHQG ZLWK
VSHFLILF UHIHUHQFH WR WKH SUREOHP RI SRWHQWLDO JOREDO
,I WKH ,66 SDWKZD\ LV FKRVHQ ZLWK FRRUGLQDWLRQ DQG FRRUGLQDWLRQ IDLOXUH WKDW FRQWURO RI VXFK WHFKQRORJ\
IRUHVLJKW DQ $*, DUPV UDFH FRXOG EH DYRLGHG EH FHQWUDOL]HG RU D PRQLWRULQJ UHJLPH GHYRWHG WR
DOWRJHWKHU E\ DGRSWLQJ WKH VDIH DQG EHQHILFLDO LGHQWLI\LQJ KDUPIXO DSSOLFDWLRQV RI $, DQG
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
LQWHUFHSWLQJ WKHP SUHGHSOR\PHQW $V VHHQ DERYH LV FDSDEOH RI ZLWK DQ LQFUHDVLQJ UDWH RI SURJUHVV
FUHDWLQJ D JOREDO $*, SURMHFW ZRXOG DGGUHVV WKH 0DQ\VXFKFRPSDQLHVFRXOGIRUPDFRQVRUWLXPGULYHQ
JOREDO FRRUGLQDWLRQ LVVXH KHDGRQ $FKLHYLQJ D OHYHO E\ WKH QHHG IRU VDIH $*, GHYHORSPHQW DQG SXEOLF
RI FRRUGLQDWLRQ VXSHULRU WR WKDW ZKLFK FXUUHQWO\ JRRG ,QGHHG VXFK DQ HQWLW\ H[LVWV LQ WKH IRUP RI
VXVWDLQV WKH ,QWHUQDWLRQDO 6SDFH 6WDWLRQ ZRXOG EH D 3DUWQHUVKLS RQ $, >@ D WLPHO\ QRQSURILW
SUHFRQGLWLRQ IRU DQ LQWHUQDWLRQDO $*, GHYHORSPHQW RUJDQL]DWLRQ EULQJLQJ WRJHWKHU GLYHUVH SDUWLHV DQG
SURJUDP DFWRUVZLWKSXEOLFVDIHW\DQGEHQHILWDVIRFL
:KDW DERXW D ZRUOG ZKLFK LV QRW \HW UHDG\ IRU VXFK 7KH SUREOHP ZLWK WKLV VFHQDULR LV WKDW WKH UDZ
FRRUGLQDWLRQ RU WKH DGYHQW RI $*, QDPHO\ RXU FDSDELOLW\IRU$*,GHYHORSPHQWLVQRWVWULFWO\OLPLWHGWR
ZRUOG":HSURSRVHWKDWDJOREDOZDWFKGRJDJHQF\EH RQH FRUQHU RI WKH JOREH DQG LQ WKH DEVHQFH RI
FUHDWHGIRUWKHH[SUHVVSXUSRVHRIWUDFNLQJSURJUHVVRI LQWHUJRYHUQPHQWDO FRRUGLQDWLRQ DQG D JOREDO
$*, SURJUDPV VWDWHIXQGHG DV ZHOODVFRUSRUDWHWKH UHJXODWRU\ DXWKRULW\ ZLWK UHDO OHJDO SRZHU WR KDOW
WKLUGYDULHW\URJXH$*,GHYHORSPHQW PD\ EH KDUGHU XQVDIH SURJUDPV LW LV HQWLUHO\ FRQFHLYDEOH WKDW $*,
WR PRQLWRU EXW QRW LPSRVVLEOH 7KLV DJHQF\ ZRXOG GHYHORSPHQW FRXOG RFFXU LQ PXOWLSOH SDUWV RI WKH
KDYH DV LWV RSHUDWLQJ FKDUWHU WKH WUHDW\ RQ VDIH $*, ZRUOG DQG QRW DOO SOD\HUVPD\ DFFHSW WKH UXOHVOLNHO\
GHYHORSPHQW IRU WKH EHQHILW RI DOO KXPDQLW\ DV WRHQVXUHWKHVDIHVWDQGPRVWEHQHILFLDORXWFRPH>@
SURSRVHGDERYHZLWKMXULVGLFWLRQDFURVVDOOQDWLRQVD SURSRVHV WKH FUHDWLRQRI DQ $, 6WDQGDUGV 'HYHORSLQJ
VLQJOHWRQ EXW ZLWKLQ WKH VSHFLILF FRQWH[W RI $*, 2UJDQL]DWLRQ ZKRVH UROH ZRXOG EH WR SURYLGH VWULFW
GHYHORSPHQW ZLWKRXW DXWKRULW\ RYHU RWKHU DVSHFWV RI JXLGHOLQHV IRU ULVN PDQDJHPHQW DQG $, VDIHW\ LQ DQ
JRYHUQDQFHRUDGPLQLVWUDWLRQDQGWKHODZIXODXWKRULW\ LQGXVWULDO FRQWH[W 7KLV LV LQGHHG D JRRG QRQVWDWH
WR ERWK LQWHUFHSW XQODZIXO DWWHPSWV DW $*, DQDORJXHWRWKHDGRSWLRQRIDWUHDW\DQGSHUKDSVFORVHU
GHYHORSPHQWDQGXQLODWHUDOO\WHUPLQDWHRUIUHH]HVXFK WR WKH WKHDWHU RI $, GHYHORSPHQWGHSOR\PHQW
SURJUDPV $OWKRXJK LW LV WR EH H[SHFWHG WKDW FRPSOH[LWLHV
DVVRFLDWHG ZLWK GHYHORSLQJ UHJXODWRU\ VWDQGDUGV
7KH FUHDWLRQ RI VXFK D ERG\ ZLWK VXFK YDVW SRZHUV ZRXOG QHFHVVLWDWH WKH LQYROYHPHQW RI VWDWHV RU D
DOEHLW ZLWKLQ D VSHFLILF FRQWH[W ZRXOG DOVR EH FRDOLWLRQRIVWDWHV
FRQVWUDLQHGE\WKHHIILFDF\RIJOREDOFRRUGLQDWLRQDQG
LV OHVV OLNHO\ WR KDSSHQ UHODWLYH WR WKH VSDFHVWDWLRQ ,QDGGLWLRQWRWKHVROXWLRQVSURIIHUHGDERYHSRZHUIXO
DQDORJXHSURSRVHGHDUOLHU,WLVSHUKDSVHDVLHUWREULQJ LPSHWXVFRXOGEHSURYLGHGWRWKHFUHDWLRQRID1DQQ\
SHRSOH WRJHWKHU WR GR VRPHWKLQJ EXLOG $*, DV D $,>@ZKLFKZRXOGEHWDVNHGZLWKWKHPRQLWRULQJRI
JOREDO HIIRUW UDWKHU WKDQ WR FUHDWH D JURXS WKDW WHOOV $*,GHYHORSPHQWZRUOGZLGHZLWKDFOHDUPDQGDWHWR
HYHU\RQHHOVHQRWWRGRVSHFLILFWKLQJVZDWFKGRJZLWK GHOD\DQ\DQGDOOVXFKSURJUDPVXQWLOWKHFRRUGLQDWLRQ
WKHSRZHUWRVWRS$*,GHYHORSPHQWWKDWUXQVDIRXORI LVVXHV DQG VDIHW\ FRQVLGHUDWLRQV FDQ EH DGGUHVVHG
WKHWUHDW\7KHKLVWRU\RIWKH,$($PD\EHRILQWHUHVW ULJRURXVO\ 7KLV KRZHYHU LV QRW ZLWKRXW ULVNV RI LWV
LIWKLVSDWKLVFKRVHQWROHDUQIURP LWV VXFFHVVHV DQG RZQ
SUHHPSW FKDOOHQJHV OLNHO\ WR EH IDFHG E\ DQ
LQWHUQDWLRQDO DJHQF\ WDVNHG ZLWK UHJXODWLQJ 6. CONCLUSION
WHFKQRORJLFDO GHYHORSPHQW RI D VSHFLILF VRUW $Q\
VXFK DJHQF\ ZRXOG EHQHILW IURP GUDZLQJ XSRQ WKH $QDUWLILFLDOLQWHOOLJHQFHDUPVUDFHPRVWOLNHO\FDQQRW
F\EHUVHFXULW\ LQIUDVWUXFWXUHV HVWDEOLVKHG E\ QDWLRQ EH VWRSSHG RQO\ PDQDJHG :KLOH WKHUH DUH PDQ\
VWDWHVDVZHOODVWKHLQWHOOLJHQFHFRPPXQLWLHV RI WKH SRVVLEOH VFHQDULRV DQG RXWFRPHV LW LV LQ WKH EHVW
SDUWLFLSDWLQJ VWDWHV 7KH SURSRVHG DJHQF\ ZRXOG LQWHUHVWRIKXPDQLW\WKDWWKHGDQJHURXVRQHVEHJLYHQ
KRZHYHU KDYH D IRFXV WKDW LV JOREDO DQG QRW GXHFRQVLGHUDWLRQEHIRUHZHGHYHORS$*,:HEHOLHYH
FRQVWUDLQHG E\ WKH QDWLRQDO LQWHUHVWV RI SDUWLFLSDWLQJ D V\VWHPDWLF DQG WHPSHUHG SXEOLF HOXFLGDWLRQ RI WKH
QDWLRQV DV WKLV FRXOG HDVLO\ OHDG WR FRQIOLFWV ZLWK ULVNV ZRXOG KHOS WKH FDXVH RI VDIH $*, GHYHORSPHQW
XQGHVLUDEOHUDPLILFDWLRQV PRUH WKDQ DQ DSSURDFK FKDUDFWHUL]HG E\ K\SH DQG
DSRFDO\SWLF PHVVDJLQJ 7HFKQRORJLFDO SURJUHVV WHQGV
1RZ WKHUH DUH UHDVRQV WR EHOLHYH WKDW $*, WRKDYHDOLIHRILWVRZQDQGJLYHQWKHUDWHDWZKLFK
GHYHORSPHQW PD\ RFFXU LQ WKH FRUSRUDWH VSKHUH DV $, V\VWHPV DUH DFKLHYLQJ IHDWV RI LQWHOOLJHQFH DQG
RSSRVHGWRZLWKLQDVWDWHIXQGHGSURJUDP2SHQ$,LV H[SHUWLVHLWLVPHUHO\DPDWWHURIWLPHSHUKDSVDIHZ
DQRQSURILWFRPSDQ\IRUPHGUHFHQWO\E\DQXPEHURI GHFDGHV KHQFH SHUKDSV PRUH EHIRUH D WUXO\ JHQHUDO
HQWUHSUHQHXUVFRQFHUQHGDERXWVDIH$*,GHYHORSPHQW $, FRPHV LQWR H[LVWHQFH ,Q WKLV SDSHU ZH KDYH
6HYHUDO FRPSDQLHV VXFK DV *RRJOH 'HHS0LQG H[DPLQHG WKH SURVSHFW RI VXFK $*, GHYHORSPHQW
9LFDULRXVHWFDUHSXVKLQJWKHERXQGDULHVRIZKDW$, EHLQJSURVHFXWHGDVDQ³DUPVUDFH´DQGKDYHRIIHUHG
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
D VHW RI VROXWLRQV LQFOXGLQJ WKH GHYHORSPHQW RI D 3HUIRUPDQFH" (YLGHQFH IURP $, ([SHUWV
FRPSUHKHQVLYH WUHDW\ RQ $*, GHYHORSPHQW DU;LYSUHSULQWDU;LY
LQWHUQDWLRQDOFROODERUDWLRQRQ D VLQJXODU $*,
SURJUDP D UHJXODWRU\ JOREDO ZDWFKGRJ GHVLJQHG WR >@ 3UHSDULQJ IRU WKH IXWXUH RI DUWLILFLDO
HQIRUFH WKH DIRUHPHQWLRQHG WUHDW\ DQG SRWHQWLDO LQWHOOLJHQFH7KH:KLWH+RXVH5HWULHYHGIURP
UHFUXLWPHQWRID1DQQ\$,V\VWHP>@WRGHOD\$*, KWWSVREDPDZKLWHKRXVHDUFKLYHVJRYVLWHVGHI
GHYHORSPHQW XQWLO SUDJPDWLF FRQVLGHUDWLRQV DQG ULVNV DXOWILOHVZKLWHKRXVHBILOHVPLFURVLWHVRVWS167
FDQ DOO EH DGGUHVVHG ZLWK VXIILFLHQW ULJRU :LWK WKLV &SUHSDULQJBIRUBWKHBIXWXUHBRIBDLSGI
ZH VHHN WR DGG WR WKH HPHUJLQJ GLVFXVVLRQ RQ $,
VDIHW\ZLWKLQWKHWHFKQRORJ\DQGSROLF\FRPPXQLWLHV >@ * $OOHQ DQG 7 &KDQ $UWLILFLDO ,QWHOOLJHQFH
DQG KRSH WKDW WKH LGHDV SUHVHQWHG KHUHLQ DUH DQG 1DWLRQDO 6HFXULW\ 5HWULHYHG IURP
LQYHVWLJDWHG WKRURXJKO\ ZLWK FRQFUHWH DSSOLFDWLRQ LQ KWWSZZZEHOIHUFHQWHURUJVLWHVGHIDXOWILOHVIL
PLQG OHVSXEOLFDWLRQ$,1DW6HFILQDOSG
I
ACKNOWLEDGEMENT
>@ 6 $UPVWURQJ 1 %RVWURP DQG & 6KXOPDQ
:H WKDQN %HWK 0%DUQHV IRU YDOXDEOH FRPPHQWV RQ 5DFLQJ WR WKH SUHFLSLFH D PRGHO RI DUWLILFLDO
WKLVSDSHU LQWHOOLJHQFH GHYHORSPHQW 7HFKQLFDO 5HSRUW
)XWXUH RI +XPDQLW\ ,QVWLWXWH 2[IRUG
REFERENCES 8QLYHUVLW\
>@ $/HYLQRYLW]³7KHP\VWHU\RI*RWKHDQFLHQW >@ & 9RQ &ODXVHZLW] 2Q ZDU WUDQVODWHG IURP
JDPH WKDW FRPSXWHUV VWLOO FDQ¶W ZLQ´ :LUHG WKH*HUPDQE\2-0DWWKLMV-ROOHV7KH0RGHUQ
0DJD]LQH 5HWULHYHG $XJXVW IURP /LEUDU\
KWWSVZZZZLUHGFRPWKHZRUOGRI
FRPSXWHUJR >@ 5 <DPSROVNL\ /HDNSURRILQJ WKH VLQJXODULW\
DUWLILFLDO LQWHOOLJHQFH FRQILQHPHQW SUREOHP
>@ '6LOYHU$+XDQJ&-0DGGLVRQ$*XH] -RXUQDORI&RQVFLRXVQHVV6WXGLHVYROQR
/ 6LIUH * 9DQ 'HQ 'ULHVVFKH - SS
6FKULWWZLHVHU , $QWRQRJORX 9
3DQQHUVKHOYDP 0 /DQFWRW DQG 6 'LHOHPDQ >@ 5 )H\QPDQ 5HSRUW RI WKH SUHVLGHQWLDO
³0DVWHULQJ WKH JDPH RI *R ZLWK GHHS QHXUDO FRPPLVVLRQ RQ WKH VSDFH VKXWWOH &KDOOHQJHU
QHWZRUNV DQG WUHH VHDUFK´ 1DWXUH YRO DFFLGHQW $SSHQGL[ ) 5HWULHYHG IURP
QRSS KWWSVHQJLQHHULQJSXUGXHHGXaDDHFROXPE
LDORVVIH\QPDQURJHUVUSWDSSISGI
>@ ( *LEQH\ :KDW *RRJOH¶V ZLQQLQJ *R
DOJRULWKP ZLOO GR QH[W 1DWXUH YRO QR >@ % :DWVRQ ³7KH 'URQHV RI ,6,6´ 'HIHQVH
SS 2QH 5HWULHYHG $XJXVW IURP
KWWSZZZGHIHQVHRQHFRPWHFKQRORJ\
>@ ( *LEQH\ *RRJOH VHFUHWO\ WHVWHG $, ERW GURQHVLVLV
1DWXUHYROSS
>@ ) 3LVWRQR DQG 5 <DPSROVNL\ ³8QHWKLFDO
>@ 1(UQHVW'&DUUROO&6FKXPDFKHU0&ODUN UHVHDUFK KRZ WR FUHDWH D PDOHYROHQW DUWLILFLDO
. &RKHQ DQG * /HH *HQHWLF )X]]\ EDVHG LQWHOOLJHQFH´DU;LYSUHSULQWDU;LY
$UWLILFLDO ,QWHOOLJHQFH IRU 8QPDQQHG &RPEDW 5HWULHYHG $XJXVW IURP
$HULDO 9HKLFOH &RQWURO LQ 6LPXODWHG $LU KWWSVDU[LYRUJDEV
&RPEDW 0LVVLRQV - 'HI 0DQDJ YRO QR
SS >@ 6 5XVVHOO ' 'HZH\ DQG 0 7HJPDUN
5HVHDUFK SULRULWLHV IRU UREXVW DQG EHQHILFLDO
>@ * %RRFK , IRU 2QH :HOFRPH 2XU 1HZ DUWLILFLDOLQWHOOLJHQFH$L0DJD]LQHYROQR
&RPSXWHU 2YHUORUGV ,((( 6RIWZDUH YRO SS
QRSS
>@ 6 ' %DXP 2Q WKH SURPRWLRQ RI VDIH DQG
>@ .*UDFH-6DOYDWLHU$'DIRH%=KDQJDQG VRFLDOO\EHQHILFLDODUWLILFLDOLQWHOOLJHQFH$,
2 (YDQV :KHQ :LOO $, ([FHHG +XPDQ 6RFLHW\SS
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
>@ 1%RVWURP6WUDWHJLFLPSOLFDWLRQVRIRSHQQHVV >@ 1 %RVWURP $ 'DIRH DQG & )O\QQ 3ROLF\
LQ$,GHYHORSPHQW*OREDO3ROLF\YROQR 'HVLGHUDWD LQ WKH 'HYHORSPHQW RI 0DFKLQH
SS 6XSHULQWHOOLJHQFH :RUNLQJ 3DSHU )XWXUH RI
+XPDQLW\,QVWLWXWH2[IRUG8QLYHUVLW\
>@ $ &ULWFK 7RZDUG QHJRWLDEOH UHLQIRUFHPHQW
OHDUQLQJ VKLIWLQJ SULRULWLHV LQ 3DUHWR RSWLPDO >@ KWWSVZZZSDUWQHUVKLSRQDLRUJ
VHTXHQWLDO GHFLVLRQPDNLQJ DU;LY SUHSULQW
DU;LY >@ 6 2]ODWL DQG 5 <DPSROVNL\ 7KH
)RUPDOL]DWLRQ RI $, 5LVN 0DQDJHPHQW DQG
>@ * + .LWPDFKHU : + *HUVWHQPHLHU - 6DIHW\ 6WDQGDUGV´ VW $$$, &RQIHUHQFH RQ
%DUWRH DQG 1 0XVWDFKLR 7KH LQWHUQDWLRQDO $UWLILFLDO ,QWHOOLJHQFH $$$, UG
VSDFH VWDWLRQ $ SDWKZD\ WR WKH IXWXUH $FWD ,QWHUQDWLRQDO :RUNVKRS RQ $, (WKLFV DQG
DVWURQDXWLFDYROQRSS 6RFLHW\6DQ)UDQFLVFR&$86$
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
$SK\VLFDOJHRJUDSKLFDOORFDWLRQZKHUHWKHQHWZRUNEDVHVWDWLRQV
DORQJ ZLWK QHFHVVDU\ HTXLSPHQW DUH LQVWDOOHG WR LOOXPLQDWH WKH
VXUURXQGLQJDUHDZLWKQHFHVVDU\UHVRXUFHV
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
6RXUFHKWWSVLPJXUFRPJDOOHU\:020D 6RXUFHKWWSVZZZ]PHVFLHQFHFRP
6RXUFHKWWSVFEVODILOHVZRUGSUHVVFRP 6RXUFHKWWSVZZZQEFQHZVFRP
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
,QUHIHUHQFHWRWKHDERYHGLVFXVVLRQVOHWXVDVVXPHWKH $VVKRZQLQ)LJOHWXVFRQVLGHUDVFHQDULRLQZKLFK
IROORZLQJ D7UDQVPLWWHU7[DWSRVLWLRQ3DQGD5HFHLYHU5[DW
7KHUHLVDQHWZRUNXQGHUFRQVLGHUDWLRQ SRVLWLRQ5DUHVHSDUDWHGE\DGLVWDQFHµ'¶DQGWKHUH
WKHUHDUHµX¶XVHUVVXEVFULEHUVLQWKHQHWZRUN H[LVWVDSRLQW4EHWZHHQ3DQG5VXFKWKDW34LVDIUHH
WKHUHDUHµV¶VLWHVLQWKHQHWZRUN VSDFH 7KHQ WR WKH )ULLV 0RGHO WKH WUDQVPLW DQG
WKHµMWK¶XVHULVVHUYHGE\µNWK¶VLWH UHFHLYHVLJQDOSRZHUUHODWLRQFDQEHH[SUHVVHGE\>@
WKHXVHUVKDYHLQVWDQWDQHRXVFDSDFLW\GHPDQGRU
WKURXJKSXWGHPDQG
WKHFDSDFLW\GHPDQGIXQFWLRQLQWHUPVRIELWVSHU
VHFRQGRIMWKXVHULVGHILQHGDVEMW
DOOXVHUVDUHG\QDPLFLQSRVLWLRQDQGWLPH :KHUH
WKHYHORFLW\DQGSRVLWLRQRIMWKXVHUDWDQ\WLPHµW¶ 3WLVWKHWUDQVPLWSRZHURIWKHQHWZRUNVLWH
LVGHILQHGDVYMWDQGSMWZKLFKLVWKHYHORFLW\ 3ULVWKHUHFHLYHVLJQDOSRZHUDW4E\WKHUHFHLYHU
DQGSRVLWLRQIXQFWLRQRIXVHUµM¶ *WLVWKHWUDQVPLWDQWHQQDJDLQ
/HWLWEHDVVXPHGWKDWWKHMWKXVHUZDVWKHRQHVWD\LQJ *ULVWKHUHFHLYHUDQWHQQDJDLQ
DW SRLQW µ3¶ GHFLGHV WR PRYH ZLWKLQ WKH QHWZRUNWR ȜLVWKHZDYHOHQJWKRIWKHFDUULHULQXVH
UHDFK SRLQW µ4¶ ,Q WKLV FDVH ZKHUHYHU WKH XVHU M LV 'LVWKHGLVWDQFHEHWZHHQ3DQG4
PRYLQJ LW LV UDLVLQJ DQ DGGLWLRQDO GHPDQG DW WKH &RQVLGHULQJ WKH DQWHQQD JDLQV DV XQLW\ WKDW LV
ORFDWLRQ 7KHQ DOO WKH SUREOHPV WKDW ZHUH RQFH *W *U HTXDWLRQ \LHOGV IUHH VSDFH 3DWK /RVV
DVVRFLDWHGZLWKSRLQW3DUHQRZSURJUHVVLQJWRSRLQW4 0RGHO3/0JLYHQDV>@
(DFKWLPHDSHUVRQRUJURXSRISHRSOHPRYHWRDQHZ
SODFHDQDGGLWLRQDOUHVRXUFHGHPDQGLVFUHDWHGZKLFK
NHHSVRQVKLIWLQJIURPSRLQWWRSRLQWDVWKHSHUVRQRU
JURXSPRYHV7KXVWKHORFXVRIWKHSDWKWKDWDSHUVRQ
RUJURXSPRYHVFUHDWHVDGHPDQGFXUYHLQWKHQHWZRUN 7KHGHFLEHOIRUPDWRIHTXDWLRQFDQEHREWDLQHGDV
DUHD
3LFWXUHV LQ )LJ VKRZ WKDW WKHUH FDQ EH µtriggers¶ PLfsdBD ORJPLfsDRU
VXFKDVPXVLFFRQFHUWVFDUQLYDOVPDUNHWVDOHHWFWKDW
FRPSHORUPRWLYDWHXVHUVWRDFFXPXODWHDQGPRYHLQ
JURXSV DW XQSUHFHGHQWHG ORFDWLRQV DQG DW XQIRUHVHHQ
WLPHV7KHPRUHSRSXODWHGWKH$R,LVWKHPRUHFKDQFHV 7KH SDWKORVV H[SHULHQFHGDW SRLQW 5 DW DGLVWDQFH'
WKHUHDUHRIVXFKUDQGRPZREEOHVRIDFFXPXODWLRQV IURP 3 FDQ EH REWDLQHG LQ UHODWLRQ WR WKH IUHH VSDFH
7KHVHXQFHUWDLQWLHVJLYHULVHWRGXELRXVQHVVLQFDSDFLW\ SDWKORVVDWDXVLQJWKHZHOONQRZQSDWKORVVHTXDWLRQ
DQGFRYHUDJHRIDQHWZRUNGLVFXVVHGEHORZ >@PHQWLRQHGEHORZDV
3.3. Place Time Coverage
$V ZH FDQ VHH IURP HTXDWLRQ WKH UHFHLYHG VLJQDO
VWUHQJWKDWDFHUWDLQGLVWDQFHµG¶IURP7[LVSULPDULO\
LQIOXHQFHGE\WKHSDWKORVVH[SRQHQWµQ¶
1RZ OHW XV DVVXPH WKDW D SHUVRQ IURP VRPHZKHUH
UHDFKHVSRLQW3DQGVWDQGVEHWZHHQ7[DQG5[SDWKVHH
)LJ,QVXFKDFDVHWKHSDWKORVVZLOOQRWEHWKHVDPH
DVZKDWLVJLYHQLQHTXDWLRQ/LNHZLVHLIPRUHSHRSOH
VXUURXQG 5[ WKHUH ZLOO EH VXEVHTXHQW GURSV LQ WKH
UHFHLYH VLJQDO YDOXH ,I DQ 163 GHFLGHV WR GHSOR\ D
PRELOH:&1XVLQJVWDQGDUGSDWKORVVPRGHOVWKHQWKH
GHSOR\HGQHWZRUNRXJKWWRIDLOLQVXFKFRQGLWLRQV
7KHQHZYDOXHRI3/(FDQEHH[SUHVVHGDV
nvar = n + NAR
)LJ3ODFHWLPHFRYHUDJHG\QDPLFSDWKORVVPRGHO
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
RIHTXDWLRQVKRZVWKDWXVHUMKDVUDLVHGDGHPDQGWR
FDWHUDYROXPHRIGDWD'MZKLOHEHLQJDWSRVLWLRQSMDQG 4.1. AI-Assisted Architecture
WKHVHFRQGWHUPVKRZVWKHDJJUHJDWLRQRIGDWDYROXPHV
ZKLOHLQPRWLRQ:HFDQH[WHQGHTXDWLRQIRURWKHU
LQGLYLGXDOXVHUVDQGJURXSVVHH)LJ:HFDQDOVR
VHHWKDWLQ)LJWKDWHDFKXVHUFUHDWHVLWVRZQORFXVRI
37&GHPDQGZKLFKLVDQHTXLYDOHQWWRWKHUHTXLUHPHQW
RIDGGLWLRQDOUHVRXUFHV
3.5. PTC2: Need of unorthodox approach
7KHUH DUH D YDULHW\ RI ZD\V DQG FRPSOH[LWLHV WR
LGHQWLI\DQGGHILQH37&DQG37&RDQGWKHGLVFXVVLRQV
LQ VXEVHFWLRQV DQG DUH FRQILQHG WR IHZHU
SDUDPHWHUV 1RQHWKHOHVV DV ERWK 37& DQG 37&R
GHSHQG RQ G\QDPLFV ZLWKLQ WKH QHWZRUN DUHD WKH\
XVXDOO\ FRPSOHPHQW HDFK RWKHU :H KDYH FRPELQHG
WKHP ZLWK WKH FRPPRQ GHILQLWLRQ RI SODFH WLPH )LJ$,$VVLVWHG$UFKLWHFWXUH
FRYHUDJH DQG FDSDFLW\ RU 37& >@ WR LQGLFDWH WKHLU
FRUUHODWLRQ )LJVKRZVDQ$,$VVLVWHG$UFKLWHFWXUH$$$WKDWLV
)URPRXU SUHYLRXV GLVFXVVLRQV ZH FDQ FRQFOXGHWKDW IRXQG SRWHQW WR KDQGOH WKH RVWHQWDWLRXV QHWZRUN
WKH 37& EHLQJ DQ DJJUHJDWLRQ RI WKH G\QDPLF EHKDYLRU $$$ LV H[SHFWHG WR KDYH WKH IROORZLQJ
EHKDYLRUVRIDOOXVHUVLQDQHWZRUNFDQQRWEHKDQGOHG FRPSRQHQWV
E\FRQYHQWLRQDOQHWZRUNSODQQLQJDQGGHSOR\PHQW:H DQHIILFLHQWPDFKLQHWKDWKDVVXIILFLHQWFDSDFLW\WR
QHHG µLQWHOOLJHQFH¶WR XQGHUVWDQG LWV EHKDYLRU ,Q WKH FRQWUROODUJHGDWDDQGIXQFWLRQV
QH[W DQG ILQDO VHFWLRQ RI WKLV SDSHU KRZ DUWLILFLDO WKH VHW RI GHHS OHDUQLQJ DQG FRJQLWLYH UHVSRQVH
LQWHOOLJHQFHFDQKDQGOHWKLVFKDOOHQJHLVHODERUDWHG DOJRULWKPV WR LWHUDWLYHO\ FRQILJXUH DQG GULYH WKH
QHWZRUN DFFRUGLQJ WR WKH FRQWHQWLRXVQHVV RI WKH
4. DEALING WITH PTC2 ‘ARTIFICIAL V\VWHP
INTELLIGENTLY’ DQ $,DVVLVWHG QHWZRUN PHDQV DOO WKH QHWZRUN
HTXLSPHQWDUHFRQWUROOHGE\WKH$,PDFKLQH
'HVSLWH HIILFLHQW QHWZRUN SODQQLQJ DQG YROXPHV RI
LQYHVWPHQWV LQ RSWLPL]DWLRQ DQG UHYDPSLQJ RI 4.2. How should AAA respond to the PTC2?
QHWZRUNV:&1VDUHQRWDEOHWRJHWULGRI37&DQGLW
LVDQHWHUQDODQGSHUSHWXDOSKHQRPHQRQ :LWKIXWXUH 7KHIXQFWLRQLQJRI$$$LVGLVFXVVHGEHORZ
GHPDQG RQ PRUH WKURXJKSXW KXPRQJRXV XVHU
PRELOLWLHV DQG PDQ\ PRUH GHYLFHV ZLWK WKH ODWHVW 4.2.1. Information aggregation
EHLQJ WKH ,QWHUQHW RI WKLQJV ,R7 WKH 37& LV
XQGRXEWHGO\ D VLJQLILFDQW ZRUU\ 7KH LQFUHDVLQJ XVHU ,WLVH[SHFWHGWKDWERWKWKHEDVHVWDWLRQVQHWZRUNDQG
GHQVLWLHV DQG FRQYHQLHQW EXW SRZHUIXO KDQGKHOG FRUH QHWZRUN EH FRQQHFWHG ZLWK WKH FRPPRQ $,
GHYLFHV LQFUHDVH WKH FKDQFHV RI IUHTXHQW DQG VHYHUH SODWIRUPKDQGOHGE\WKH$,PDFKLQH,QWKLVZD\WKH
ZREEOHVRI DFFXPXODWLRQVDQG PRYHPHQWV LQ JURXSV FKDQJH LQ WKH HQYLURQPHQWDO FKDUDFWHULVWLFV DQG XVHU
ZKLFKLVXQGRXEWHGO\JRLQJWR KXUW PRUH$V :&1V ZREEOHVWKDWDUHVHQVHGE\WKHRQVLWHEDVHVWDWLRQVFDQ
DUHSODQQHGEDVHGRQVRPHVSHFLILFXVHUGLVWULEXWLRQV EHVHQWWRWKHFHQWUDOFRPSXWHUWROHDUQWKHHQYLURQPHQW
WKHFXVKLRQIRUXVHUVURDPLQJLQWRDVLWHLVYHU\QDUURZ XVHUEHKDYLRUV7KLVLVWREHQRWHGWKDWHQYLURQPHQWDQG
ZKLFK RIWHQ OHDGV WR QHWZRUN FRQJHVWLRQ ,I WKH XVHU EHKDYLRU DUH GLVWLQFW IXQFWLRQV $Q HQYLURQPHQW
SUREOHPLVLWLQHUDQWDQGFODQGHVWLQHWKHRQO\ZD\RXW FDQEHYDULHGE\DFKDQJHLQWKHPDWHULDOFRPSRVLWLRQ
LVWRKDQGOHLWµLQWHOOLJHQWO\¶,QYROYHPHQWRIPDFKLQHV ZKLFK FKDQJHV WKH GLHOHFWULF SURSHUW\ RI WKH
WRSHUIRUPLQWHOOLJHQWWDVNVLVHYHQEHWWHUDVWKHQWKH HQYLURQPHQWDQGWKHUHIRUHLVSXUHO\DFRYHUDJHLVVXH
V\VWHPLV PRUH UREXVW DQG DFFXUDWH 7KLV OHDGV XV WR 37&R:KHUHDVWKHDFFXPXODWLRQRIXVHUVLVERWKD
SURSRVHWKHSHUFRODWLRQRIDUWLILFLDOLQWHOOLJHQFH$,LQ FRYHUDJH FKDQJH LQ PDWHULDO GLHOHFWULF DQG FDSDFLW\
WKH :&1 V\VWHP /DWHU VHFWLRQV VKDOO HODERUDWH WKLV FKDQJHLQWKHFRXQWRIXVHUGHYLFHVLVVXH%RWKWKHVH
VFRSH FKDQJHVFDQEHVHQVHGE\DQLQWHOOLJHQWDQWHQQDV\VWHP
DQG DGYDQFHG EDVH VWDWLRQV :H KDYH GLVFXVVHG RQFH
VXFKNLQGRIVPDUWQHWZRUNV\VWHPLQRXUZRUN>@
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
4.2.2. Deep Learning DOJRULWKPV HWF DUH VRPH RI WKH PDQ\ DUHDV WR EH
ZRUNHGRQ1RQHWKHOHVVLWPXVWEHVDLGWKDW$,LVDQ
$OWKRXJK WKH 37& ZREEOHV PD\ VHHP UDQGRP WKH\ LQHYLWDEOHSDUDGLJPWKDWLV\HWEXWYHU\VRRQWRFRPH
DUHQRWHQWLUHO\VR,ILWLVREVHUYHGPRVWRIWKHVHYHUH IXOOIOHGJHG
ZREEOHV DUH WULJJHUHG E\ VRPH SHULRGLF HYHQWV OLNH
FDUQLYDOV DQG IHVWLYDOVDQG VR RQ ,W LV SURSRVHG WKDW REFERENCES
WKLVSDUWLVWREHGRQHE\WKHGHHSOHDUQLQJDOJRULWKPV
6XFKDOJRULWKPVFDQSUHFLVHO\LGHQWLI\WKHORFDWLRQVDQG >@ .XPDU$PEXM3/0HKWDDQG53UDVDG³3ODFH
PDQ\RIZREEOHVLIQRWDOORIWKHPWKHQDWOHDVWPDQ\ 7LPH &DSDFLW\ ± $ QRYHO FRQFHSW IRU GHILQLQJ
RIWKHP$OVRZLWKHIILFLHQWGHHSOHDUQLQJDOJRULWKPV FKDOOHQJHVLQ*QHWZRUNVDQGEH\RQGLQ,QGLD´
WKHV\VWHPFDQLGHQWLI\ZKHUHWKHJURXSVRISRWHQWLDO ,((( *OREDO &RQIHUHQFH RQ :LUHOHVV
XVHUV DUH KHDGLQJ WR 7KHUHIRUH ZH KDYH WR LQYROYH &RPSXWLQJ DQG 1HWZRUNLQJ *&:&1
FDSDEOHPDFKLQHVWKDWFDQDJJUHJDWHDOOWKHLQIRUPDWLRQ SS±
DQG SURFHVV LW LQ D VLQJOH WLPH WR LGHQWLI\ WKH
SRVVLELOLWLHV RI DFFXPXODWLRQV DQG WKH DGGLWLRQDO >@ .XPDU$PEXM³$FWLYH3URELQJ)HHGEDFNEDVHG
UHVRXUFHUHTXLUHPHQW7KHSUHGLFWLRQVKRZHYHUFDQEH 6HOI&RQILJXUDEOH,QWHOOLJHQW'LVWULEXWHG$QWHQQD
PRGLILHG RU UHJHQHUDWHG LWHUDWLYHO\ E\ FRQWLQXRXVO\ 6\VWHP)RU5HODWLYHDQG,QWXLWLYH&RYHUDJHDQG
SURFHVVLQJ WKH QHWZRUN LQIRUPDWLRQ DQG OHDUQLQJ WKH &DSDFLW\ 3UHGLFWLRQV IRU 3URDFWLYH 6SHFWUXP
QHWZRUN 6HQVLQJ DQG 0DQDJHPHQW´ $DOERUJ 8QLYHUVLW\
4.2.3. Disseminating actions
>@ &LVFR9LVXDO1HWZRUNLQJ,QGH[³*OREDO0RELOH
2QFH WKH V\VWHP NQRZV WKH SUREDEOH SUREOHPDWLF 'DWD 7UDIILF )RUHFDVW 8SGDWH :KLWH
ORFDWLRQV WKH $, PDFKLQH FDQ DOORFDWH WKH QHZ 3DSHU´
FRQILJXUDWLRQRIWKHQHWZRUNZKLFKFDQEHREVHUYHGE\ KWWSVZZZFLVFRFRP
WKHFRQQHFWHGVPDUWHTXLSPHQWVXFKDVVPDUWDQWHQQDV FHQXVVROXWLRQVFROODWHUDOVHUYLFHSURYLGHU
DQGLQWHOOLJHQW%6V YLVXDOQHWZRUNLQJLQGH[YQLPRELOHZKLWHSDSHU
,WLVWREHQRWHGWKDWD:&1LVDFORVHGV\VWHP7KLV FKWPO
PHDQV WKDW HYHQ WKRXJK WKLQJV DUH G\QDPLF LQ WKH
V\VWHP WKHUH LV D PDUJLQDO FKDQJH LQ WKH QXPEHU RI >@ KWWSZZZLWXLQWHQ,78'6WDWLVWLFV
XVHUV+HQFHWKHUHFRQILJXUDWLRQRIWKHQHWZRUNPD\ 'RFXPHQWVIDFWV,&7)DFWV)LJXUHVSGI
UHTXLUH WKH VKLIWLQJ RI FDUULHU FKDQQHO IURP RQH EDVH
VWDWLRQ WR DQRWKHU DQG GRZQWLOWLQJ WKH DQWHQQDV WR >@ ,78 5(&200(1'$7,21 ³,785 0
FRQILQH UHVRXUFHV VHH )LJ +RZHYHU PDQ\ WLPHV ,079LVLRQ ±)UDPHZRUNDQGRYHUDOOREMHFWLYHV
WKHDFFXPXODWLRQLVVRVHYHUHWKDWHYHQWKHVKLIWLQJRI RI WKH IXWXUH GHYHORSPHQW RI ,07 IRU DQG
UHVRXUFHVGRHVQRWVROYHWKHSUREOHP,QVXFKFDVHVDQ EH\RQG´
$$$ V\VWHP FDQ DOVR XVH WKH RQGHPDQG EDVLV RI
VSHFWUXPDOORFDWLRQWRKDYHWKHWLPHEDVHGDGGLWLRQDO >@ : (UWHO ,QWURGXFWLRQ WR $UWLILFLDO ,QWHOOLJHQFH
VSHFWUXPWRFDWHUHQRUPRXVDFFXPXODWLRQVDVVKRZQ 6SULQJHU6FLHQFH %XVLQHVV0HGLD
LQ)LJ
>@ ³0DWKHPDWLFV 6WDFN ([FKDQJH´ >2QOLQH@
4.2.4. Integrating Alternate Solutions $YDLODEOH
KWWSPDWKVWDFNH[FKDQJHFRPTXHVWLRQV
6HYHUDO UHVHDUFK ZRUNV DUH EHLQJ GRQH WR FDWHU XVHUV
WKURXJK DOWHUQDWLYH ZD\V 7KH PRVW SURPLVLQJ DQG
ORRNHGXSRQVROXWLRQLVXVLQJXQPDQQHGDHULDOYHKLFOHV >@ *ULEELQ -RKQ ³,Q 6HDUFK RI 6FKURGLQJHU
V &DW
DNDGURQHVLQVWHDGRIXVLQJJURXQGIL[HGVWUXFWXUHVIRU 4XDQWXP 3K\VLFV DQG 5HDOLW\´ 5DQGRP +RXVH
PRXQWLQJ EDVH VWDWLRQV %6 >@ 3XUQLPD HW DO 3XEOLVKLQJ *URXS S ,6%1
SURSRVHG$HULDO+HWQHWWKDWIROORZVPRYLQJFURZGV
$, FDQ DOVR SOD\ D SULPDU\ UROH LQ LQWHJUDWLQJ VXFK
DOWHUQDWH VROXWLRQV WR ZRUN LQ FRRUGLQDWLRQ ZLWK WKH >@ & $VK ³7KH 3UREDELOLW\ 7XWRULQJ %RRN $Q
SULPH QHWZRUN WR RIIORDG WKH DGGLWLRQDO UHVRXUFH ,QWXLWLYH&RXUVHIRU(QJLQHHUVDQG6FLHQWLVWV´
GHPDQG (GLWLRQ1HZ<RUN:LOH\,(((3UHVV
$ ORW RI ZRUN LV UHTXLUHG WR EH GRQH LQ WKLV UHJDUG
$FWLYH DQG VPDUW QHWZRUNV GHHS OHDUQLQJ FRJQLWLYH
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
4. TIME-SERIES GENERATION BASED ON RFFXUUHG WKH UXQ OHQJWK ୲ ZLOO GURS WR ]HUR
ENERGY PRIMARY USER DETECTION RWKHUZLVHWKHUXQOHQJWKLVLQFUHDVHGE\RQH:HXVH
SEQUENCE WKH %2/ DOJRULWKP WR FDOFXODWH WKH SRVWHULRU UXQ
OHQJWK DW WLPH W LH ሺ୲ ȁଵǣ୲ ሻǡ VHTXHQWLDOO\ 7KLV
$IWHUWKHGHWHFWLRQRIWKHLQVWDQWDQHRXVSULPDU\XVHU SRVWHULRULVXVHGWRPDNHRQOLQHSUHGLFWLRQVUREXVWWR
FKDQQHO VWDWH ୲ LH 38 VLJQDO SUHVHQW RU 38 XQGHUO\LQJUHJLPHFKDQJHVWKURXJKPDUJLQDOL]DWLRQ
DEVHQWEDVHGRQWKHHQHUJ\GHWHFWRUDVH[SODLQHGLQ RIWKHUXQOHQJWKYDULDEOHDVIROORZV
WKH SUHYLRXV VHFWLRQ RWKHU VSHFWUXPVHQVLQJ
DOJRULWKPV VXFK DV GDWD IXVLRQ EDVHG FRRSHUDWLYH ሺ୲ାଵ ȁଵǣ୲ ሻ ൌ ሺ୲ାଵ ȁଵǣ୲ ǡ ୲ ሻሺ୲ ȁଵǣ୲ ሻ
VHQVLQJDSSURDFKFRXOGEHDOVRXVHGKHUH2XUQH[W ୰౪
JRDOLVWRSUHGLFWWKHQHDUIXWXUHRIWKHSULPDU\XVHU ൌ σ୰౪ ሺ୲ାଵ ȁ୰ ሻሺ୲ ȁଵǣ୲ ሻ
FKDQQHOVWDWH,QRUGHUWRGRVRZHGHQRWHWKHSHULRG
WKDWWKHSULPDU\XVHUVLJQDOLVDV³LGOHVWDWH´ ZKHUH ୰ UHIHUV WR WKH VHW RI REVHUYDWLRQV
DQGWKHSHULRGWKDWWKHSULPDU\XVHU VLJQDO ୲ DVVRFLDWHG ZLWK UXQ OHQJWK୲ DQGሺ୲ାଵ ȁ୰ ሻLV
DV³RFFXSLHGVWDWH´$QGWRHVWLPDWHWKHWLPHZKHQ FRPSXWHG XVLQJ WKH XQGHUO\LQJ SUHGLFWLYH PRGHO
WKHFKDQQHOVWDWHZLOOVZLWFKIURPLGOHWRRFFXSLHGRU 830WKHWUDLQLQJPRGHOVHWWRILQGሺ୲ ǡ ଵǣ୲ ሻZH
YLFHYHUVDLHWKHFKDQJHSRLQWVWLPHZHJHQHUDWH HVWLPDWH WKH UXQ OHQJWK GLVWULEXWLRQሺ୲୧ ǡ ଵǣ୲ ሻ IRU
D WLPH VHULHV ୲ WR FDSWXUH WKH LQVWDQWDQHRXV ൌ ͳǡ ʹǡ Ǥ Ǥ Ǥ ǡ RIUXQOHQJWK୲ )RUHDFKWLPHVWHSǡ
GHWHFWLRQ VHTXHQFH VLJQDO୲ 7KHQ ZH WUDQVIHU WKH WKH UXQ OHQJWK GLVWULEXWLRQ FRQWDLQV HOHPHQWV RI
WZR VWDWHV RI WKH WLPH VHULHV ³38 SUHVHQW´ RU SUREDELOLWLHV VXFK WKDWσ୲୧ୀଵ ୲୧ ൌ ͳǤ7KH UXQ OHQJWK
³DEVHQW´ LQWR REVHUYDWLRQV XVLQJ WZR GLIIHUHQW SRVWHULRULVIRXQGE\QRUPDOL]LQJWKHMRLQWOLNHOLKRRG
UDQGRP GLVWULEXWLRQV IRU HDFK VWDWH LH ୲ א DV
ሼଵ ǡ ଶ ǥ ሽ IRU LGOH VWDWH DQG ୲ א
ሼାଵ ǥ Ǥ ሽIRURFFXSLHGVWDWH7KHHTXDWLRQWKDW ሺ୲ ȁଵǣ୲ ሻ ൌ σ ౪ భǣ౪
ሺ୰ ǡ୶ ሻ
FDSWXUH 38 GHWHFWLRQ VHTXHQFH୲ FDQ EH ZULWWHQ DV ౨౪ ሺ୰౪ǡ୶ ሻ
భǣ౪
IROORZV
,IZHGHQRWHWKHMRLQWOLNHOLKRRGGLVWULEXWLRQRIWKH
ሼଵ ǡ ଶ ǡ ǥ ǡ ሽ୲ ൏ ɉ UXQ OHQJWK ୲ DW WLPH IRU WKH REVHUYHG GDWD
ǡ
୲ א൝ ሼାଵ ǡ Ǥ Ǥ Ǥ ǡ ሽ୲ ɉ ଵǣ୲ ǡ ሺ୲୧ ǡ ଵǣ୲ ሻDVԄ୲ ሺ୲୧ ǡ ଵǣ୲ ሻZH FDQ XSGDWH
ͳ WKHMRLQWOLNHOLKRRGRQOLQHUHFXUVLYHO\XVLQJ
:HFDQQRWHWKDW ୲ݔIRUPXODWHVDWLPHVHULHVRIWZR Ԅ୲ ൌ ሺ୲୧ ǡ ଵǣ୲ ሻ ሺȁሻሺሻ
QRQRYHUODSSLQJ VWDWHV WKH WLPH 7 7KH ൌ ൫୲୧ ǡ ଵǣ୲ หሺ୲ିଵሻ୧ ǡ ଵǣ୲ିଵ ൯ሺ୲ିଵ ǡ ଵǣ୲ିଵ ሻ
HIIHFWLYHQHVV RI WKH %D\HVLDQ RQOLQH OHDUQLQJ
ሺ୰౪ ିଵሻ୧
DOJRULWKPLQSUHGLFWLQJWKHFKDQJHSRLQWVLQVXFKD
ൌ σሺ୰౪ ିଵሻ୧ ൫୲୧ หǡ ሺ୲ିଵሻ୧ ൯ሺ୲ ȁሺ୲ିଵሻ୧ ǡ ୰ ሻ
WLPH VHULHV KDV EHHQ VKRZQ LQ PDQ\ DSSOLFDWLRQV
VXFKDVILQDQFHELRPHWULFVDQGURERWLFV>@
ZKHUH ൫୲୧ หǡ ሺ୲ିଵሻ୧ ൯ LV WKH FKDQJHSRLQW SULRU RU
5. TIME-SERIES PREDICTION BASED ON KD]DUGIXQFWLRQDQGሺ୲ ȁሺ୲ିଵሻ୧ ǡ ୰ ሻLVWKHOLNHOLKRRG
BAYESIAN ONLINE LEARNING RUWKHXQGHUO\LQJSUHGLFWLYHPRGHO830WKHPRGHO
ALGORITHM WUDLQLQJGDWDVHW$OOWKHGLVWULEXWLRQVPHQWLRQHGVR
IDU DUH LPSOLFLWO\ FRQGLWLRQHG RQ WKH VHW RI K\SHU
:H DVVXPH D VHTXHQFH RI REVHUYDWLRQV ୲ ൌ SDUDPHWHUVɅ
ଵ ǡ ଶ ǡ ଷ ǡ ǥ ZLWK WZR QRQRYHUODSSLQJ VWDWHV DV
$VVXPLQJ D VLPSOH %2/ PRGHO UHSUHVHQWHG XVLQJ D
GHQRWHG E\ HTXDWLRQ 7KH GHOLQHDWLRQV EHWZHHQ
FRQVWDQW KD]DUG IXQFWLRQሺȁɅ୦ ሻ ǣ ൌ Ʌ୦ WKLV PHDQV
WKHWZRQRQRYHUODSSLQJVWDWHVDUHFDOOHGWKHFKDQJH
ሺ୲ ൌ Ͳȁ୲ିଵ ǡ Ʌ୦ ሻ LV LQGHSHQGHQW RI ୲ିଵ DQG LV
SRLQWV7RGHWHUPLQHWKHVHFKDQJHSRLQWVZHQHHGWR FRQVWDQW :H FDQ UHSUHVHQW WKH XQGHUO\LQJ SUHGLFWLYH
HVWLPDWH WKH SRVWHULRU GLVWULEXWLRQ RYHU WKH FXUUHQW PRGHOZLWKDEDVLFSUHGLFWLYHPRGHOWKDWPRGHODVFDODU
³UXQOHQJWK ୲ ´RU WKH WLPH VLQFH WKH ODVW FKDQJH ୲ ࣬ אሻE\SODFLQJDQRUPDOLQYHUVHJDPPDSULRURQ
SRLQW JLYHQ WKH GDWD VR IDU REVHUYHG 8QGHU WKH LLG*DXVVLDQREVHUYDWLRQV>@
DVVXPSWLRQWKDWFKDQJHSRLQWVRFFXUDVDVWRFKDVWLF
SURFHVV WKH GDWD EHWZHHQ FKDQJHSRLQWV DUH LLG ୲ ̱ሺɊ୲ ǡ ɐ୲ ଶ ሻ
GLVWULEXWHG WKH SDUDPHWHUV DUH LQGHSHQGHQW DFURVV Ɋ୲ ̱ሺɊ ǡ ɐ୲ ଶ ΤɈ୲ ሻǡ ɐ୲ ିଶ ̱
ሺȽ୲ ǡ Ⱦ୲ ሻ
WKH FKDQJHSRLQWV DQG ZKHQ WKH FKDQJHSRLQW KDV
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
)LJ7KHVLPXODWHGGHWHFWLRQVHTXHQFHVLJQDOͳͷͲWLPHSRLQWVXVHGWRWUDLQWKHK\SHUSDUDPHWHUVɅWKHJHQHUDWHGWLPH
VHULHVWRFDSWXUHWKHGHWHFWLRQVHTXHQFHDQGWKHSHUIRUPDQFHRIWKH%2/DOJRULWKPLQSUHGLFWLQJWKHFKDQJHSRLQWVIRU
WLPHSRLQWVWHVWLQJWLPHVHULHVDVVXPLQJWKHWLPHSRLQWLVLQPLOOLVHFRQG ݉ݏ
7KH ERWWRP SORWVKRZV WKH SRVWHULRU SUREDELOLW\ RI ACKNOWLEDGEMENT
WKH FXUUHQW UXQ OHQJWKሺ୲ ȁଵǣ୲ ሻDW HDFK WLPH VWHS
XVLQJ D ORJDULWKPLF FRORU VFDOH WKH OLJKWHU SL[HOV ,JUDWHIXOO\DFNQRZOHGJHWKHIXQGLQJUHFHLYHGIURP
LQGLFDWH KLJKHU SUREDELOLW\ WKH UHG FURVVHV DUH WKH 6KDQJKDL-LDR7RQJ8QLYHUVLW\WRXQGHUWDNHP\3K'
FKDQJHSRLQWV DQG WKH GDUNHU SL[HOV UHSUHVHQW WKH , DOVR WKDQN 3URI %LQ *XR IRU KLV HQFRXUDJHPHQW
FXUUHQW UXQ OHQJWK $V ZH FDQ VHH UXQOHQJWK LV DQGKHOSRQWKHWRSLF
GURSSHGWR]HURLPPHGLDWHO\DIWHUWKHFKDQJHSRLQW
7KH WLPH FRQVXPHG IRU WUDLQLQJ WKH PRGHO LV REFERENCES
PLOOLVHFRQGVZKLOHWKHWHVWLQJWLPHLVRQO\
PLOOLVHFRQGV >@ ,$ $NEDU DQG :+ 7UDQWHU ³'\QDPLF
VSHFWUXP DOORFDWLRQ LQ FRJQLWLYH UDGLR XVLQJ
KLGGHQ0DUNRYPRGHOV3RLVVRQGLVWULEXWHGFDVH´
7. CONCLUSION
LQ3URF,(((6RXWKHDVW&RQSS
,QWKLVSDSHUZHKDYHVWXGLHGWKHSUREOHPVSHFWUXP >@ = &KHQ DQG 5& 4LX ³3UHGLFWLRQ RI FKDQQHO
RFFXSDQF\ SUHGLFWLRQ IRU D VLQJOH XVHU FRJQLWLYH VWDWH IRU FRJQLWLYH UDGLR XVLQJ KLJKHURUGHU
UDGLRQHWZRUNEDVHGRQWKH%D\HVLDQRQOLQHOHDUQLQJ KLGGHQPDUNRYPRGHO´LQ,(((3URFHHGLQJVRI
PRGHO :H PRGHOHG WKH GHWHFWLRQ VHTXHQFH RI WKH 6RXWKHDVW &RQ 6RXWKHDVW &RQ
SULPDU\ XVHU FKDQQHO VWDWH DYDLODELOLW\ DV D WLPH SS
VHULHV FKDQJLQJ RYHU WKH WLPH EHWZHHQ WZR VWDWHV
>@ (&KDW]LDQWRQLRX%$OOHQDQG99HOLVDYOMHYLF
38LGOHDQG38RFFXSLHG:HLQWURGXFHG%D\HVLDQ
³$Q KPPEDVHG VSHFWUXP RFFXSDQF\ SUHGLFWRU
RQOLQHOHDUQLQJWRSUHGLFWLQDGYDQFHWKHFKDQJHVLQ
IRUHQHUJ\HIILFLHQWFRJQLWLYHUDGLR´LQ,(((WK
WKHVWDWHVRIWKHWLPHVHULHV)LQDOO\ZHHYDOXDWHGWKH
,QWHUQDWLRQDO6\PSRVLXPRQ3HUVRQDO,QGRRUDQG
SHUIRUPDQFHRIRXUDOJRULWKPXVLQJDVLPXODWHG38
0RELOH5DGLR&RPPXQLFDWLRQV3,05&
GHWHFWLRQ VHTXHQFH 7KH VLPXODWLRQ UHVXOWV KDYH
SS
YHULILHG WKH HIIHFWLYHQHVV RI WKH %2/ PRGHO LQ
SUHGLFWLQJ38FKDQQHOVWDWHDYDLODELOLW\
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
IUDXG WHFKQLTXHV 7KHQ ZH ZLOO JR RQ WR H[SORUH (GZDUG)HOWHQIURP3ULQFHWRQ8QLYHUVLW\VXFFLQFWO\
EULHIO\ VRPH UHFHQW GDWD EUHDFKHV DQG WKHLUFXUUHQW VXPVXSWKHSURFHVVRIGDWDFROOHFWLRQDQGDQDO\VLV
LPSDFWVDVDVVHVVHGE\WKHF\EHUVHFXULW\FRPPXQLW\ WRGD\>@DVFROOHFWLQJPHUJLQJDQGDQDO\]LQJGDWD
:H ZLOO WLH DOO RI WKLV WRJHWKHU WR H[SODLQ IUDXG WRLQIHUIDFWVDERXWSHRSOH,WLVWKHPHUJLQJSURFHVV
VFHQDULRV WKDW KDYH WKH SRWHQWLDO WR DULVH DV D WKDWJHWVDORWPRUHHIIHFWLYHDVDFRQVHTXHQFHRIWKH
FRQVHTXHQFH RI SLHFLQJ WRJHWKHU WKH DERYH DQG PRVDLFHIIHFW'XULQJWKHILUVWF\FOHRIPHUJLQJGDWD
VXEVHTXHQWO\DQDO\]HKRZDGYDQFHVLQGHHSOHDUQLQJ RQHLVDEOHWRFUHDWHPRUHDFFXUDWHSRUWUDLWVRIXVHUV
WHFKQLTXHVZLOOWXUERFKDUJHWKLVSURFHVV)LQDOO\ZH EXW IROORZRQ F\FOHV FDQ GR WKLV LQ D PRUH UHILQHG
ZLOOORRNDWVRPHFKDOOHQJHVWKDWUHPDLQWREHVROYHG PDQQHUDVWKH\NQRZPRUHDERXWWKHXVHUEHKDYLRU
DQGLGHQWLW\ZKLFKDOORZVIXUWKHUPHUJLQJ
IURP DQ HWKLFDO F\EHUVHFXULW\ UHJXODWRU\ DQG
VRFLHWDO SHUVSHFWLYH 7KH SDSHU PDNHV SUHOLPLQDU\
7KLV DOVR KDV WKH DGGHG EHQHILW RI EHLQJ DEOH WR
UHFRPPHQGDWLRQ WR VHW WKH VWDJH IRU IXWXUH
JHQHUDWH VPDOOHU PRUH KRPRJHQRXV JURXSV LH
GHYHORSPHQWVLQWKLVGRPDLQHVSHFLDOO\DVWKHSDFH LQFUHDVLQJ WKH DELOLW\ WR PLFURWDUJHW LQGLYLGXDOV
RIDGYDQFHVLQ$,TXLFNHQV>@ ZKLOH FUHDWLQJ ILQHJUDLQHG DQDO\VLV WR LQIRUP
SROLF\PDNLQJDGYHUWLVLQJFUHGLWGHFLVLRQVHWFE\
2. KEY IDEAS WKHDFTXLULQJILUPVDWDPDFUROHYHO2QRFFDVLRQ
VRPHRIWKHVHLQVLJKWVDULVHZLWKRXWSULRUNQRZOHGJH
2.1. Data brokers WKDWVXFKDQREMHFWLYHFRXOGEHDFKLHYHGZKHQGDWD
EURNHUV DUH DJJUHJDWLQJ DQG DQDO\]LQJ WKLV
'DWD EURNHUV DUH FRPSDQLHV WKDW VK\ DZD\ IURP LQIRUPDWLRQ
PHGLDH[SRVXUHEXWDUHUHVSRQVLEOHIRUFROOHFWLQJD
YDVWDUUD\RILQIRUPDWLRQ>@DERXWLQGLYLGXDOVYLD 7ZR H[DPSOHV LOOXVWUDWH WKH SRZHU RI
GLIIHUHQWFKDQQHOV2IWHQWKH\DJJUHJDWHLQIRUPDWLRQ GHDQRQ\PL]DWLRQ WKH DELOLW\ WR LGHQWLI\ DQ
IURP SDUWQHUV OLNH VRFLDO PHGLD FRPSDQLHV LQGLYLGXDOLQDQDQRQ\PL]HGGDWDVHWE\FRPELQLQJ
WHOHFRPPXQLFDWLRQILUPVUHWDLOFKDLQVHFRPPHUFH GLIIHUHQWGDWDSRLQWV1HWIOL[PRYLHUDWLQJVDQG$2/
ILUPVHWF$WWKHVDPHWLPHWKHVHDERYHPHQWLRQHG GDWDVHDUFKFRPELQDWLRQ
SDUWQHUV DUH DOVR FOLHQWV WKDW ORRN WR DXJPHQW WKH
SURILOHV WKDW WKH\ KDYH RQ WKHLU FXVWRPHUV .H\ ,Q WKH 1HWIOL[ H[DPSOH >@ HVVHQWLDOO\ DIWHU DQ
FRQFHUQVZLWKWKHRSHUDWLRQVRIWKHGDWDEURNHUVDUH DQRQ\PL]HG GDWDVHW ZDV UHOHDVHG DV SDUW RI D
WKDW WKH\ FROOHFW LQGHSWK LQIRUPDWLRQ DERXW FRPSHWLWLRQE\1HWIOL[WRLQFHQWLYL]HUHVHDUFKHUVWR
FRQVXPHUV DQG WKHLU EHKDYLRUV RIWHQ ZLWKRXW WKHLU FRPH XS ZLWK PRUH HIILFLHQW UHFRPPHQGDWLRQ
FRQVHQW7KHODFNRIFRQVHQWLVDOPRVWOHVVVKRFNLQJ V\VWHPV VRPH UHVHDUFKHUV ZHUH DEOH WR
FRQVLGHULQJWKDWPRVWSHRSOHDUHXQDZDUH>@RIWKH FURVVUHIHUHQFH UDWLQJ VFRUHV RQ UDUH PRYLHV ZLWK
H[LVWHQFHRIWKHVHILUPVDQGWKHGHJUHHRISURILOLQJ WKRVHRQ,QWHUQHW0RYLH'DWDEDVH,0'%ZKLFKKDV
WKDWWKH\FDQGRRQDWDUJHWHGLQGLYLGXDO SXEOLFUDWLQJVWRLGHQWLI\WKHXVHUDQGFRQVHTXHQWO\
UHYHDOLQIHUUHGLQIRUPDWLRQDERXWWKHXVHUVVXFKDV
,QWKHFRQWH[WRIWKLVSDSHUWKHGDWDEURNHUVZLOOEH VH[XDORULHQWDWLRQDQGSRWHQWLDOSROLWLFDODIILOLDWLRQV
LPSRUWDQW EHFDXVH WKH\ RIWHQ DFFXPXODWH GLVSDUDWH
GDWDVHWV FRQWDLQLQJ QRQRYHUODSSLQJ ELWV RI ,QWKHFDVHRI$2/>@LQDQDQRQ\PL]HGGDWDVHW
LQIRUPDWLRQRQDQLQGLYLGXDOZKLFKLIOLQNHGWRJHWKHU WKDW ZDV UHOHDVHG D FORVHU DQDO\VLV RI WKH DFWXDO
FDQ IRUP DQ HYHQ ULFKHU UHSUHVHQWDWLRQ RI WKH VHDUFKTXHULHVKHOSHGWRORFDOL]HWKHXVHUWRDVSHFLILF
LQGLYLGXDOIRUWDUJHWLQJSXUSRVHV UHJLRQ DQG WKHQ FRPELQLQJ WKDW ZLWK VRPH HDVLO\
DFFHVVLEOHSXEOLFLQIRUPDWLRQUHSRVLWRULHVLWEHFDPH
2.2 Mosaic effect SRVVLEOH WR LGHQWLI\ XVHUV ZLWKLQ WKDW DQRQ\PL]HG
GDWDVHW
7KH PRVDLF HIIHFW UHVXOWV LQ D GHHSHU DQDO\VLV E\
FRPELQLQJ VHYHUDO ODUJH GDWDVHWV DQG PDNLQJ 'DWD EURNHUV DOUHDG\ OHYHUDJH WKH PRVDLF HIIHFW WR
FURVVUHIHUHQFHV EHWZHHQ WKHP WR FRDOHVFH FUHDWHULFKFRQVXPHUSURILOHVWKDWWKH\FDQWKHQVHOO
SUHYLRXVO\GHOLQNHGLQIRUPDWLRQLQWRDVLQJOHULFKHU WRFOLHQWVEXWIROORZLQJWKHODUJHVFDOHGDWDEUHDFKHV
SURILOH>@ LW ZLOO QRZ EH SRVVLEOH WR ³XQORFN´ SUHYLRXVO\
GLVMRLQWHG GDWDVHWV YLD DWWULEXWH JURXSV WKDW DFW DV
XQLTXHNH\VWROLQNWKHPWRJHWKHU
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
3. RECENT DATA BREACHES FRGH JLYHV DZD\ LQIRUPDWLRQ RI LQFRPH UDQJHV
DPRQJ RWKHU WKLQJV YLD SXEOLFO\ DYDLODEOH GDWDVHWV
7KLV VHFWLRQ ZLOO EULHIO\ ORRN DW WKH ODUJHVW GDWD IURPWKHQDWLRQDOVWDWLVWLFVGDWDEDVHV
EUHDFKHV WKDW KDYH KDSSHQHG LQ UHFHQW KLVWRU\
ORRNLQJDWWKHVSHFLILFELWVRILQIRUPDWLRQOHDNHGDQG 3.4. Equifax
DKLJKOHYHOYLHZRISRWHQWLDOFRQVHTXHQFHV
(TXLID[LVRQHRIWKHODUJHVWFUHGLWEXUHDXVDQGWKH
3.1. Yahoo PRVWUHFHQWODUJHVFDOHFRPSURPLVHPRUHWKDQ
PLOOLRQ DFFRXQWV ZHUH KDFNHG DQG ELUWK GDWHV
7KH PRVW UHFHQW VWDWHPHQW IURP <DKRR FRQILUPHG DGGUHVVHV VRFLDO VHFXULW\ QXPEHUV 661 DQG LQ
WKDW DOO ELOOLRQ DFFRXQWV >@ ZLWK WKHP ZHUH VRPHFDVHVGULYHUOLFHQVHLQIRUPDWLRQZDVOHDNHG,Q
FRPSURPLVHG ZLWK LQIRUPDWLRQ VXFK DV QDPHV DERXWFDVHVFRQVXPHUVDOVRKDGWKHLUFUHGLW
HPDLODGGUHVVHVGDWHVRIELUWKHQFU\SWHGSDVVZRUGV FDUG LQIRUPDWLRQ H[SRVHG 'DWD EURNHUV DQG RWKHU
IRUVRPHIUDFWLRQRIWKHDFFRXQWVWKHHQFU\SWLRQZDV PDOHYROHQW HQWLWLHV FDQ SLFN XS WKLV LQIRUPDWLRQ
QRWVWDWHRIWKHDUWEHLQJOHDNHGDVZHOODVVHFXULW\ DORQJ ZLWK VRPH RI WKH RQHV PHQWLRQHG EHIRUH WR
TXHVWLRQVDQGDQVZHUV:KDWLVWURXEOLQJKHUHLVWKDW FUHDWHDSUHWW\FRPSUHKHQVLYHSURILOHRILQGLYLGXDOV
IRU H[DPSOH ZHDNO\ HQFU\SWHG SDVVZRUGV DQG ZKR PLJKW KDYH EHHQ SUHVHQW LQ DOO RI WKH DERYH
VHFXULW\TXHVWLRQDQVZHUSDLUVDUHXVXDOO\VLPLODUIRU PHQWLRQHG FRPSURPLVHV 0RUH LPSRUWDQWO\ WKH
XVHUV DFURVV GLIIHUHQW ZHE VHUYLFHV DQG WKLV RSHQV OLQNLQJRI661WRRWKHUELWVRISHUVRQDOO\LGHQWLILDEOH
XSWKHULVNRIXVHUVEHLQJFRPSURPLVHGHOVHZKHUH LQIRUPDWLRQ 3,, SUHSDUHV XQLTXH NH\V WKDW DUH
LQYDOXDEOHLQGHDQRQ\PL]LQJODUJHH[LVWLQJGDWDVHWV
)XUWKHUPRUH WKLV RQO\ KHOSV WR FUHDWH PRUH UREXVW
UDLQERZ WDEOHV >@ ZKLFK FDQ EH XVHG DV DQ HDV\ 4. EVOLUTION OF FRAUD
PHFKDQLVP WR EUHDN WKURXJK RWKHU RQOLQH VHUYLFHV
WKDWKDYHOHVVWKDQLGHDOF\EHUVHFXULW\SUDFWLFHV ,I ZH VWDUW WR FROOHFW DOO WKH GLVSDUDWH SLHFHV RI
LQIRUPDWLRQVSUHDGDFURVVWKHVDPSOHRIODUJHVFDOH
3.2. Adult Friend Finder FRPSURPLVHVPHQWLRQHGKHUHWKHUHDUHWUHPHQGRXV
³XQORFNHG´ GDWDVHWV WKDW FDQ QRZ EH IHG LQWR
$SSUR[LPDWHO\ PLOOLRQ DFFRXQWV ZHUH GLIIHUHQW SDWWHUQ UHFRJQLWLRQ V\VWHPV WR FUHDWH WKH
FRPSURPLVHGLQWKLVOHDNZKLFKUHSUHVHQWHGDERXW QH[W JHQHUDWLRQ RI IUDXG WHFKQLTXHV LH ,GHQWLW\
\HDUV¶ZRUWKRILQIRUPDWLRQFXWWLQJDFURVVGDWDEDVHV 7KHIW
>@7KHORQJWHPSRUDOQDWXUHRIWKLVOHDNSURYLGHV
D XQLTXH ZLQGRZ WR WKH KDFNHU FRPPXQLW\ WR ILQG 6RPHRIWKHUHFHQWUHVHDUFKSURMHFWVFRPLQJRXWRI
WLGELWVRILQIRUPDWLRQLQWHUPVRIERWKROGDQGQHZ $, UHVHDUFK ODEV DFURVV WKH ZRUOG DFW DV SUHVFLHQW
SHUVSHFWLYHVRQWKHRQOLQHLGHQWLWLHVRIWKHXVHUV UHPLQGHUV RI D VRPHZKDW G\VWRSLF IXWXUH LI
FRPELQHG ZLWK WKH LQIRUPDWLRQ OHDNV WKDW ZH
7KLV DOVR FRPHV ZLWK WKH DGGLWLRQDO EXUGHQ RI GLVFXVVHGDERYH$VDQH[DPSOH/\UHELUG>@IURP
UHYHDOLQJXQVDYRU\GHWDLOVRIVRPHRQH¶VRQOLQHOLIH 0RQWUHDO&DQDGDXVHV³OHVVWKDQRQHPLQXWH´YRLFH
ZLWK YHU\ WDQJLEOH UHDOZRUOG FRQVHTXHQFHV 7KLV VDPSOHVIURPDQLQGLYLGXDOWRJHQHUDWHYRLFHRXWSXW
UHSUHVHQWV DQ DOPRVW WLPHV ODUJHU EUHDFK RI WKHP VD\LQJ DQ\ VWDWHPHQW WKDW \RX LQSXW
FRPSDUHGWRWKH$VKOH\0DGLVRQEUHDFK>@ZKLFK /\UHELUGLVQRWSHUIHFW\HWEHFDXVHLWUHTXLUHVKLJK
OHGWRVRPHVXLFLGHV>@ TXDOLW\LQSXWVDPSOHVZLWKDQDUUD\RIVHQWHQFHVEXW
DVWKHWHFKQLTXHLPSURYHVLWZRXOGEHSRVVLEOHWRXVH
3.3. eBay YRLFHVDPSOHVRYHUDWHOHSKRQHFRQQHFWLRQWRFROOHFW
HQRXJKGDWD
,Q WKLV FDVH LQ DOO PLOOLRQ DFFRXQWV >@
ZHUHFRPSURPLVHGOHDGLQJWRWKHUHOHDVHRIQDPHV $UHVHDUFKSDSHUIURPWKH8QLYHUVLW\RI:DVKLQJWRQ
GDWHV RI ELUWK HPDLO DGGUHVVHV SK\VLFDO DGGUHVVHV >@ KLJKOLJKWHG KRZ WKH\ FRXOG WDNH DQ DXGLR
DQGVDOWHGKDVKHGSDVVZRUGVWKRXJKH%D\GHFOLQHG VDPSOH DQG WKHQ V\QWKHVL]H YLGHR RXWSXW RI WKH
WRFRPPHQWRQ WKHDOJRULWKP XVHGWR GRVR :KDW SHUVRQVD\LQJZLWKIDLUO\UHDOLVWLFIDFLDOH[SUHVVLRQV
ZDVRISDUWLFXODUFRQFHUQKHUHLVWKHOHDNRISK\VLFDO DQGKHDGPRYHPHQWVDQ\WKLQJVDLGLQWKHDXGLR,Q
DGGUHVVLQIRUPDWLRQZKLFKDGGVDQRWKHUFUXFLDOOLQN LWVFXUUHQWLWHUDWLRQWKLVLVOLPLWHGLQLWVDSSOLFDWLRQ
WR WKH GDWDEDVHV PDLQWDLQHG E\ GDWD EURNHUV (YHQ EHFDXVHRIWKHQHHGIRUKLJKTXDOLW\YLGHRLQSXWIRU
WKRXJKILQDQFLDOLQIRUPDWLRQZDVQRWOHDNHGEHLQJ WUDLQLQJ SXUSRVHV EXW DJDLQ DV WHFKQLTXHV LPSURYH
DEOHWROLQNWKHSK\VLFDODGGUHVVVSHFLILFDOO\WKH]LS WKLVFRXOGEHDSSOLHGPRUHEURDGO\
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
EHFRPELQHGWRJHWKHUWRFUHDWHPRUHSRZHUIXOWRROV ³+LSSRFUDWLF2DWK´IRU$,GHYHORSPHQWDVDVWDUWLQJ
WKDW KDYH XQVHHQ FRQVHTXHQFHV :LWK VWURQJ SRLQW ZKLFK ZKLOH QRQELQGLQJ FDQ DW OHDVW WULJJHU
LQFHQWLYHVWRPRQHWL]HVXFKDGYDQFHVWKHUHZLOOEH WKH ULJKW FRQYHUVDWLRQV DURXQG WKH GLVWULEXWLRQ RI
DQHPHUJHQFHRIPDQ\QRYHOXVHFDVHVWKDWKDYHWKH UHVSRQVLELOLW\DQGVKDUHWKHRQXVLQWHUPVRIDUULYLQJ
SRWHQWLDO WR GUDPDWLFDOO\ DOWHU RXU QRWLRQ RI DWVROXWLRQVWRKHOSDGGUHVVVRPHRIWKHLVVXHVUDLVHG
RZQHUVKLS RI RXU LGHQWLW\ DQG KRZ ZH SURMHFW LQWKLVSDSHU
RXUVHOYHV RQOLQH ,Q D ZRUOG ZKHUH ZH OLYH
LQFUHDVLQJO\ODUJHUSRUWLRQVRIRXUOLYHVRQOLQHLWLV 2Q WKH GDWD VLGH ZKHUH RUJDQL]DWLRQV WRGD\ FDQQRW
FUXFLDOWKDWZHEHDEOHWRPDQDJHDGYHUVHRXWFRPHV RQO\ FROOHFW DQ LQFUHDVLQJ DPRXQW RI GDWD RQ DQ\
LQGLYLGXDOYLDWKHLURQOLQHDQGVORZO\WKHLUSK\VLFDO
7. CHALLENGES TO BE ADDRESSED DFWLYLWLHVDVZHOOWKH\VWDUWFUHDWLQJDQDELOLW\WRLQIHU
D ORW RI GLIIHUHQW IDFWV DERXW DQ LQGLYLGXDO 2SHQ
*LYHQZKDWKDVEHHQGLVFXVVHGVRIDUWKHUHDUHTXLWH GDWDVHWV WKDWKDYH EHHQ GHDQRQ\PL]HGIDOO SUH\WR
D IHZ FKDOOHQJHV WKDW WKH UHVHDUFK FRPPXQLW\ VRSKLVWLFDWHG VWDWLVWLFDO WHFKQLTXHV DV VKRZQ LQ WKH
LQGXVWU\SROLF\PDNHUVDQGFRQFHUQHGFLWL]HQVQHHG FDVH RI $2/ DQG 1HWIOL[ WKDW OHG WR WKH
WRWKLQNDERXWWRFRPHXSZLWKVROXWLRQVWRPLWLJDWH UHLGHQWLILFDWLRQ RI LQGLYLGXDOV ZKLFK ZLOO QRZ
DGYHUVHRXWFRPHV$WWKHKLJKHVWOHYHOZHQHHGWR UHPDLQLQWKHSXEOLFGRPDLQIRUHYHU:KLOHLWLVJUHDW
RULHQW WKH GHYHORSPHQW DQG GHSOR\PHQW RI WR KDYH UHVHDUFK HIIRUWV WKDW KHOS XV LGHQWLI\ WKH
$,SRZHUHG VROXWLRQV WRZDUGV HQKDQFLQJ KXPDQ VKRUWFRPLQJV RI GHDQRQ\PL]DWLRQ DQG HVSHFLDOO\
ZHOIDUH %XW PRUH VSHFLILFDOO\ WR EH DEOH WRVDIHO\ SXEOLF GHPRQVWUDWLRQV RI WKH PRVDLF HIIHFW ZKLFK
XQORFNWKHEHQHILWVIURP$,GHYHORSPHQWDQGWRKDYH KHOSWRSXWWKHULVNVLQ SHUVSHFWLYHZHQHHGWRIRFXV
WKHPEHGLVWULEXWHGLQDQHTXLWDEOHWUDQVSDUHQWDQG RXU HIIRUWV RQ EHLQJ DEOH WR FUHDWH VDIH ZD\V WR
IDLUPDQQHUZLOOEHRQHRIWKHNH\FKDOOHQJHVIDFLQJ DGYDQFHUHVHDUFKHIIRUWVSDUWLFXODUO\WKRVHLQWKH$,
WKHFRPPXQLW\ FRPPXQLW\EHFDXVHWKH\ UHO\ KHDYLO\ RQ DFFHVV WR
ODUJHGDWDVHWVIRUWUDLQLQJSXUSRVHV
7KHUHDUHTXHVWLRQVDURXQGRXUDELOLW\WR³UHJXODWH´
WKH GHYHORSPHQW RI $,WKLV LGHD ZKLOH QREOH LQLWV 6RPHWHFKQLTXHVOLNHKRPRPRUSKLFHQFU\SWLRQ>@
LQWHQWLRQV JUHDWO\ XQGHUHVWLPDWHV QRW RQO\ WKH KHOSWRDGGUHVVWKLVWRDFHUWDLQGHJUHHE\OHYHUDJLQJ
YDVWQHVV DQG GLVWULEXWHG QDWXUH RI UHVHDUFK DW WKH FU\SWRJUDSKLF DQG VWDWLVWLFDO SULQFLSOHV WR DOORZ
PRPHQWEXWDOVRWKHJUHDWGLIILFXOW\LQEHLQJDEOHWR FRPSXWDWLRQVRQHQFU\SWHGGDWDVHWVZLWKRXWKDYLQJ
ILQGVXFKDERG\WKDWFDQQRWRQO\DVVLPLODWHRQJRLQJ WRUHOHDVHWKHXQGHUO\LQJGDWD\HWOLPLWDWLRQVUHPDLQ
UHVHDUFKIURPDFURVVWKHZRUOGEXWDOVRKDYHWKHULJKW DURXQG WKH KLJK FRVW RI FRPSXWDWLRQV UHTXLUHG WR
MXULVGLFWLRQDOSRZHUVWKDWKDYHEHHQDJUHHGXSRQE\ SURFHVVGDWDLQWKLVIRUP.HHSLQJWKLVLQOLJKWWKHUH
VXFKDFRPPXQLW\WRDFWDVWKHLUUHJXODWRUV GHILQLWHO\ UHPDLQV GDQJHUV RI UHOHDVLQJ SDUWLFXODU
VQLSSHWVRILQIRUPDWLRQEHFDXVHLWLVKDUGWRSUHGLFW
7KH(XURSHDQ8QLRQ(8*HQHUDO'DWD3URWHFWLRQ ZKDW WKLV FDQ EH FRPELQHG ZLWK WR XQORFN RWKHU
5HJXODWLRQ*'35>@VHUYHVDVDJUHDWSUHFHGHQW SUHYLRXVO\H[LVWLQJGDWDVHWV
LQWKHILHOGRIGDWDSULYDF\DQGVHFXULW\RQKRZZH
FDQHOHYDWHWKHULJKWVRIWKHXVHUVDQGVWUHQJWKHQWKH 2WKHU FKDOOHQJHV UHPDLQ OLNH WKH FROOHFWLRQ RI
RZQHUVKLS WKDW WKH\ FDQ KDYH RQ WKHLU 3,, <HW ZH HQFU\SWHG WUDIILF IRU IXWXUH GHFU\SWLRQ ZKHQ QRYHO
QHHGWRZDLWWLOO0D\ZKHQLWFRPHVLQWRHIIHFW PHWKRGV PLJKW EH LQYHQWHG LQFOXGLQJ WKH XVH RI
WRVHH KRZRUJDQL]DWLRQV UHDFWDQGKRZXVHUULJKWV TXDQWXPFRPSXWHUVIXUWKHUGHPRQVWUDWLQJWKHWKUHDW
DFWXDOO\JHWVWUHQJWKHQHG IURPOHDNHGGDWDHYHQLILWLVLQDQHQFU\SWHGIRUPDW
,Q WKH FRQWH[W RI ZLGHO\ GLIIHULQJ VWDQGDUGV DQG 8. CONCLUDING REMARKS
DSSURDFKHVXVHGLQGLIIHUHQWLQGXVWULHVRQHDSSURDFK
WR PLWLJDWH DGYHUVH RXWFRPHV LV WR IROG 7KH UROH RI WKH WHFKQLFDO FRPPXQLW\ LQ SURYLGLQJ
GHFLVLRQPDNLQJDURXQGEHVWSUDFWLFHVLQWRH[LVWLQJ DFFHVVLEOH GLVFRXUVH DQG JXLGLQJ SRSXODU FRYHUDJH
UHJXODWRU\ HQWLWLHV ZLWKLQ WKDW LQGXVWU\ 0RUH VR VSHFLILFDOO\ NHHSLQJ LW ZLWKLQ WKH ERXQGV RI
VKDULQJ FKDOOHQJHV DFURVV UHVHDUFK FRPPXQLWLHV SUDFWLFDOLW\ ZLOO EH FUXFLDO DV WKLV VHUYHV WKH
GLIIHUHQW LQGXVWULHV DQG DFURVV JHRJUDSKLF ERUGHUV VWDNHKROGHUV LQ WDNLQJ DSSURSULDWH GHFLVLRQV UDWKHU
FDQ KDVWHQ WKH SDFH DW ZKLFK ZH GLVFRYHU DQG WKDQ EHLQJ VZD\HG E\ XQLQIRUPHG RSLQLRQV
GHYHORS WKH ULJKW PL[ RI SROLFLHV WKDW SUHVHUYH WKH HVSHFLDOO\IURPDWHFKQLFDOIHDVLELOLW\SHUVSHFWLYH
ULJKWV RI FRQVXPHUV ZKLOH QRW VWLIOLQJ WKH
GHYHORSPHQWRI $,3UDFWLWLRQHUV FDQVHOILPSRVH D
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
MACHINE INTELLIGENCE TECHNIQUES FOR NEXT-GENERATION
CONTEXT-AWARE WIRELESS NETWORKS
7DGLOR(QGHVKDZ%RJDOH,;LDQELQ:DQJDQG/RQJ%DR/H
:HVWHUQ8QLYHUVLW\/RQGRQ&DQDGD
,QVWLWXWH1DWLRQDOGHOD5HFKHUFKH6FLHQWLILTXH,156
8QLYHUVLWHGX4XHEHF0RQWUHDO&DQDGD
(PDLOWDGLORERJDOH#HPWLQUVFD,[LDQELQZDQJ#XZRFD
DQGORQJOH#HPWLQUVFD
Abstract – Next generation wireless networks (i.e., 5G and beyond), which will be extremely dynamic
and complex due to the ultra-dense deployment of heterogeneous networks (HetNets), pose many critical
challenges for network planning, operation, management and troubleshooting. At the same time, the
generation and consumption of wireless data are becoming increasingly distributed with an ongoing
paradigm shift from people-centric to machine-oriented communications, making the operation of future
wireless networks even more complex. In mitigating the complexity of future network operation, new
approaches of intelligently utilizing distributed computational resources with improved context
awareness becomes extremely important. In this regard, the emerging fog (edge) computing architecture
aiming to distribute computing, storage, control, communication, and networking functions closer to
end users, has a great potential for enabling efficient operation of future wireless networks. These
promising architectures make the adoption of artificial intelligence (AI) principles, which incorporate
learning, reasoning and decision-making mechanisms, natural choices for designing a tightly integrated
network. To this end, this article provides a comprehensive survey on the utilization of AI integrating
machine learning, data analytics and natural language processing (NLP) techniques for enhancing the
efficiency of wireless network operation. In particular, we provide comprehensive discussion on the
utilization of these techniques for efficient data acquisition, knowledge discovery, network planning,
operation and management of next generation wireless networks. A brief case study utilizing the AI
techniques for this network has also been provided.
Keywords – $UWLILFLDOPDFKLQHLQWHOOLJHQFHFRQWH[WDZDUHZLUHOHVVPDFKLQHOHDUQLQJRQWRORJ\
1. INTRODUCTION DQWLFLSDWHG IROG FDSDFLW\ LQFUHDVH
FRVWHIIHFWLYHO\)RULQVWDQFHWKHPL[HGXVHRISODQQHG
7KH DGYHQW RI WKH ILIWK JHQHUDWLRQ * ZLUHOHVV DQG FHQWUDOO\ FRQWUROOHG PDFUR%6V DQG UDQGRPO\
QHWZRUNDQGLWVFRQYHUJHQFHZLWKYHUWLFDODSSOLFDWLRQV GHSOR\HG ZLUHOHVV ILGHOLW\ :L)L DFFHVV SRLQWV RU
FRQVWLWXWHWKHIRXQGDWLRQRIDIXWXUHFRQQHFWHGVRFLHW\ IHPWR%6V LQ WKH XOWUDGHQVH KHWHURJHQHRXV QHWZRUN
ZKLFK LV H[SHFWHG WR VXSSRUW ELOOLRQ GHYLFHV E\ +HW1HWUDLVHVVHYHUDOXQH[SHFWHGRSHUDWLRQVFHQDULRV
,+60DUNLW$VWKHVHDSSOLFDWLRQVDQGGHYLFHV ZKLFKDUHQRWSRVVLEOHWRHQYLVLRQDWWKHQHWZRUNGHVLJQ
DUH IHDWXUHG E\ XELTXLWRXVFRQQHFWLYLW\ UHTXLUHPHQWV VWDJH 7KLV UHTXLUHV IXWXUH ZLUHOHVV QHWZRUNV WR KDYH
IXWXUH * DQG EH\RQG QHWZRUNV DUH EHFRPLQJ PRUH VHOIRUJDQL]LQJ FRQILJXULQJ DQG KHDOLQJ FDSDELOLWLHV
FRPSOH[$VLGHIURPWKHFRPSOH[LW\LQFUHDVHRIEDVH EDVHG RQ WKH RSHUDWLRQDO FRQGLWLRQ WKURXJK WKH WLJKW
VWDWLRQV %6V DQG XVHU HTXLSPHQW 8( VLJQLILFDQW FRRUGLQDWLRQ DPRQJ GLIIHUHQW QRGHV WLHUV DQG
FKDOOHQJHVDULVHIURPWKHLQLWLDOQHWZRUNSODQQLQJWRWKH FRPPXQLFDWLRQOD\HUV7KHVHFKDOOHQJHVKLJKOLJKWWKDW
GHSOR\PHQW DQG VLWXDWLRQGHSHQGHQW RSHUDWLRQ DQG H[LVWLQJQHWZRUNGHVLJQVWUDWHJLHVZKLFKXWLOL]HDIDLUO\
PDQDJHPHQWVWDJHV VLPSOH VWDWLVWLFV H[SHULHQFH GHOLYHUV XQDFFHSWDEOH
SHUIRUPDQFH IRU H[DPSOH LQ WHUPV RI VSHFWUXPDQG
7KH QHWZRUN DUFKLWHFWXUH RI * DQG EH\RQG ZLOO EH HQHUJ\HIILFLHQF\FRYHUDJHGHOD\DQGFRVW>@>@
LQHYLWDEO\ KHWHURJHQHRXV DQG PXOWLWLHU ZLWK
XOWUDGHQVH GHSOR\PHQW RI VPDOO FHOOV WR DFKLHYH WKH
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
7KH UDSLGO\ JURZLQJ QXPEHU RI PDFKLQHW\SH DQG VPDUW SKRQHV DOVR VKRZ FOHDU HYLGHQFH RI
FRPPXQLFDWLRQ 07& GHYLFHV FRQWULEXWHV D H[FHSWLRQDO SURFHVVLQJ FDSDELOLW\ DQG
FRQVLGHUDEOHSRUWLRQRIWKHFRPSOH[LW\RIWKLVXOWUDGHQVH FRVWHIIHFWLYHQHVV RI VHPLFRQGXFWRU GHYLFHV 7KHVH
QHWZRUN 0DQ\ RI WKH IXWXUH 07& DSSOLFDWLRQV SURPLVLQJ GHYHORSPHQWV IDFLOLWDWH GLVWULEXWHG
VXSSRUWHG E\ * DQG EH\RQG ZLOO UHTXLUH WKH FRPSXWLQJUHVRXUFHVQRWRQO\LQWKHFORXGEXWDOVRLQ
XQGHUO\LQJ ZLUHOHVV QHWZRUNV WR DFKLHYH KLJK WKHIRJDQGHGJHQRGHV%RWKIRJDQGHGJHFRPSXWLQJ
DYDLODELOLW\UHOLDELOLW\ DQGVHFXULW\ YHU\ VKRUW WUDQVLW DWWHPSW WR SXVK WKH LQWHOOLJHQFH DQG SURFHVVLQJ
WLPHV DQG ORZ ODWHQF\ >@ )XUWKHUPRUH LQ VXFK XVH FDSDELOLWLHVGRZQFORVHUWRZKHUHWKHGDWDRULJLQDWHV
FDVHVXQLQWHUUXSWHGDQGVDIHRSHUDWLRQLVRIWHQWKHWRS
7KHHGJHFRPSXWLQJDLPVWRLQWHJUDWHLQWHOOLJHQFHDQG
SULRULW\ IRU LQVWDQFH FRQQHFWHG YHKLFOHV 7DNLQJ DQ
SURFHVVLQJ SRZHU FDSDELOLWLHV FORVHVW WR WKH RULJLQDO
07& DSSOLFDWLRQ RIIOLQH IRU DQ\ UHDVRQ FDQ FDXVH
GDWD VRXUFH 7KH HGJH QRGH IRU H[DPSOH LQWHOOLJHQW
VLJQLILFDQW EXVLQHVV ORVV RU QRQWROHUDEOH FXVWRPHU
SURJUDPPDEOH DXWRPDWLRQ FRQWUROOHUV 3$&V
H[SHULHQFHDQGPDQ\RIWKH07&GHYLFHVDUHUHVRXUFH GHWHUPLQHV ZKLFK UDZ LQSXW GDWD VKRXOG EH VWRUHG
FRQVWUDLQHGDQGZLOOQRWEHDEOHWRUHO\VROHO\RQWKHLU ORFDOO\RUVHQWWRWKHIRJFORXGIRUIXUWKHUDQDO\VLV
RZQ OLPLWHG UHVRXUFHV WR IXOILOO WKHLU SURFHVVLQJ 2Q WKH RWKHU KDQG LQ WKH IRJ FRPSXWLQJ DOO WKH UDZ
GHPDQGV>@ LQSXW GDWD ZLOO ILUVW EH FRQYHUWHG WR WKH DSSURSULDWH
,QWHUQHWSURWRFROVXFKDV+773EHIRUHEHLQJVHQWWR
'LVWULEXWHG DIIRUGDEOH WKH IRJ QRGHV 7KXV KLJKHUOHYHO GDWD FRQWHQW L V
SURFHVVHG VWRUHG DQG VHQW WR WKH FORXG IRU IXUWKHU
DQDO\VLV LQ WKH IRJ GHYLFHV IRU H[DPSOH LQWHOOLJHQW
AI opportunities URXWHUV DFFHVV SRLQWV ,QWHUQHW RI WKLQJV ,R7
for wireless JDWHZD\V7KXV WKH HGJH DQG IRJ HQDEOHG QHWZRUN
networks
DOORZV GLVWULEXWHG FRPSXWLQJ VWRUDJH FRQWURO
FRPPXQLFDWLRQDQGQHWZRUNLQJIXQFWLRQVE\UHGXFLQJ
0DVVLYHGDWDDYDLODELOLW\ WKHGDWDWUDQVPLWWHGDQGZRUNORDGRIWKHFORXGODWHQF\
FKDUDFWHULVWLFV
DQG V\VWHP UHVSRQVH WLPH HVSHFLDOO\ IRU DSSOLFDWLRQV
GHPDQGLQJ ORFDOL]HG DQG ORFDWLRQGHSHQGHQW
)LJ)DYRUDEOHFRQGLWLRQVIRUWKHDGRSWLRQRIPDFKLQH LQIRUPDWLRQ >@ 0RUHRYHU WKH QRGH XVHU VHQVRU RU
LQWHOOLJHQFHWHFKQLTXHVLQWKHQH[WJHQHUDWLRQ 07& GHYLFH LV SRWHQWLDOO\ FDSDEOH RI JHQHUDWLQJ UDZ
ZLUHOHVVQHWZRUNV GDWDDQGSURFHVVHGGDWDDWGLIIHUHQWJUDQXODULW\OHYHOV
ZKLFKXOWLPDWHO\KHOSVWKHQHWZRUNWRKDYHDPDVVLYH
$VDUHVXOWWKHVHODWHQF\FULWLFDODSSOLFDWLRQVFDQQRWEH DPRXQW RI GDWD H[KLELWLQJ D SDWWHUQ 7KLV ZLOO KHOS
PRYHGWRWKHQHWZRUNFRQWUROOHURUFORXGGXHWRGHOD\ GLIIHUHQW QRGHV WR OHYHUDJH GDWD PLQLQJ DQG DQDO\WLFV
EDQGZLGWKRURWKHUFRQVWUDLQWV0RUHRYHUWKHGDWDVHWV WHFKQLTXHVWRSUHGLFWUHOHYDQWQHWZRUNPHWULFVVXFKDV
JHQHUDWHGIURPWKHVHGHYLFHVZLOOEHH[WUHPHO\GLYHUVH XVHU PRELOLW\ WUDIILF EHKDYLRU QHWZRUN ORDG
DQG PD\ KDYHODUJHVFDOHPLVVLQJ LQDFFXUDWH YDOXHV IOXFWXDWLRQFKDQQHOYDULDWLRQVDQGLQWHUIHUHQFHOHYHOV
>@ ,Q DGGLWLRQ D QXPEHU RI QHZ GDWD KXQJU\ 07&
LPPHUVLYH XVHFDVHV ZLOO DULVH LQFOXGLQJ ZHDUDEOHV $OO WKHVH RSSRUWXQLWLHV HQDEOH HIILFLHQW DQG IOH[LEOH
YLUWXDO UHDOLWLHV LQWHOOLJHQW SURGXFW DQG VXSSRUW UHVRXUFH DOORFDWLRQ DQG PDQDJHPHQW SURWRFRO VWDFN
V\VWHPVZKHUHPRVWRIWKHPZLOOXVHEXLOWLQEDFNHQG FRQILJXUDWLRQ DQG VLJQDOLQJ SURFHGXUH DQG SK\VLFDO
GDWD LQIUDVWUXFWXUH DQG DQDO\WLFV HQJLQH WR SURYLGH OD\HU RSWLPL]DWLRQ DQG IDFLOLWDWH H[LVWLQJ GHYLFHV WR
FRQWH[WDZDUH VHUYLFHV $OO WKHVH QHFHVVLWDWHWKH QH[W KDUQHVV WKH SRZHUV RI VHQVRUV HGJH IRJ DQG
JHQHUDWLRQQHWZRUNLH*DQGEH\RQGWRDGRSWDQ FORXGEDVHG FRPSXWLQJ SODWIRUPV DQG GDWD DQDO\WLFV
LQWHOOLJHQW DQG FRQWH[WDZDUH DSSURDFK IRU QHWZRUN HQJLQHV>@>@7KHVHDOVRFUHDWHIDYRUDEOHFRQGLWLRQV
SODQQLQJGHVLJQDQDO\VLVDQGRSWLPL]DWLRQ WRHQJLQHHU D WLJKWO\ LQWHJUDWHG ZLUHOHVV QHWZRUN E\
DGRSWLQJ WKH $, SULQFLSOHV VHH)LJ LQFRUSRUDWLQJ
:HDUHLQWKHEHJLQQLQJSKDVHRIDQLQWHOOLJHQWHUDWKDW OHDUQLQJ UHDVRQLQJ DQG GHFLVLRQPDNLQJ PHFKDQLVPV
KDVEHHQGULYHQE\WKHUDSLGHYROXWLRQRIVHPLFRQGXFWRU ZKLFK DUH FUXFLDO WR UHDOL]H WKH FRQWH[WDZDUHQHVV
LQGXVWULHV FRPSXWLQJ WHFKQRORJLHV DQG GLYHUVH XVH FDSDELOLW\$W\SLFDOQH[WJHQHUDWLRQQHWZRUNXWLOL]LQJ
FDVHV 7KLV LV ZLWQHVVHG E\ WKH WLJKW LQWHJUDWLRQ RI WKH$, SULQFLSOHVDWGLIIHUHQWQRGHVLVVKRZQLQ)LJ
QHWZRUNHG LQIRUPDWLRQ V\VWHPV VHQVLQJ DQG 7RWKLVHQGWKHFXUUHQWSDSHUSURYLGHVDFRPSUHKHQVLYH
FRPPXQLFDWLRQ GHYLFHV GDWD VRXUFHV GHFLVLRQ VXUYH\ RQ WKH XWLOL]DWLRQ RI $, LQWHJUDWLQJ PDFKLQH
PDNLQJ DQG F\EHUSK\VLFDO LQIUDVWUXFWXUHV 7KH OHDUQLQJ GDWD DQDO\WLFV DQG QDWXUDO ODQJXDJH
SUROLIHUDWLRQRIWLQ\ZLUHOHVVVHQVRUVDQG07&GHYLFHV SURFHVVLQJ 1/3 WHFKQLTXHV IRU HQKDQFLQJ WKH
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
HIILFLHQF\RIZLUHOHVVV\VWHPV:HSDUWLFXODUO\IRFXVRQ SUHGLFWVWKDWWKHVDPHFRQWHQWZLOOEHUHTXHVWHGLQWKH
WKHXWLOL]DWLRQRIWKHVHWHFKQLTXHVIRUHIILFLHQWZLUHOHVV QHDUIXWXUH>@>@
GDWD DFTXLVLWLRQ DQG NQRZOHGJH GLVFRYHU\ SODQQLQJ
DQG RSHUDWLRQ DQG PDQDJHPHQW RI QH[W JHQHUDWLRQ 0RUHRYHUVLQFHGLIIHUHQWXVHUVPD\UHTXHVWWKHVDPH
ZLUHOHVV QHWZRUNV $EULHI FDVH VWXG\ VKRZLQJ WKH FRQWHQW ZLWK GLIIHUHQW TXDOLWLHV HDFK HGJH QRGH PD\
XWLOL]DWLRQ RI $, WHFKQLTXHV IRU WKLV QHWZRUN KDV DOVR QHHGWRFDFKHWKHVDPHFRQWHQWLQGLIIHUHQWJUDQXODULW\
EHHQSURYLGHG IRU H[DPSOH FDFKLQJ YLGHR GDWD ZLWK GLIIHUHQW
UHVROXWLRQV 7KLV IXUWKHU UHTXLUHV WKH HGJH GHYLFH WR
7KH SDSHU LV RUJDQL]HG DV IROORZV ,Q VHFWLRQ ZH DSSO\FRGHGDGDSWLYHFDFKLQJWHFKQLTXHVEDVHGRQWKH
GLVFXVV GDWD DFTXLVLWLRQ DQG NQRZOHGJH GLVFRYHU\ TXDOLW\ RI VHUYLFH4R6UHTXLUHPHQWRIWKHUHTXHVWHU
DSSURDFKHV XVHG LQ $,HQDEOHG ZLUHOHVV QHWZRUNV >@ &RGHG FDFKLQJ DOVR HQDEOHV GHYLFHV WR FUHDWH
7KHQ D FRPSUHKHQVLYH GLVFXVVLRQ RQ KRZ WKLV PXOWLFDVWLQJRSSRUWXQLWLHVIRUFHUWDLQFRQWHQWYLDFRGHG
NQRZOHGJHFDQEHXVHGLQQHWZRUNSODQQLQJRSHUDWLRQ PXOWLFDVWWUDQVPLVVLRQV>@
DQG PDQDJHPHQW RI WKH QH[W JHQHUDWLRQ ZLUHOHVV
QHWZRUN LV JLYHQ LQ VHFWLRQV DQG $ FDVH VWXG\ ,QVRPHFDVHVDJLYHQHGJHIRJPD\FROOHFWGDWHIURP
GLVFXVVLQJ WKH DSSOLFDWLRQV RI $, WHFKQLTXHV IRU PRUH WKDQ RQH VRXUFH ZLWK GLIIHUHQW FRQQHFWLYLW\
FKDQQHO LPSXOVH UHVSRQVH &,5 SUHGLFWLRQ DQG FULWHULD>@,QDIRJHQDEOHGZLUHOHVVQHWZRUNWKLVLV
FRQWH[WDZDUH GDWD WUDQVPLVVLRQ LV WKHQ SURYLGHG LQ IDFLOLWDWHGE\HPSOR\LQJ,R7GHYLFHVZKLFKOHYHUDJHD
VHFWLRQ)LQDOO\FRQFOXVLRQVDUHGUDZQLQVHFWLRQ PXOWLWXGHRIUDGLRDFFHVVWHFKQRORJLHVVXFKDVZLUHOHVV
ORFDODUHDQHWZRUNV:/$1DQGFHOOXODUQHWZRUNV,Q
2. DATA ACQUISITION AND WKLV UHJDUG FRQWH[WDZDUH GDWD FROOHFWLRQ IURP
KNOWLEDGE DISCOVERY PXOWLSOHVRXUFHVSUREDEO\LQDFRPSUHVVHGIRUPDWE\
HPSOR\LQJ DSSURSULDWH GLPHQVLRQDOLW\ UHGXFWLRQ
(IILFLHQWGDWDDFTXLVLWLRQDQGNQRZOHGJHGLVFRYHU\LV WHFKQLTXHVXQGHULPSHUIHFWVWDWLVWLFDONQRZOHGJHRIWKH
RQHRIWKHUHTXLUHPHQWVRIIXWXUHZLUHOHVVQHWZRUNVDV GDWD ZKLOH VLPXOWDQHRXVO\ RSWLPL]LQJ PXOWLSOH
LW KHOSV WR UHDOL]H VLWXDWLRQ DZDUH DQG RSWLPL]HG REMHFWLYH IXQFWLRQV VXFK DV GHOD\ DQG WUDQVPLVVLRQ
GHFLVLRQV DVVKRZQ LQ )LJ 7KH JDWKHUHG GDWD PD\ SRZHUFDQEHHQDEOHG>@
QHHG WR EH SURFHVVHG HIILFLHQWO\ WR H[WUDFW UHOHYDQW
NQRZOHGJH )XUWKHUPRUH DV WKH DYDLODEOH GDWD PD\ B. Knowledge discovery
FRQWDLQDODUJHDPRXQWRIHUURQHRXVPLVVLQJYDOXHV
DUREXVWNQRZOHGJHGLVFRYHU\PD\QHHGWREHGHYLVHG (IILFLHQWNQRZOHGJHGLVFRYHU\LVFULWLFDOIRURSWLPL]HG
>@ RSHUDWLRQ DQG PDQDJHPHQW RI WKH QHWZRUN 7KH
QHWZRUN PD\ QHHG WR XVH D QRYHO OHDUQLQJ WHFKQLTXH
A. Data acquisition VXFKDVGHHSOHDUQLQJWRH[WUDFWWKHKLGGHQFRQWH[WXDO
LQIRUPDWLRQ RI WKH QHWZRUN ZKLFK LV FUXFLDO IRU
$,EDVHG WRROV UHO\LQJ RQ PDFKLQH OHDUQLQJ IRU WKH NQRZOHGJH EDVH .% FUHDWLRQ ,Q JHQHUDO FRQWH[W LV
LQSXWGDWDPLQLQJDQGNQRZOHGJHPRGHOH[WUDFWLRQDW UHODWHG WR DQ\ LQIRUPDWLRQ XVHG WR FKDUDFWHUL]H WKH
GLIIHUHQWOHYHOVFRXOGEHDSSOLHG>@7KLVLQFOXGHVWKH VLWXDWLRQ RI DQ HQWLW\LQFOXGLQJ VXUURXQGLQJ ORFDWLRQ
FHOOOHYHOFHOOFOXVWHUOHYHODQGXVHUOHYHO,QJHQHUDO LGHQWLW\SUHIHUHQFHVDQGDFWLYLWLHV&RQWH[WPD\DIIHFW
RQHFDQFROOHFWGDWDIURPWKUHHPDLQVRXUFHVQHWZRUN WKHRSHUDWLRQDQGPDQDJHPHQWSURFHGXUHVRIFRPSOH[
XVHU DQG H[WHUQDO GHYLFHV 7KH QHWZRUN GDWD V\VWHPV DW YDULRXV OHYHOV IURP WKH SK\VLFDO GHYLFH
FKDUDFWHUL]HV WKH QHWZRUN EHKDYLRU LQFOXGLQJ RXWDJH OHYHOWRWKHFRPPXQLFDWLRQOHYHOXSWRWKHDSSOLFDWLRQ
DQGXVDJHVWDWLVWLFVRIVHUYLFHVRUQRGHVDQGWKHORDG OHYHO >@ )RU LQVWDQFH XQFRYHULQJ WKH UHODWLRQ
RI D FHOO 7KH XVHU GDWD FRXOG FRPSULVH XVHU EHWZHHQ WKH GHYLFH DQG QHWZRUN LQIRUPDWLRQ XVHU
VXEVFULSWLRQLQIRUPDWLRQDQGXVHUGHYLFHW\SH$QGWKH ORFDWLRQ YHORFLW\ EDWWHU\ OHYHO DQG RWKHU PHGLXP
H[WHUQDO GDWD FRQWDLQV XVHU VSHFLILF LQIRUPDWLRQ DFFHVVFRQWURO0$&DQGKLJKHUOD\HUDVSHFWVZRXOG
REWDLQHG IURP GLIIHUHQW VRXUFHV VXFK DV VHQVRUV DQG SHUPLW DGDSWLYH FRPPXQLFDWLRQ DQG SURFHVVLQJ
FKDQQHOPHDVXUHPHQWV>@ FDSDELOLWLHV EDVHG RQ WKH FKDQJHV LQ WKH HQYLURQPHQW
DQGDSSOLFDWLRQ>@>@
2QH ZD\ RI FROOHFWLQJ ZLUHOHVV GDWD LV E\HPSOR\LQJ
FRQWHQW FDFKLQJ ZKHUH WKH LGHD LV WR VWRUH SRSXODU
FRQWHQWDWWKHQHWZRUNHGJHDW%6VGHYLFHVRURWKHU
LQWHUPHGLDWHORFDWLRQV,QWKLVUHJDUGRQHFDQHQDEOH
WKHSURDFWLYHFDFKHW\SHLIWKHWUDIILFOHDUQLQJDOJRULWKP
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
)LJ7\SLFDOQH[WJHQHUDWLRQQHWZRUNDGRSWLQJ$,SULQFLSOHVZLWKOHDUQLQJUHDVRQLQJDQGGHFLVLRQPDNLQJ
8QGHUVWDQGLQJ WKH FRQWH[W DOVR KHOSV WR SURGXFH
FRQWH[WDZDUH FRPSUHVVHG VXPPDU\ LQIRUPDWLRQ
ZKLFKZLOOXWLOL]HOHVVUDGLRUHVRXUFHVIRUWUDQVPLVVLRQ
)RU LQVWDQFH LI D %6 ZRXOG OLNH WR WUDQVPLW WH[W
LQIRUPDWLRQ WR D XVHU WKH %6 FDQ WUDQVPLW RQO\ LWV
FRQWH[WXDO FRGHG GDWD 7KH XVHU ZLOO WKHQ H[WUDFW WKH
GHVLUHG FRQWHQW MXVW IURP WKH FRQWH[W E\ XWLOL]LQJ
DSSURSULDWHGHFRGHUDQGELJGDWDDQDO\WLFVWHFKQLTXHV
VXFKDV1/3$VFRQWH[WGLIIHUVIURPWKHXVHU¶VZRUOG
NQRZOHGJHDERXWWKHFRQWHQWWKHFRGLQJDQGGHFRGLQJ
WHFKQLTXHPD\YDU\DPRQJXVHUV>@,QJHQHUDOWZR
W\SHV RI FRQWHQW VXPPDUL]LQJ DSSURDFKHV DUH
FRPPRQO\ DGRSWHG DEVWUDFWLYH DQG H[WUDFWLYH 7KH
)LJ2SWLPL]HGQHWZRUNGHVLJQZLWK$,WHFKQLTXHV H[WUDFWLYHDSSURDFKXVHVRQO\WKHUHOHYDQWFRQWHQWIURP
WKH RULJLQDO LQIRUPDWLRQ ZKHUHDV WKH DEVWUDFWLYH
$QDO\]LQJ ZLUHOHVV GDWD FRQWH[WXDOO\ VHPDQWLFDOO\ DSSURDFKPD\XVHQHZZRUGVH[SUHVVLRQVRU FRQWHQWV
IDFLOLWDWHVZLUHOHVVRSHUDWRUVWRRSWLPL]HWKHLUQHWZRUN DV SDUW RI WKH VXPPDU\ LQIRUPDWLRQ >@ >@
WUDIILF7RUHDOL]HVHPDQWLFDZDUHWUDIILFRSWLPL]DWLRQ $OWKRXJK PRVW RI WKH H[LVWLQJ PHWKRGV FDQ H[WUDFW
KRZHYHU WKH QHWZRUN PD\ QHHG WR XQGHUVWDQG WKH XVHIXOLQIRUPDWLRQIRUWKHVXPPDU\WKH\DUHYHU\IDU
FRQWHQW RI WKH VLJQDO 2QH ZD\ RI XQGHUVWDQGLQJ WKH IURP JHQHUDWLQJ D KXPDQ XQGHUVWDQGDEOH VXPPDU\
LQIRUPDWLRQFRQWHQWRIDGDWDLVE\FUHDWLQJVHPDQWLF 2QHRIWKHPDLQUHDVRQVLVWKHORRVHDVVRFLDWLRQVDQG
DZDUHRQWRORJ\XVLQJSUHGHILQHGYRFDEXODU\RIWHUPV XQRUGHUHGLQIRUPDWLRQGLVWULEXWLRQZKLFKPDNHLWKDUG
DQG FRQFHSWV >@ 7KH RQWRORJ\ VSHFLILFDWLRQ FDQ WR H[WUDFW V\QWDFWLFDOO\ FRUUHFW DQG VHPDQWLFDOO\
SURYLGH DQ H[SUHVVLYH ODQJXDJH ZLWK PDQ\ ORJLFDO FRKHUHQW LQIRUPDWLRQ IURP WKH VXPPDU\ ,Q IDFW
FRQVWUXFWV WR GHILQH FODVVHV SURSHUWLHV DQG WKHLU PRGHOLQJ WKH FRKHUHQFH RI LQIRUPDWLRQ VXPPDU\ LV
UHODWLRQVKLSV,QWKLVUHJDUGWKHDXWKRUVRI>@SURSRVH RQHRIWKHDFWLYHDUHDVRIUHVHDUFK>@
D VHPDQWLF RSHQ GDWD PRGHO IRU VHQVRU GDWD FDOOHG
MyOntoSens DQGZULWHXVLQJRQWRORJ\ZHEODQJXDJH
GHVFULSWLRQ ORJLF ODQJXDJH 7KH SURRSRVHG .% KDV 3. NETWORK PLANNING
EHHQLPSOHPHQWHGXVLQJprotégé DQGSUHYDOLGDWHGZLWK
SHOOHW UHDVRQHU ,Q D VLPLODU FRQWH[W DQ RQWRORJ\ IRU 2QH RI WKH PRVW FULWLFDO DVSHFWV GHWHUPLQLQJ WKH
ZLUHOHVV VHQVRU QHWZRUNV :61V GHGLFDWHG WR WKH SHUIRUPDQFH RI D ZLUHOHVV QHWZRUN LV WKH LQLWLDO
GHVFULSWLRQRIVHQVRUIHDWXUHVDQGREVHUYDWLRQKDVEHHQ SODQQLQJ 7KLV LQFOXGHV LQIUDVWUXFWXUH QRGH
SUHVHQWHGLQ>@>@ GHSOR\PHQW IUHTXHQF\ QXPEHU RI SDUDPHWHUV DQG
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
WKHLU FRQILJXUDWLRQ VHWWLQJ SURFHGXUHV DQG HQHUJ\ HQHUJ\ SODQQLQJ LQHIILFLHQW IRUWKH IXWXUHVPDUWFLWLHV
FRQVXPSWLRQWRUXQWKHQHWZRUNLQERWKLGOHQRGDWD DLPLQJ WR UHDOL]H JUHHQ FRPPXQLFDWLRQ 7R HQDEOH
FRPPXQLFDWLRQWDNHVSODFHEHWZHHQWKHQHWZRUNDQGD HQHUJ\HIILFLHQW ZLUHOHVV QHWZRUNV GLIIHUHQW $,
XVHU DQG DFWLYH GDWD FRPPXQLFDWLRQ WDNHV SODFH WHFKQLTXHV KDYH EHHQ VXJJHVWHG )RU LQVWDQFH WKH
EHWZHHQ WKH QHWZRUN DQG D XVHU FRQGLWLRQV DXWKRUVRI>@SURSRVHDPHWKRGWRUHDOL]HWKHHIILFLHQW
$ZHOOSODQQHG QHWZRUN PD\ QHHG WR JXDUDQWHH XVHRIHOHFWULFLW\E\DXWRQRPRXVO\FRQWUROOLQJQHWZRUN
VDWLVIDFWRU\XVHU4R6LQWHUPVRIGDWDUDWHUHOLDELOLW\ HTXLSPHQW VXFK DV VHUYHUV DLUFRQGLWLRQHUV LQ DQ
DQG ODWHQF\ DQG WKH QHWZRUN RSHUDWRU UHTXLUHPHQWV LQWHJUDWHG PDQQHU )XUWKHUPRUH WKH DXWKRUV RI >@
LQWHUPVRIFRVW7KHPDFKLQHOHDUQLQJWHFKQLTXHFDQ VXJJHVW SUHGLFWLYH PRGHOV LQFOXGLQJ QHXUDO QHWZRUN
EHXVHGIRUSODQQLQJGLIIHUHQWSDUWVRIWKHQHWZRUNE\ DQG0DUNRYGHFLVLRQVIRUWKHHQHUJ\FRQVXPSWLRQRI
XWLOL]LQJWKHQHWZRUNDQGXVHUGDWD ,R7 LQ VPDUW FLWLHV $ORQJ WKLV OLQH D %6VZLWFKLQJ
VROXWLRQ IRU WUDIILF DZDUH JUHHQHU FHOOXODU QHWZRUNV
A. Node deployment, Energy consumption and RF XVLQJ$,WHFKQLTXHVKDVDOVREHHQGLVFXVVHGLQ>@
planning
B. Configuration parameter and service planning
7KH IXWXUH JHQHUDWLRQ ZLUHOHVV QHWZRUNV ZLOO EH
H[WUHPHO\ GHQVH DQG KHWHURJHQHRXV OLNHO\ HTXLSSHG 7KH QXPEHU RI FRQILJXUDEOH SDUDPHWHUV LQ FHOOXODU
ZLWK PRYLQJ DQG IO\LQJ %6V DQG IHDWXUHG E\ QHWZRUNV IDLUO\ LQFUHDVHV ZKHQ PRYLQJ IURP RQH
FRQWLQXDOO\YDU\LQJQHWZRUNFRQGLWLRQV>@7KLVIDFW JHQHUDWLRQWRWKHQH[W)RULQVWDQFHLQW\SLFDO*DQG
PDNHVWKHH[LVWLQJQHWZRUNSODQQLQJWHFKQLTXHVZKLFK *QRGHVWKHVHSDUDPHWHUVDUHDURXQGDQG
DUH PDLQO\ VWDWLF DQG GHVLJQHG IURP H[SHQVLYH ILHOG UHVSHFWLYHO\ ,W LV DQWLFLSDWHG WKDW WKLV WUHQG ZLOO
WHVWVQRWVXLWDEOHIRUIXWXUHZLUHOHVVQHWZRUNV>@>@ FRQWLQXHDQGWKHUHFHQWO\VXJJHVWHG*QHWZRUNQRGH
7KHXWLOL]DWLRQRI$,WHFKQLTXHVIRUQHWZRUNSODQQLQJ ZLOOOLNHO\KDYHRUPRUHSDUDPHWHUV,QDGGLWLRQ
KDV UHFHQWO\ UHFHLYHG DQ LQWHUHVW LQ WKH UHVHDUFK XQOLNH WKH FXUUHQW DQG SUHYLRXV JHQHUDWLRQ QHWZRUNV
FRPPXQLW\)RULQVWDQFHDPDFKLQHOHDUQLQJWHFKQLTXH ZKLFK SURYLGH VWDWLF VHUYLFHV WKH QH[W JHQHUDWLRQ
LV VXJJHVWHG IRU FRQWHQW SRSXODULW\ DQG UHTXHVW QHWZRUN PD\ QHHG WR VXSSRUW FRQWLQXRXVO\ HYROYLQJ
GLVWULEXWLRQSUHGLFWLRQVRIDFDFKHZKHUHLWVGHVLJQLQ QHZ VHUYLFHV DQG XVH FDVHV DQG HVWDEOLVK VXIILFLHQW
WKHQHWZRUNFRQVLGHUVVHYHUDOIDFWRUVLQFOXGLQJFDFKH QHWZRUNUHVRXUFHDQGSURYLVLRQLQJPHFKDQLVPVZKLOH
SODFHPHQWDQGXSGDWHVWUDWHJ\ZKLFKDUHGHWHUPLQHGE\ HQVXULQJDJLOLW\DQGUREXVWQHVV7KHVHQHFHVVLWDWHWKH
XWLOL]LQJ WKH XVHUV¶ FRQWHQW UHTXHVW GLVWULEXWLRQ DQG QH[W JHQHUDWLRQ QHWZRUN WR XQGHUVWDQG SDUDPHWHU
IUHTXHQF\DQGPRELOLW\SDWWHUQ >@ YDULDWLRQV OHDUQ XQFHUWDLQWLHV FRQILJXUH QHWZRUN
SDUDPHWHUVIRUHFDVWLPPHGLDWHDQGIXWXUHFKDOOHQJHV
,Q >@ DQ $,EDVHG V\VWHP ZKLFK OHYHUDJHV JUDSK DQG SURYLGH WLPHO\ VROXWLRQV E\ LQWHUDFWLQJ ZLWK WKH
WKHRU\ EDVHG SUREOHP IRUPXODWLRQV IRU WKH ILEHU WR HQYLURQPHQW >@ ,Q WKLV GLUHFWLRQ WKH XWLOL]DWLRQ RI
KRPH QHWZRUN LV SURSRVHG WR DXWRPDWH WKH SODQQLQJ ELJGDWDDQDO\WLFVKDVEHHQGLVFXVVHGIRUSURWRFROVWDFN
SURFHVV 7R VROYH WKH SUREOHPV PL[HG LQWHJHU OLQHDU FRQILJXUDWLRQ VLJQDOLQJ SURFHGXUH DQG SK\VLFDO OD\HU
SURJUDPPLQJ0,/3DQWFRORQ\RSWLPL]DWLRQ$&2 SURFHGXUHRSWLPL]DWLRQVLQ >@
DQG JHQHWLF DOJRULWKP *$ KDYH EHHQ DSSOLHG 7KH
DXWKRUV RI >@HPSOR\ WKH SULQFLSOHVRI $, IRU UDGLR )XWXUH VPDUW FLWLHV UHTXLUH ZHOOSODQQHG ZLUHG DQG
DFFHVV QHWZRUN 5$1 SODQQLQJ ZKLFK LQFOXGHV QHZ ZLUHOHVV QHWZRUNV ZLWK XELTXLWRXV EURDGEDQG
FHOO UDGLR IUHTXHQF\ 5) DQG VSHFWUXP RI WKH * FRQQHFWLYLW\ DQG IOH[LEOH UHDOWLPH DQG GLVWULEXWHG
ZLUHOHVV QHWZRUN 7KH DQDO\VLV LV SHUIRUPHG E\ GDWD SURFHVVLQJ FDSDELOLW\ $OWKRXJK PRVW PRGHUQ
SURFHVVLQJ LQSXW GDWD IURP PXOWLSOH VRXUFHV WKURXJK FLWLHV KDYH PXOWLSOH FHOOXODU QHWZRUNV WKDW SURYLGH
OHDUQLQJEDVHGFODVVLILFDWLRQSUHGLFWLRQDQGFOXVWHULQJ DGHTXDWH FRYHUDJH DQG GDWD SURFHVVLQJ FDSDELOLW\
PRGHOVDQGH[WUDFWLQJUHOHYDQWNQRZOHGJHWRGULYHWKH WKHVH QHWZRUNV RIWHQ KDYH OLPLWHG FDSDFLW\ DQG SHDN
GHFLVLRQVPDGHE\WKH* QHWZRUN EDQGZLGWKVDQGIDLOWRPHHWWKHUHDOWLPHFRQVWUDLQWRI
GLIIHUHQWHPHUJLQJWDFWLOHDSSOLFDWLRQV7KHVHPDNHWKH
:LUHOHVVQHWZRUNVFRQWULEXWHDQLQFUHDVLQJVKDUHLQWKH UHDOL]DWLRQ RI DGYDQFHG GHOD\ FULWLFDO PXQLFLSDO
HQHUJ\FRQVXPSWLRQRIWKHLQIRUPDWLRQFRPPXQLFDWLRQ VHUYLFHV HQYLVLRQHG LQ D VPDUW FLW\ HJ UHDOWLPH
WHFKQRORJ\ ,&7 LQIUDVWUXFWXUH 2YHU RI D VXUYHLOODQFH SXEOLF VDIHW\ RQWLPH DGYLVRULHV DQG
ZLUHOHVV QHWZRUN SRZHU FRQVXPSWLRQ LV XVHG E\ WKH VPDUW EXLOGLQJV FKDOOHQJLQJ >@ 2QH ZD\ RI
5$1V HVSHFLDOO\ DW WKH %6 VLQFH WKH SUHVHQW %6 DGGUHVVLQJWKLVFKDOOHQJHZRXOGEHE\GHSOR\LQJDQ$,
GHSOR\PHQW LV GHVLJQHG RQ WKH EDVLV RI SHDN WUDIILF LQWHJUDWHG IRJEDVHG ZLUHOHVV DUFKLWHFWXUH ZKLFK
ORDGVDQGJHQHUDOO\VWD\VDFWLYHLUUHVSHFWLYHRIWKHKXJH DOORZVGDWDSURFHVVLQJRIWKHQHWZRUNXVLQJDQXPEHU
YDULDWLRQVLQWUDIILFORDG>@7KLVPDNHVWKHFXUUHQW RI GLVWULEXWHG QRGHV 7KLV ZLOO KHOS DQDO\]H QHWZRUN
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
VWDWXV GHWHFW DQWLFLSDWHG IDXOWV DQG SODQ QHZ QRGH SURSRVH D KRSILHOG QHXUDO QHWZRUN VFKHPH IRU
GHSOR\PHQWXVLQJ$,WHFKQLTXHV>@ PXOWLUDGLR SDFNHW VFKHGXOLQJ 7KH SUREOHP RI
UHVRXUFH DOORFDWLRQ ZLWK XSOLQNGRZQOLQN GHFRXSOLQJ
4. NETWORK OPERATION AND LQ D ORQJ WHUP HYROXWLRQXQOLFHQVHG /7(8 V\VWHP
MANAGEMENT KDV EHHQ LQYHVWLJDWHG LQ >@ IRU ZKLFK WKH DXWKRUV
SURSRVH D GHFHQWUDOL]HG VFKHPH EDVHG RQ QHXUDO
(QHUJ\DQGVSHFWUXPHIILFLHQF\ODWHQF\UHOLDELOLW\DQG QHWZRUNV 7KH DXWKRUV LQ >@ SURSRVH D GLVWULEXWHG
VHFXULW\ DUH WKH NH\ SDUDPHWHUV WKDW DUH WDNHQ LQWR DSSURDFK EDVHG RQ 4OHDUQLQJ IRU WKH SUREOHP RI
DFFRXQW GXULQJ WKH QHWZRUN RSHUDWLRQ VWDJH $QG FKDQQHOVHOHFWLRQLQDQ/7(8V\VWHP)XUWKHUPRUHLQ
SURSHUO\ RSWLPL]LQJ WKHVH SDUDPHWHUV XVXDOO\ \LHOGV DPXOWL5$7VFHQDULRPDFKLQHOHDUQLQJWHFKQLTXHVFDQ
VDWLVIDFWRU\SHUIRUPDQFHIRUERWKWKHVHUYLFHSURYLGHUV DOORZWKHVPDUWXVHRIGLIIHUHQW5$7VZKHUHLQD%6FDQ
DQG HQG XVHUV ,Q DGGLWLRQ WKHVH RSWLPL]DWLRQ OHDUQZKHQWRWUDQVPLWRQHDFKW\SHRIIUHTXHQF\EDQG
SDUDPHWHUV XVXDOO\ UHTXLUH VLPSOH DQG UHDOWLPH EDVHGRQWKHQHWZRUNFRQGLWLRQV)RULQVWDQFHRQHFDQ
OHDUQLQJDQGGHFLVLRQPDNLQJDOJRULWKPV DSSO\PDFKLQHOHDUQLQJWRSUHGLFWWKHDYDLODELOLW\RID
OLQH RI VLJKW /R6 OLQN E\ FRQVLGHULQJ WKH XVHUV¶
A. Resource allocation and m anagement PRELOLW\ SDWWHUQ DQG DQWHQQD WLOW WKXV DOORZLQJ WKH
WUDQVPLVVLRQRYHUWKHPLOOLPHWHUZDYHEDQG
'LIIHUHQW $, WHFKQLTXHV KDYH EHHQ SURSRVHG IRU
UHVRXUFH DOORFDWLRQ PDQDJHPHQW DQG RSWLPL]DWLRQ RI B. Security and privacy p rotection
ZLUHOHVV QHWZRUNV VXFK DV FHOOXODU ZHDUDEOH :61
DQG ERG\ DUHD QHWZRUN %$1 >@ ,Q >@ WKH 7KH LQKHUHQW VKDUHG QDWXUH RI UDGLR SURSDJDWLRQ
SRWHQWLDO RI $, LQ VROYLQJ WKH FKDQQHO DOORFDWLRQ HQYLURQPHQWPDNHVZLUHOHVVWUDQVPLVVLRQV YXOQHUDEOH
SUREOHPLQZLUHOHVVFRPPXQLFDWLRQLVFRQVLGHUHG,WLV WR PDOLFLRXV DWWDFNV LQFOXGLQJ HDYHVGURSSLQJ DQG
GHPRQVWUDWHG WKDW WKH $,EDVHG DSSURDFK KDV VKRZQ MDPPLQJ )RU WKLV UHDVRQ VHFXULW\ DQG SULYDF\
EHWWHU SHUIRUPDQFH WKDQ WKRVH RI UDQGRPL]HGEDVHG SURWHFWLRQ DUH IXQGDPHQWDO FRQFHUQV RI WRGD\¶V
KHXULVWLFDQGJHQHWLFDOJRULWKPV*$V,Q>@ UDGLR ZLUHOHVV FRPPXQLFDWLRQ V\VWHPV :LUHOHVV QHWZRUNV
DFFHVV WHFKQRORJ\ 5$7 VHOHFWLRQ XWLOL]LQJ WKH JHQHUDOO\ DGRSW VHSDUDWH VHFXULW\ OHYHOV DW GLIIHUHQW
+RSILHOG QHXUDO QHWZRUNV DV D GHFLVLRQPDNLQJ WRRO OD\HUV RI WKH FRPPXQLFDWLRQ SURWRFRO VWDFN
ZKLOHOHYHUDJLQJWKHDELOLW\RI$,UHDVRQLQJDQGWKHXVH )XUWKHUPRUH GLIIHUHQW DSSOLFDWLRQV XVXDOO\ UHTXLUH
RIPXOWLSDUDPHWHUGHFLVLRQVE\H[SORLWLQJWKHRSWLRQV GLIIHUHQWHQFU\SWLRQPHWKRGV>@7KHXWLOL]DWLRQRI$,
RI,(((SURWRFROLVSURSRVHG0DFKLQHOHDUQLQJ WHFKQLTXHV IRU ZLUHOHVV VHFXULW\ KDV UHFHLYHG
EDVHG WHFKQLTXHV LQFOXGLQJ VXSHUYLVHG XQVXSHUYLVHG VLJQLILFDQWLQWHUHVW
DQG UHLQIRUFHPHQW OHDUQLQJ WHFKQLTXHV KDYH EHHQ
H[SORLWHG WR PDQDJH WKH SDFNHW URXWLQJ LQ PDQ\ 7$%/(0DLQLVVXHVLQ$,HQDEOHGZLUHOHVVQHWZRUN
GLIIHUHQWQHWZRUNVFHQDULRV>@6SHFLILFDOO\LQ>@
'DWDDFTXLVLWLRQDQGNQRZOHGJHGLVFRYHU\ 5HI
>@DGHHSOHDUQLQJDSSURDFKIRUVKRUWHVWWUDIILFURXWH • &RQWH[WDZDUHGDWDDFTXLVLWLRQIURPVLQJOHPXOWLSOHVRXUFHV >@
LGHQWLILFDWLRQ WR UHGXFH QHWZRUN FRQJHVWLRQ LV • &RGHGDGDSWLYH FDFKLQJ
• 6HPDQWLFDZDUH2QWRORJ\.%FUHDWLRQIURPQHWZRUNGDWD
>@>@
>@>@
SUHVHQWHG $ GHHSOHDUQLQJ WHFKQLTXH DLPLQJ WR VKLIW • 5REXVW NQRZOHGJH GLVFRYHU\ IURP HUURQHRXV PLVVLQJ GDWD >@
WKH FRPSXWLQJ QHHGV IURP UXOHEDVHG URXWH 1HWZRUNSODQQLQJ
• 1RGHGHSOR\PHQWDQGUDGLRIUHTXHQF\DOORFDWLRQ >@>@
FRPSXWDWLRQ WR PDFKLQH OHDUQLQJ EDVHG URXWH • &DFKLQJDQGFRPSXWLQJSODFHPHQWDQGFRQWHQWXSGDWH >@
HVWLPDWLRQ IRU KLJK WKURXJKSXW SDFNHW SURFHVVLQJ LV • (QHUJ\FRQVXPSWLRQPRGHOLQJDQGSUHGLFWLRQLGOHDFWLYH >@>@
• 3DUDPHWHUDQGVHUYLFHFRQILJXUDWLRQSURFHGXUH >@>@
SURSRVHG LQ >@ $ORQJ WKLV OLQH D IRJ FRPSXWLQJ 1HWZRUNRSHUDWLRQDQGPDQDJHPHQW
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
1RWH WKDW VLPLODU DYHUDJH SHUIRUPDQFH LV REVHUYHG IRU RWKHU
VXEFDUULHUV
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
REFERENCES >@ - 3UH]5RPHUR 2 6DOOHQW 5 )HUUV DQG 5
$JXVW³$UWLILFLDOLQWHOOLJHQFHEDVHG*QHWZRUN
>@ $0XQLU3.DQVDNDUDQG68.KDQ³,)&,R7 FDSDFLW\ SODQQLQJ DQG RSHUDWLRQ´ LQ
LQWHJUDWHG)RJ&ORXG,R7$QRYHODUFKLWHFWXUDO ,QWHUQDWLRQDO 6\PSRVLXP RQ :LUHOHVV
SDUDGLJPIRUWKHIXWXUHLQWHUQHWRIWKLQJV´,((( &RPPXQLFDWLRQ 6\VWHPV ,6:&6 $XJ
&RQVXPHU (OHFWURQLFV 0DJD]LQH YRO QR SS
SS-XO\
>@ (%DVWXJ0%HQQLVDQG0'HEEDK³/LYLQJ
>@ 7( %RJDOH DQG / /H ³0DVVLYH 0,02 DQG RQWKHHGJH7KHUROHRISURDFWLYHFDFKLQJLQ*
PP:DYH IRU * ZLUHOHVV +HW1HW 3RWHQWLDO ZLUHOHVV QHWZRUNV´ ,((( &RPPXQLFDWLRQV
EHQHILWVDQGFKDOOHQJHV´,(((9HKLF7HFKQR 0DJD]LQHYROQRSS$XJ
0DJYROQRSS0DU
>@ ( %DVWXJ 0 %HQQLV 0 0HGDUG DQG 0
>@ 0:HLQHU0-RUJRYDQRYLF$6DKDLDQG% 'HEEDK³7RZDUGLQWHUFRQQHFWHGYLUWXDOUHDOLW\
1LNROL³'HVLJQRIDORZODWHQF\KLJKUHOLDELOLW\ 2SSRUWXQLWLHV FKDOOHQJHV DQG HQDEOHUV´ ,(((
ZLUHOHVV FRPPXQLFDWLRQ V\VWHP IRU FRQWURO &RPPXQLFDWLRQV 0DJD]LQH YRO QR
DSSOLFDWLRQV´LQ3URF,(((,QW&RQI&RPPXQ SS
,&&SS
>@ *3DVFKRV(%DVWXJ,/DQG*&DLUHDQG0
>@ 0 &KLDQJ DQG 7 =KDQJ ³)RJ DQG ,R7 $Q 'HEEDK ³:LUHOHVV FDFKLQJ 7HFKQLFDO
RYHUYLHZ RI UHVHDUFK RSSRUWXQLWLHV´ ,((( PLVFRQFHSWLRQV DQG EXVLQHVV EDUULHUV´ ,(((
,QWHUQHW RI 7KLQJV YRO QR SS &RPPXQLFDWLRQV 0DJD]LQH YRO QR
'HF SS$XJXVW
>@ ;:DQJDQG<+H³/HDUQLQJIURPXQFHUWDLQW\ >@ < )DGODOODK $ 0 7XOLQR ' %DURQH *
IRU ELJ GDWD )XWXUH DQDO\WLFDO FKDOOHQJHV DQG 9HWWLJOL-/ORUFDDQG-0*RUFH³&RGLQJIRU
VWUDWHJLHV´ ,((( 6\VWHPV 0DQ DQG FDFKLQJ LQ * QHWZRUNV´ ,((( &RPPXQ
&\EHUQHWLFV0DJD]LQHYROQRSS 0DJD]LQHYROQRSS
$SULO
>@ '2KPDQQ$$ZDGD,9LHULQJ06LPVHNDQG
>@ 5XLORQJ 'HQJ 5RQJ[LQJ /X &KHQJ]KH /DL *3 )HWWZHLV ³$FKLHYLQJ KLJK DYDLODELOLW\ LQ
7RP + /XDQ DQG +DR /LDQJ ³2SWLPDO ZLUHOHVV QHWZRUNV E\ LQWHUIUHTXHQF\ PXOWL
ZRUNORDG DOORFDWLRQ LQ IRJFORXG FRPSXWLQJ FRQQHFWLYLW\´ LQ ,((( ,QWHUQDWLRQDO
WRZDUGEDODQFHGGHOD\DQGSRZHUFRQVXPSWLRQ´ &RQIHUHQFHRQ&RPPXQLFDWLRQV,&&0D\
,(((,QWHUQHWRI7KLQJV-RXUQDOYROQRSS SS
>@ )&KLWL5)DQWDFFL0/RUHWLDQG53XJOLHVH
>@ 0&KLDQJ6+D&/,)5LVVRDQG7=KDQJ ³&RQWH[W DZDUH ZLUHOHVV PRELOH DXWRQRPLF
³&ODULI\LQJ)RJFRPSXWLQJDQGQHWZRUNLQJ FRPSXWLQJ DQG FRPPXQLFDWLRQV 5HVHDUFK
TXHVWLRQVDQGDQVZHUV´,(((&RPPXQLFDWLRQV WUHQGV DQG HPHUJLQJ DSSOLFDWLRQV´ ,(((
0DJD]LQHYROQRSS$SULO :LUHOHVV &RPPXQ YRO QR SS
>@ <6XQ+6RQJ$--DUDDQG5%LH³,QWHUQHW $SU
RI WKLQJV DQG ELJ GDWD DQDO\WLFV IRU VPDUW DQG >@ /1DFKDEH0*LURG*HQHWDQG%(O+DVVDQ
FRQQHFWHG FRPPXQLWLHV´ ,((( $FFHVV YRO ³8QLILHG GDWD PRGHO IRU ZLUHOHVV VHQVRU
SS QHWZRUN´,(((6HQVRUV-RXUQDOYROQR
>@ 6+DQ&/,*/L6:DQJDQG46XQ³%LJ SS-XO\
GDWDHQDEOHGPRELOHQHWZRUNGHVLJQIRU*DQG >@ 5 %HQGDGRXFKH & 5RXVVH\ * 'H 6RXVD -
EH\RQG´,(((&RPPXQLFDWLRQV0DJD]LQHYRO &KDQHW DQG .0 +RX ³([WHQVLRQ RI WKH
33QRSS VHPDQWLF VHQVRU QHWZRUN RQWRORJ\ IRU ZLUHOHVV
>@ - 3UH]5RPHUR 2 6DOOHQW 5 )HUUV DQG 5 VHQVRU QHWZRUNV 7KH VWLPXOXV:61QRGH
$JXVW ³.QRZOHGJHEDVHG * UDGLR DFFHVV FRPPXQLFDWLRQSDWWHUQ´LQ3URFWK,QW&RQI
QHWZRUN SODQQLQJ DQG RSWLPL]DWLRQ´ LQ 6HPDQWLF 6HQVRU 1HWZRUNV ± 9RO
,QWHUQDWLRQDO 6\PSRVLXP RQ :LUHOHVV SS
&RPPXQLFDWLRQ 6\VWHPV ,6:&6 6HSW
SS
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
>@ 0 &RPSWRQ $ $ +HQVRQ / /HIRUW + >@ :(MD]01DHHP$6KDKLG$$QSDODJDQ
1HXKDXV DQG $ 3 6KHWK ³$ VXUYH\ RI WKH DQG0-R³(IILFLHQWHQHUJ\PDQDJHPHQWIRUWKH
VHPDQWLF VSHFLILFDWLRQ RI VHQVRUV´ LQ 3URF LQWHUQHW RI WKLQJV LQ VPDUW FLWLHV´ ,(((
&(85:RUNVKRSSS &RPPXQLFDWLRQV 0DJD]LQH YRO QR
SS-DQXDU\
>@ ( &DPEULD DQG % :KLWH ³-XPSLQJ 1/3
FXUYHV$UHYLHZRIQDWXUDOODQJXDJHSURFHVVLQJ >@ 6 , 6XOLPDQ * .HQGDOO DQG , 0XVLULQ
UHVHDUFK´ ,((( &RPS ,QWHOOLJHQFH 0DJ ³$UWLILFLDO LPPXQH DOJRULWKP LQ VROYLQJ WKH
SS0D\ FKDQQHO DVVLJQPHQW WDVN´ LQ ,(((
,QWHUQDWLRQDO &RQIHUHQFH RQ &RQWURO 6\VWHP
>@ 7+LUDR01LVKLQR<<RVKLGD-6X]XNL1
&RPSXWLQJ DQG (QJLQHHULQJ ,&&6&(
<DVXGD DQG 0 1DJDWD ³6XPPDUL]LQJ D
1RYSS
GRFXPHQW E\ WULPPLQJ WKH GLVFRXUVH WUHH´
,((($&0 7UDQV $XGLR 6SHHFK DQG /DQJ >@ 9 5DNRYLF DQG / *DYULORYVND ³1RYHO 5$7
3URFHVV YRO QR SS VHOHFWLRQPHFKDQLVPEDVHGRQ+RSILHOGQHXUDO
1RY QHWZRUNV´ LQ ,QWHUQDWLRQDO &RQJUHVV RQ 8OWUD
0RGHUQ 7HOHFRPPXQLFDWLRQV DQG &RQWURO
>@ 0 $O]HQDG $ (O.H\L ) /DJXP DQG +
6\VWHPV2FWSS
<DQLNRPHURJOX ³' SODFHPHQW RI DQ
XQPDQQHGDHULDOYHKLFOHEDVHVWDWLRQ8$9%6 >@ %0DR=0)DGOXOODK)7DQJ1.DWR2
IRU HQHUJ\HIILFLHQW PD[LPDO FRYHUDJH´ ,((( $NDVKL7,QRXHDQG.0L]XWDQL³5RXWLQJRU
:LUHOHVV&RPPXQLFDWLRQV/HWWHUVYROQR FRPSXWLQJ" WKH SDUDGLJP VKLIW WRZDUGV
SS$XJ LQWHOOLJHQW FRPSXWHU QHWZRUN SDFNHW
WUDQVPLVVLRQ EDVHG RQ GHHS OHDUQLQJ´ ,(((
>@ = )DGOXOODK ) 7DQJ % 0DR 1 .DWR 2
7UDQVDFWLRQV RQ &RPSXWHUV YRO 33 QR
$NDVKL 7 ,QRXH DQG . 0L]XWDQL ³6WDWHRI
SS
WKHDUW GHHS OHDUQLQJ (YROYLQJ PDFKLQH
LQWHOOLJHQFH WRZDUG WRPRUURZ¶V LQWHOOLJHQW >@ 1.DWR=0)DGOXOODK%0DR)7DQJ2
QHWZRUN WUDIILF FRQWURO V\VWHPV´ ,((( $NDVKL 7 ,QRXH DQG . 0L]XWDQL ³7KH GHHS
&RPPXQLFDWLRQV 6XUYH\V 7XWRULDOV YRO 33 OHDUQLQJYLVLRQIRUKHWHURJHQHRXVQHWZRUNWUDIILF
QRSS FRQWURO 3URSRVDO FKDOOHQJHV DQG IXWXUH
SHUVSHFWLYH´ ,((( ZLUHOHVV FRPPXQ 0DJ
>@ 0 &KHQ 0 0R]DIIDUL : 6DDG & <LQ 0
YROQRSS
'HEEDK DQG & 6 +RQJ ³&DFKLQJ LQ WKH VN\
3URDFWLYH GHSOR\PHQW RI FDFKHHQDEOHG >@ )7DQJ%0DR=0)DGOXOODK1.DWR2
XQPDQQHGDHULDOYHKLFOHVIRURSWLPL]HGTXDOLW\ $NDVKL 7 ,QRXH DQG . 0L]XWDQL ³2Q
RIH[SHULHQFH´ ,((( -6$& YRO QR UHPRYLQJURXWLQJSURWRFROIURPIXWXUHZLUHOHVV
SS QHWZRUNV $ UHDOWLPH GHHS OHDUQLQJ DSSURDFK
IRU LQWHOOLJHQW WUDIILF FRQWURO´ ,((( :LUHOHVV
>@ .)3RRQ$&KXDQG$2XDOL³$Q$,EDVHG
&RPPXQ0DJ
V\VWHPIRUWHOHFRPPXQLFDWLRQQHWZRUNSODQQLQJ´
LQ ,((( ,QWHUQDWLRQDO &RQIHUHQFH RQ >@ <&XL<;X5;XDQG;6KD³$PXOWLUDGLR
,QGXVWULDO (QJLQHHULQJ DQG (QJLQHHULQJ SDFNHWVFKHGXOLQJDOJRULWKPIRUUHDOWLPHWUDIILF
0DQDJHPHQW'HFSS LQ D KHWHURJHQHRXV ZLUHOHVV QHWZRUN
HQYLURQPHQW´ ,QIRUPDWLRQ 7HFKQRORJ\
>@ 5/L==KDR;=KRX*'LQJ<&KHQ=
-RXUQDOYROSS2FW
:DQJ DQG + =KDQJ ³,QWHOOLJHQW * :KHQ
FHOOXODU QHWZRUNV PHHW DUWLILFLDO LQWHOOLJHQFH´ >@ 0 &KHQ : 6DDG & <LQ DQG 0 'HEEDK
,(((:LUHOHVV&RPPXQLFDWLRQVYRO33QR ³(FKR VWDWH QHWZRUNV IRU SURDFWLYH FDFKLQJ LQ
SS FORXGEDVHGUDGLRDFFHVVQHWZRUNVZLWKPRELOH
XVHUV´,(((7UDQV:LUHOHVV&RPPXQYRO
>@ .$ZDKDUD6,]XPL7$EHDQG76XJDQXPD
QRSS±-XQ
³$X WRQRPRXV FRQWURO PHWKRG XVLQJ $,
SODQQLQJIRUHQHUJ\HIILFLHQWQHWZRUNV\VWHPV´ >@ - 3HUH]5RPHUR 2 6DOOHQW 5 )HUUXV DQG 5
LQ (LJKWK ,QWHUQDWLRQDO &RQIHUHQFH RQ $JXVWL ³$ UR EXVWQHVV DQDO\VLV RI OHDUQLQJ
%URDGEDQG DQG :LUHOHVV &RPSXWLQJ EDVHG FRH[LVWHQFH PHFKDQLVPV IRU /7(8
&RPPXQLFDWLRQ DQG $SSOLFDWLRQV 2FW RSHUDWLRQLQQRQVWDWLRQDU\FRQGLWLRQV´LQ3URF
SS RI ,((( 9HKLFXODU 7HFKQRORJ\ &RQIHUHQFH
97&)DOO6HS
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
.H\ZRUGV±$UWLILFLDOLQWHOOLJHQFHEHVWSUDFWLFHGHYHORSPHQWLGHDWHOHFRPRSHUDWRUVXQLTXHDGYDQWDJHV
1. INTRODUCTION WKH DQDO\WLFDO ZULWLQJ WHVW RI *5( DQG 6$7 ZKLFK
IUHHG WHDFKHUV IURP UHSHWLWLYH ZRUN ,Q WKH )LQWHFK
$UWLILFLDO LQWHOOLJHQFH $, FRQWLQXHV WR GHYHORS ZHOO GRPDLQ E\ WDNLQJ DGYDQWDJH RI $, WHFKQRORJ\
VLQFH LW ZDV UDLVHG LQ WKH 86 'DUWPRXWK PHHWLQJ LQ *RRJOH XWLOL]HG IDFH UHFRJQLWLRQ WHFKQRORJ\ RQ
>@LVLWV VL[WLHWK DQQLYHUVDU\ $IWHU PRUH $QGURLG 3D\ DQG IDFWV SURYHG WKDW WKH VHFXULW\ DQG
WKDQ KDOI D FHQWXU\¶V GHYHORSPHQW $, KDV UHDFKHG D XVDELOLW\RISD\PHQWVHUYLFHVLPSURYHGVLJQLILFDQWO\
UHODWLYHO\ VRSKLVWLFDWHG VWDWH LQ WHUPV RI ERWK
KDUGZDUH DQG VRIWZDUH ZKHUH WKH SRWHQWLDO RI $W SUHVHQW WKH HFRORJLFDO SDWWHUQ RI $, KDV EHHQ
LQGXVWULDO DSSOLFDWLRQ LV VWLPXODWHG 6LQFH ZLWK HVWDEOLVKHG JUDGXDOO\ ,Q WKH IROORZLQJ \HDUV WKH
WKH UDSLG GHYHORSPHQW RI LWV UHODWHG WHFKQRORJ\ VXFK VSHFLDOL]HG LQWHOOLJHQW DSSOLFDWLRQ ZLOO EH WKH PDLQ
DVGHHSOHDUQLQJDQGNQRZOHGJHPDSSLQJWKHWUHQGRI SRWHQWLDO DUHD IRU WKH IXWXUH GHYHORSPHQW RI $, 1R
$, WHFKQRORJ\ LQGXVWULDOL]DWLRQ KDV HPEDUNHG RQ D PDWWHULILWLVDVSHFLDOL]HGRUJHQHUDOL]HGDSSOLFDWLRQ
IDVW WUDFN 0DQ\ JLDQW FRPSDQLHV KDYH PDGH WKH HQWHUSULVH OD\RXW RI $, ZLOO IRFXV RQ WKH WKUHH
UHPDUNDEOH DFKLHYHPHQWV LQ PHGLFDO HGXFDWLRQ DV EDVLF OHYHOV RI GDWD DQG FRPSXWLQJ OD\HU EDVH
ZHOO DV )LQWHFKDUHDV +HUH DUHVRPH H[DPSOHV ,%0 DOJRULWKP OD\HU WHFKQRORJ\ DQG DSSOLFDWLRQ OD\HU
:DWVRQ FRXOG GLDJQRVH D UDUH GLVHDVH ZLWKLQ 7KH&KLQHVHJRYHUQPHQWSODFHVDKLJKLPSRUWDQFHRQ
PLQXWHV ZLWK WKH KHOS RI $, WHFKQRORJ\ DQG WKH $,DQGKDVUHOHDVHGDVHULHVRISROLFLHVWRVXSSRUWLWV
DFFXUDF\ RI OXQJ FDQFHU WUHDWPHQWV UHFRPPHQGDWLRQV GHYHORSPHQW ,Q 0D\ IRXU 0LQLVWULHV MRLQWO\
FRXOGEHXSWR1RZ$,FRXOGPDNHWKHDFFXUDF\ LVVXHG ³¶,QWHUQHW SOXV¶ $, DFWLRQ SODQV LQ WKH QH[W
RI LQWHOOLJHQW PHGLFDO GLDJQRVLV FRPSDUDEOH WR D WKUHH\HDUV´5HFHQWO\$,ZDVDGGHGLQWKHUHSRUWRQ
GRFWRU ZLWK \HDUV RI H[SHULHQFH %\ SURYLQJ $, WKHZRUNRIWKHJRYHUQPHQWDWWZRVHVVLRQV2Q-XO\
WHFKQRORJ\FDQEHWUDLQHGWRDFFXUDWHO\DQDO\]HDQG WKHVWDWHFRXQFLOLVVXHG³$QHZJHQHUDWLRQRI
HYDOXDWHWHVWDQVZHUV(76KDVVXFFHVVIXOO\UHYLHZHG $,GHYHORSPHQWSURJUDP´ ZKLFK QRWHG$,DVRQHRI
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
WKH PRVW VLJQLILFDQW QDWLRQDO GHYHORSPHQW VWUDWHJLHV &KDUDFWHUL]HG E\ WKH ZLGH FRYHUDJH QXPHURXV
7DNLQJ DGYDQWDJH RI WKH DERYH IDYRUDEOH SROLFLHV YDULHWLHV ODUJH YROXPH DQG KLJK TXDOLW\ WKHLU GDWD
&KLQHVH KLJKWHFK LQGXVWULHV DUH GHYRWLQJ WR GHYHORS UHVRXUFHV ZLOO FUHDWH UHPDUNDEOH YDOXH WKURXJK GDWD
$,UHODWHG WHFKQRORJ\ DQG EXLOG WKH $, HFRV\VWHP PLQLQJDQGDQDO\VLV7RHQKDQFHFRPSXWLQJSRZHU
7HOHFRP RSHUDWRUV DUH QR H[FHSWLRQ )RU LQVWDQFH LQ ZH KDYH HVWDEOLVKHG DQ DGYDQFHG LQIUDVWUXFWXUH
&KLQD7HOHFRPSURSRVHGWKHWUDQVIRUPDWLRQ SODWIRUP RI ELJ GDWD LQFOXGLQJ WKH ELJ GDWD
VWUDWHJ\LQWREHWKHOHDGLQJLQWHJUDWHGLQWHOOLJHQW PDQDJHPHQW SODWIRUP ELJ GDWD DSSOLFDWLRQV DQG
LQIRUPDWLRQVHUYLFHSURYLGHU7KURXJKWKHZD\WR$, RSHUDWLQJ SODWIRUP ELJ GDWD FDSDELOLW\ SODWIRUP DQG
WKH\ ZLOO SRVLWLYHO\ UHVSRQG WR WKH QDWLRQDO HQWHUSULVHOHYHO ELJ GDWD DFTXLVLWLRQ V\VWHP 6R IDU
GHYHORSPHQWSODQQLQJLQWKHILHOGRI$,FORVHO\NHHS ZH KDYH PDVWHUHG WKH VXSHUODUJHVFDOH GDWD
SDFH ZLWK WKH HPHUJLQJ IRUZDUGORRNLQJ WHFKQRORJ\ SURFHVVLQJ DQG DQDO\VLV FDSDELOLWLHV ,Q WKH
ERWK GRPHVWLFDOO\ DQG DEURDG DQG GHGLFDWHG WR DOJRULWKPV UHVHDUFK DUHD E\ FRPELQLQJ RSHQ VRXUFH
SURYLGLQJWKH$,LQIUDVWUXFWXUH)XUWKHUPRUHWHOHFRP WHFKQRORJ\ DQG LQGHSHQGHQW UHVHDUFK DQG
RSHUDWRUV DUH DOVR VHHNLQJ WKH HQWU\ SRLQW IRU GHYHORSPHQW DELOLW\ WHOHFRP RSHUDWRUV¶ $, WHDPV
FRRSHUDWLRQ LQ WKH ZD\ RI WKH LQWHOOLJHQW QHWZRUN IRFXVRQWKHGLUHFWLRQRIQDWXUDOODQJXDJHSURFHVVLQJ
VPDUW RSHUDWLRQ DQG EXVLQHVV HFRORJ\ DQG WR DQG KDV DFKLHYHG VRPH WHFKQLFDO EUHDNWKURXJKV LQ
FRRSHUDWH ZLWK WKH SRWHQWLDO LQGXVWU\ SXVK IRUZDUG WHUPV RI LQIRUPDWLRQ H[WUDFWLRQ GRPDLQ NQRZOHGJH
WKH UHVHDUFK RQ $, FRUH WHFKQRORJ\ DQG SURPRWH WKH EDVH HVWDEOLVKPHQW LQIRUPDWLRQ UHFRPPHQGDWLRQ DQG
GHYHORSPHQWRIUHOHYDQWLQWHOOLJHQFHDSSOLFDWLRQV ILOWHULQJ DQG VR RQ ,Q RUGHU WR VDWLVI\ WKH LQWHUQDO
UHTXLUHPHQWV RI RSHUDWRUV DQG PHHW WKH QHHGV RI
2. THE UNIQUE ADVANTAGES FOR FXVWRPHUV E\ WDNLQJ IXOO DGYDQWDJH RI WKH DERYH
OPERATORS TO DEVELOP AI VWUHQJWKV WHOHFRP RSHUDWRUV DUH WU\LQJ WR PHUJH $,
WHFKQRORJ\ZLWKLQQRYDWLYHWHFKQRORJLHVVXFKDVFORXG
,Q WKH WLGH RI $, UHVHDUFK DQG GHYHORSPHQW WKH FRPSXWLQJELJGDWDEORFNFKDLQDQG,QWHUQHWRIWKLQJV
RSHUDWRUV DUH DOVR VHDUFKLQJ IRU ZD\V WR WUDQVIRUP WR VDWLVI\ WKH LQWHUQDO DQG H[WHUQDO GHPDQGV RI
WKHPVHOYHV IURP ³WUDGLWLRQDO RSHUDWRU´ WR ³LQWHOOLJHQW HQWHUSULVHV 8QGRXEWHGO\ WKLV PRYH ZLOO VKDSH WKH
RSHUDWRU´ FKDUDFWHULVWLF LQWHOOLJHQW WHFKQRORJ\ DUFKLWHFWXUH DQG
0RVW RI WKH ZHOONQRZQ RSHUDWRUV RI WKH ZRUOG DUH VXSSRUWLQWHOOLJHQWVWUDWHJLHV
FDUU\LQJ RXW $,UHODWHG ZRUN ˅ )UDQFH 7HOHFRP
2UDQJH DQG 'HXWVFKH 7HOHNRP $* UHFHQWO\
DQQRXQFHG WKDW WKH YRLFH DVVLVWDQW SODWIRUP 'MLQJR
ZKLFK ZDV EDVHG RQ $, LV EHLQJ GHYHORSHG ,W ZDV
H[SHFWHGWRFRPSHWHZLWKWKHH[LVWLQJYRLFHSODWIRUPV
VXFK DV $SSOH¶V 6LUL DQG $PD]RQ¶V $OH[D LQ WKH
PDUNHW ˅9RGDIRQHˈ WKH JLDQW (XURSHDQ RSHUDWRU
%ORFNFKDLQ
DOVRVWDWHGWKDWLWZLOOODXQFKDFXVWRPHUVHUYLFHURERW
FDOOHG72%LWRKHOSKDQGOHFXVWRPHUVHUYLFHLVVXHV
DQGHQKDQFHWKHXVHUH[SHULHQFH˅-DSDQHVHWHOHFRP
)LJ7KHURDGPDSRI$,GHYHORSPHQWRI&KLQD7HOHFRP
RSHUDWRU 177 KDV DOVR ODXQFKHG LWV $, SODWIRUP ,WV
PDLQ UHVHDUFK LQWHUHVWV LQFOXGH DVVLVWDQW ± $,
HFKRFDUGLRJUDSK\ ± $, HQYLURQPHQWDO $, DQG
3. TELECOM OPERATORS' PRACTICES
QHWZRUN$, IN THE FIELD OF ARTIFICIAL
INTELLIGENCE
)URP WKH WHOHFRP RSHUDWRUV¶ SRLQW RI YLHZ WKHUH DUH %DVHG RQ WKHVH XQLTXH VWUHQJWKV WHOHFRP RSHUDWRUV
IRXUNH\DGYDQWDJHVWRGHYHORS$,ELJGDWDUHVRXUFH KDYH LPSOHPHQWHG D VHULHV RI HIIHFWLYH SUDFWLFHV WR
VXSHULRU FRPSXWLQJ SRZHU ORWV RI LQYHVWPHQW LQ $, VDWLVI\ WKH LQWHUQDO DQG H[WHUQDO GHPDQGV RI
DOJRULWKPLFUHVHDUFKDQGDEURDGFXVWRPHUEDVH,Q HQWHUSULVHV )RU H[DPSOH LQ RUGHU WR VDYH HQHUJ\ LQ
WHUPVRIDELJGDWDUHVRXUFHWDNH&KLQD7HOHFRPDVDQ RXU LQWHUQDO GDWD FHQWHUV E\ UHIHUULQJ WR WKH UHODWHG
H[DPSOHZKLFKKDVPRELOHEDVHVWDWLRQVDQG DOJRULWKPV SXEOLVKHG E\ *RRJOH &RUSRUDWLRQ DQ
GDWDFHQWHUVDOORYHU&KLQD7KHPRELOHVXEVFULEHU DOJRULWKPEDVHGRQGHHSOHDUQLQJKDVEHHQSURSRVHG
VFDOH KDV UHDFKHG PLOOLRQ DQG WKH EURDGEDQG ZKLFKKDVJRWJUHDWUHVXOWVLQHQHUJ\VDYLQJGXULQJWKH
VXEVFULEHU VFDOH KDV UHDFKHG PLOOLRQ &KLQD WHVWV LQ WKH GDWD FHQWHUV RI WHOHFRP RSHUDWRU >@ 7R
7HOHFRP SRVVHVVHV WKH ZRUOG
V ODUJHVW GDWD KHOS LPSURYH SXEOLF VHFXULW\ E\ PDNLQJ IXOO XVH RI
LQIUDVWUXFWXUH DQG JUHDWHVW QXPEHU RI VXEVFULEHUV WKH³ELJGDWDUHVRXUFH´DGYDQWDJHDQGZLWKDVHULHVRI
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
FULPHFOXHVDQGWKHWRWDOSLHFHVRIFULPHHYLGHQFHDQG
JUHDWO\UHGXFHWKHLQYHVWPHQWRILQYHVWLJDWRUUHVRXUFHV
,Q WKLV ZD\ WKH SURVHFXWRUV FDQ IRFXV PRUH RQ
GHWHUPLQLQJWKHQDWXUHRIWKHFDVHWKHGLUHFWLRQVDQG
WKH PHDQV RI LQYHVWLJDWLRQ VR DV WR VWUHQJWKHQ WKH
GHWHFWLRQHIILFLHQF\
7KH ³LQWHOOLJHQW SROLFH´ DV WKH $, UHODWLRQ LQVLJKW
V\VWHPLVUHVHDUFKHGDQGGHYHORSHGWRZRUNIRUSXEOLF
VHFXULW\XUEDQFRPSUHKHQVLYHPDQDJHPHQWDQGRWKHU
LQGXVWULHV 7KH LQGXVWU\ FXVWRPHU FDQ DSSO\
)LJ&7%5,GDWDFHQWHUSRZHUVDYLQJGHVLJQEDVHGRQ$,
LQWHOOLJHQW SROLFH WR HVWDEOLVK D SXEOLF VDIHW\
PDQDJHPHQWVROXWLRQIRULQWHOOLJHQWFLWLHV
&7%5, KDV FRQGXFWHG VRPH WHVWV LQ WKH ODE DQG
REWDLQHG VRPH JRRG UHVXOWV 7KH ODE UHVRXUFH SRRO
FRQVLVWV RI SK\VLFDO PDFKLQHV GLYLGHG LQWR
90V 'XULQJ WKH WZR PRQWKV¶ WHVW SHULRG WKH WRWDO
DPRXQWRISRZHUVDYLQJLVXSWR.:KPHDQLQJ
.:KHYHU\GD\$WRWDORI<XDQLVVDYHG
$ SUDFWLFDO WHVW LV FRQGXFWHG LQ ,QQHU 0RQJROLD
$XWRQRPRXV5HJLRQE\&KLQD7HOHFRP7LDQ\L&ORXG
&RPSDQ\ 7KH 5HVRXUVH SRRO FRQVLVWHG RI
SK\VLFDO PDFKLQHV DQG ZDV GLYLGHG LQWR 90V
5HVXOWVVKRZWKDWDERXW<XDQZDVVDYHGIRUHDFK
SK\VLFDOPDFKLQHLQGLFDWLQJDQDYHUDJHSRZHUVDYLQJ
UDWHRIDERXW$,EDVHGHQHUJ\VDYLQJSURGXFWVLQ
GDWD FHQWHUV FRXOG QRW RQO\ ORZHU SURGXFWLRQ FRVW
JUHDWO\ EXW DOVR UHGXFH HQHUJ\ FRQVXPSWLRQ )LJ7KHLQWHUIDFHRIWKH³LQWHOOLJHQWSROLFH´
HIIHFWLYHO\
%DVHGRQ$,FORXGVHUYLFHVELJGDWDDQGWKH,QWHUQHW
RI WKLQJV WHFKQRORJLHV WKLV SURJUDP DFFHVVHV SXEOLF
3.2. AI-based public security management VHFXULW\ GDWD DQG WHOHFRP GDWD WR KHOS WKH XUEDQ
platform DGPLQLVWUDWRUV TXLFNO\ WUDQVIRUP YDULRXV FRPSOLFDWHG
XQVWUXFWXUHG GDWD LQWR NQRZOHGJH PDSSLQJ $IWHU
*RYHUQPHQWFXVWRPHUVDUHRQHRIWKHPDMRUFXVWRPHU GHPRQVWUDWLQJ LQ WKH IRUP RI GDWD YLVXDOL]DWLRQ WKH
JURXSVIRUWHOHFRPRSHUDWRUV7KHZRUOG¶VPDLQVWUHDP LQWHOOLJHQFH DVVRFLDWLRQ EDVHG RQ WKH ORFDWLRQ
RSHUDWRUV DUHDOOWU\LQJ WKHLU EHVW WR KHOS JRYHUQPHQW LQIRUPDWLRQ LV FRPSOHWHG DQG WKH FRPSUHKHQVLYH
PDNH FLW\ PDQDJHPHQW HDVLHU DQG PRUH HIILFLHQW $W UHSRUWV IRU SURFHVVLQJ WDVNV DUH SUHVHQWHG VR DV WR
SUHVHQW WKH FLW\ DGPLQLVWUDWRUV LQ &KLQD DUH VXSHUYLVH WKH PXOWLGLPHQVLRQDO SXEOLF RSLQLRQ RI WKH
FRQIURQWLQJ WKH LQFUHDVLQJO\ FRPSOLFDWHG SXEOLF WDUJHW REMHFW DQG HYHQWV $Q ³LQWHOOLJHQW SROLFH´ $,
VHFXULW\PDQDJHPHQWSUREOHP2QHRIWKHIDFWVLVWKDW UHODWLRQ LQVLJKW V\VWHP ZRUNV WR SURYLGH WKH YDULHG
WKH UDSLG GHYHORSPHQW RI XUEDQL]DWLRQ KDV EHHQ FXVWRPL]HGIHDWXUHVZKLFKFHQWHURQWKUHHPRGXOHVRI
FRQVWDQWO\ LPSDFWLQJ WKH XUEDQ ³VWHDG\ VWUXFWXUH´ FDVH PDS DQG DVVRFLDWLRQ LQFOXGLQJ FDVH DQDO\VLV
VKDSHGLQWKHSODQQHGHFRQRP\SHULRGDQGWKHXUEDQ FOXH H[WUDFWLRQ FDVH UHODWLRQ GLVSOD\ FULPH HDUO\
PDQDJHPHQW LV IDFLQJ LQFUHDVLQJ FKDOOHQJHV ZLWK WKH ZDUQLQJ FDVH WKHUPRG\QDPLF GLDJUDP VXVSHFW
JURZLQJSRSXODWLRQHVSHFLDOO\LQPHWURSROLVHV,QWKLV WUDFNLQJH[WHUQDOSRSXODWLRQGHWHFWLRQDQGXUEDQURDG
FRQWH[W WKH FRQWUDGLFWLRQ EHWZHHQ WKH ORZHUOHYHO IORZ DQDO\VLV ,W KDV YDVWO\ HQKDQFHG WKH LQWHOOLJHQFH
SROLFHGHSOR\PHQWDQGWKHSHUVLVWHQWO\ DVFHQGLQJQHZ RISXEOLFVHFXULW\PDQDJHPHQW
FDVHVKDVSRVHGJUHDWFKDOOHQJHV IRUWKHLQYHVWLJDWLRQ
DQG LQWHUURJDWLRQ RI FDVHV WKH FRQYHQWLRQDO ZD\ 'XULQJ WKH SURFHVV RI DGRSWLQJ $,7 LQ WKH UHDOL]HG
FDQQRWPHHWWKHQHHGVRISXEOLFVHFXULW\7KHUHIRUHLW IXQFWLRQ RI FULPH SUHGLFWLRQ ZH KDYH FRQGXFWHG D
LV XUJHQW WR DSSO\ WKH LQWHOOLJHQW PHDQV LQ YDULHW\RIHIIHFWLYHDOJRULWKPH[SORUDWLRQDQGUHVHDUFK
LQYHVWLJDWLQJ DQG FRPSDULQJ IURP PXOWLSOH $IWHU WKH SUHOLPLQDU\ GDWD DQDO\VLV DQG WHFKQLFDO
GLPHQVLRQV VXFK DV VXVSHFW
V IXQGV DFWLRQ WUDFN DQG LQYHVWLJDWLRQ UDQGRP IRUHVW DOJRULWKP LV VHOHFWHG WR
DVVRFLDWHG ILJXUHV ZKLFK KHOSV WR LPSURYH WKH SUHGLFWWKH W\SH RI FULPH DQG PRQWKV GD\V SHULRGV
HIILFLHQF\ RI LQWHUURJDWLQJ LQIRUPDWLRQ ILQG RXW WKH ODWLWXGHDQGORQJLWXGHDUHSHUFHLYHGDVWKHIHDWXUHVWR
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
WUDLQWKHFODVVLILHU7KHFODVVLILFDWLRQDFFXUDF\UDWHLV
DSSUR[LPDWHO\7KHUHDUHIRXUVWDJHVGXULQJRXU
GHYHORSPHQW LWHUDWLRQ 6XEVHTXHQWO\ WKH ;JERRVW
DOJRULWKP ZKLFK LV WKH PXOWLSOH GHFLVLRQ WUHH
DOJRULWKPV DV WKH UDQGRP IRUHVW EXW SRVVHVVHV EHWWHU
HIIHFWV DQG SHUIRUPDQFH LV FKRVHQ >@ $QG WKH
DFFXUDF\ LV LQFUHDVHG WR YLD DSSURSULDWHO\
DGMXVWHG SDUDPHWHUV +RZHYHU WKHUH DUH RQO\ DERXW
YDOLG GDWD REWDLQHG IURP WKH FROOHFWHG SXEOLF
VHFXULW\ GDWDIRU KDOID \HDU LQ WKH SUHOLPLQDU\ VWDJH
ZKLOHWKHGDWDLVGLYLGHGLQWRPRUHWKDQFDWHJRULHV
ZKLFK PD\ WULJJHU RYHUILWWLQJ ,Q RUGHU WR REWDLQ
EHWWHU SUHGLFWLRQ DFFXUDF\ ZH UHFRQVLGHUHG WKH UHDO
LPSOLFDWLRQRIWKHFULPHSUHGLFWLRQDQGIRXQGWKDWWKH
PRGHO EDVHG RQ WKH FDVH FODVVLILFDWLRQ FDQ PHUHO\ )LJ7KHHYROXWLRQSURFHVVRIDSUHGLFWLRQDOJRULWKP
IRUFULPHSUHGLFWLRQ
SURYLGH WKH W\SH RI FDVH ZKHQ LW KDSSHQV UDWKHU WKDQ
WKH SUREDELOLW\ RI DFWXDO RFFXUUHQFH RU WKH H[SHFWHG
3.3. AI-based health management and control
TXDQWLW\$IWHUWKHLQYHVWLJDWLRQLWLVIRXQGWKDW6HOI
([FLWDWLRQ 3RLQW 3URFHVV 0RGHO 6(33 SXW LQWR XVH
,Q UHFHQW \HDUV WKH PHGLFDO $, PDUNHW KDV VKRZQ D
E\3UHG3ROWKHIDPRXVFULPHIRUHFDVWFRPSDQ\LQWKH
YDVW JURZWK 3XEOLVKHG E\ &KLQHVH GLJLWDO PHGLFDO
8QLWHG6WDWHVFDQVHUYHWRSUHGLFWWKHFULPHTXDQWLW\
QHWZRUNWKHUHSRUW³7KHDQDO\VLVUHSRUWRI
VSDWLDO GHQVLW\ DQG PDNHV VRPH HIIHFWLYH
$, LQ PHGLFDO PDUNHW´ DQDO\]HG WKDW LQ WKH ILUVW
DFKLHYHPHQWV:LWKWKHUHVHDUFKRQWKHUHODWHGSDSHUV
TXDUWHU RI PRUH WKDQ $, HQWHUSULVHV KDYH
WKHWHDPDGMXVWVWKHDOJRULWKPPRGHOLQOLQHZLWKWKH
REWDLQHG ILQDQFLQJ PRVW RI ZKLFK DUH LQ PHGLFDO
IHDWXUHV RI SXEOLF VHFXULW\ GDWD LQFOXGLQJ D VHOHFWHG
ILHOGV,QGHHG$,HQWHUSULVHVLQWKHPHGLFDOILHOGKDYH
DSSURSULDWH WLPH VSDFH EDQGZLGWK DQG LQWHUFHSW
JUHDWGHYHORSPHQWSRWHQWLDO$OVRUHVLGHQWV¶KHDOWKLV
LQWHUFHSWLYHLWHUDWLYHSURFHVVDQGWKHSURSHUVDPSOLQJ
D PDMRU FRQFHUQ RI WKH JRYHUQPHQW +HQFH WHOHFRP
PHWKRGWKH6(33DFKLHYHGWKHH[SHFWHGSHUIRUPDQFH
RSHUDWRUV DUH GRLQJ D VHULHV UHVHDUFK LQ KHDOWK
7KHSUHGLFWLRQDFFXUDF\JRHVXSWR7KHVSHFLILF
PDQDJHPHQW DQG FRQWURO ILHOG WR IXOILOO JRYHUQPHQW
PRGHOLQJSURFHVVLVDVIROORZV
FXVWRPHUV¶UHTXLUHPHQWV
3DUDPHWHU HVWLPDWLRQ SUHVHQW D FULPH PRGHO
FRPSRVHG RI D YDULDEOH EDQGZLGWK NHUQHO 2SHUDWRUVKDYHDJUHDWQXPEHURIIL[HGQHWZRUNVDQG
VPRRWKLQJ HVWLPDWH IRU WKH EDFNJURXQG LQWHQVLW\ PRELOH QHWZRUN VXEVFULEHUV WKXV D KXJH DPRXQW RI
DQG D VLPSOH H[SRQHQWLDOLQWLPH *DXVVLDQLQ GDWD FRXOG EH REWDLQHG %\ DQDO\]LQJ WKHVH GDWD
VSDFHNHUQHOIRUWKHH[FLWHGLQWHQVLW\ RSHUDWRUV FDQ H[WUDFW WKH XVHU¶V QHWZRUN EHKDYLRU
0RGHO ILWWLQJ GHWHUPLQH WKH DSSURSULDWHQHVV RI D LQIRUPDWLRQ $QG E\ DFFHVVLQJ RWKHU UHODWHG GDWD
PRGHO E\ XVLQJ WKH GDWD FROOHFWHG IURP D SROLFH LQIRUPDWLRQ XVHU¶V KHDOWK GDWDEDVH FDQ DOVR EH
VWDWLRQ HVWDEOLVKHG*UDGXDOO\WKHPHGLFDOLPDJHFORXGFRXOG
6LPXODWLRQ WHVW WKH JRRGQHVV RI WKH ILW RI WKH EH EXLOW ZKLFK PHDQV D ORW IRU GHYHORSLQJ $, LQ WKH
PRGHO PHGLFDOILHOG
$WSUHVHQWWKHWHDPLVWU\LQJWRXVHWKHGHHSOHDUQLQJ ,Q WKH WHFKQLFDO DVSHFW WKURXJK WKH HIIHFWLYH XVH RI
DOJRULWKPWRLPSURYHWKHDFFXUDF\RIFULPHSUHGLFWLRQ RXU DEXQGDQW LQIUDVWUXFWXUH UHVRXUFHV VXFK DV WKH
EDVLF OLJKW ZLGWK * QHWZRUN :L)L HTXLSPHQW
FORXG VWRUDJH HWF RSHUDWRUV FRXOG DFWLYHO\ GHYHORS
7KH LQWHOOLJHQW SXEOLF VHFXULW\ PDQDJHPHQW V\VWHP WKH$,WHFKQRORJ\LQWKHPHGLFDOILHOG0HGLFDOLPDJH
KDVEHHQLPSOHPHQWHGLQRQH3XEOLF6HFXULW\%XUHDX IHDWXUHV DQG D FOLQLFDO SUREOHPV FODVVLILFDWLRQ PRGHO
RI %HLMLQJ DQG 6LFKXDQ 3ROLWLFV DQG /DZ &RPPLWWHH KDYH EHHQ EXLOW EDVHG RQ WKH 690 DQG &11 PRGHO
7KH V\VWHP KDV DFFHVV WR WKH ORFDO XUEDQ SXEOLF >@>@ %\ TXDQWLWDWLYH DQDO\VLV GHSWK FRPSDULVRQ
VHFXULW\ PDQDJHPHQW GDWD DQG LV LQWHJUDWHG ZLWK WKH GHHS OHDUQLQJ HIILFLHQW DQG DFFXUDWH SLFWXUH UHDGLQJ
PRELOHVWDWLRQGDWDRIRSHUDWRUV,WLVQRZDVVLVWLQJWKH FRXOGEHDFKLHYHGZKLFKFRXOGKHOSGRFWRUVGLDJQRVH
XUEDQDGPLQLVWUDWRUVLQPDNLQJGHFLVLRQVZLWKWKHDLG LQWHOOLJHQWO\ )RU LQVWDQFH &KLQD 7HOHFRP¶V
IURP$,7ZKLFKKDVDFWXDOO\HQKDQFHGWKHLQWHOOLJHQW H[SHULPHQWDO UHVXOWV VKRZ WKDW WKH PHGLFDO LPDJH
OHYHORIFLW\PDQDJHPHQW UHFRJQLWLRQDFFXUDF\EDVHGRQGHHSOHDUQLQJFDQUHDFK
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
>@ .LP .HXQ +HXL HW DO $ 6WXG\ RQ 0HVVDJH &HOO )RUPDWLRQ $GYDQFHV LQ 1DWXUDO
4XHXH 6DIH 3URSHU 7LPH IRU $, 2SHQ $3, &RPSXWDWLRQ 6SULQJHU %HUOLQ +HLGHOEHUJ
)LQWHFK $UFKLWHFWXUH &RPSXWHU DQG
$SSOLFDWLRQV
>@ 6HWLDZDQ 1RRU $NKPDG HW DO 'LDJQRVLV RI
>@ 177 DQG 0,7 WR FROODERUDWH LQ QH[W FRURQDU\ DUWHU\ GLVHDVH XVLQJ $UWLILFLDO
JHQHUDWLRQ ,QWHUQHW DQG $, &RPSXWLQJ -DSDQ ,QWHOOLJHQFH EDVHG GHFLVLRQ VXSSRUW V\VWHP
8QLYHUVLW\0DOD\VLD3HUOLV±
>@ *DR -LP DQG 5DWQHVK -DPLGDU0DFKLQH
OHDUQLQJ DSSOLFDWLRQV IRU GDWD FHQWHU
RSWLPL]DWLRQ*RRJOH:KLWH3DSHU
>@ <LQ6KL $Q 7KH H[SORUDWLRQ DQG SUDFWLFH RI
RSHUDWRUV
$, >-@ &RPPXQLFDWLRQ HQWHUSULVH
PDQDJHPHQW
>@ /HFXQ<DQQ<%HQJLRDQG*+LQWRQ'HHS
OHDUQLQJ1DWXUH
>@ &KHQ 7LDQTL DQG & *XHVWULQ ;*%RRVW $
6FDODEOH7UHH%RRVWLQJ6\VWHP
>@ -RDFKLPV7KRUVWHQ0DNLQJ/DUJH6FDOH690
/HDUQLQJ 3UDFWLFDO 7HFKQLVFKH 8QLYHUVLWlW
'RUWPXQG 6RQGHUIRUVFKXQJVEHUHLFK
.RPSOH[LWlWVUHGXNWLRQ LQ PXOWLYDULDWHQ
'DWHQVWUXNWXUHQ
>@ 2]WXUN*XUNDQ=.2]WXUNDQG$$,VOLHU
$&RPSDULVRQRI&RPSHWLWLYH1HXUDO1HWZRUN
ZLWK 2WKHU $, 7HFKQLTXHV LQ 0DQXIDFWXULQJ
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
Keywords±&RUUHODWLRQVF\EHUDWWDFNVGHSHQGHQFLHVQHWZRUNWLPHVHULHV
1. INTRODUCTION 5HVHDUFKRQF\EHUDWWDFNSDWWHUQUHFRJQLWLRQLQQHWZRUN
WUDIILFKDVEHHQJRLQJRQIRUTXLWHVRPHWLPH5HOHYDQW
7RGD\PRVWRUJDQL]DWLRQVLQWKHZRUOGKHDYLO\GHSHQG UHVHDUFK DSSURDFKHV KDYH EHHQ PDGH LQ WKH VFRSH RI
RQ ,7 LQIUDVWUXFWXUH VXFK DV FRPSXWHU QHWZRUNV ILQGLQJ VDWLVIDFWRU\ SUHGLFWLQJ PDWKHPDWLFDO PRGHOV
VHUYHUVGDWDEDVHVDQGLQIRUPDWLRQV\VWHPVWRFDUU\RXW IRUVXFKLQFLGHQWV(PSLULFDOPRGHOOLQJRIF\EHUDOHUWV
WKHLU GDLO\ DFWLYLWLHV 7KLV LQIUDVWUXFWXUH KDV EHHQ WKH UHODWHV PDLQO\ WR WKH VWXG\ RI WLPHVHULHV PRGHOV IRU
WDUJHWRIF\EHUDWWDFNVZKLFKDLPWRGLVUXSWWKHDELOLW\ HIILFLHQW IRUHFDVWLQJ RI F\EHUDWWDFNV ,Q >@ 0DUNRY
RIDQRUJDQL]DWLRQWRSHUIRUPLWVDFWLYLWLHVVWHDOGDWDRU PRGHOV RQ WLPHVHULHV GDWD RI FRPPXQLFDWLRQV ZHUH
HYHQSXWLWRXWRIEXVLQHVV$FFRUGLQJWR>@DQG>@ XVHGWRKLJKOLJKWWKHLPSRUWDQFHRIGHWHFWLQJW\SHVRI
DIWHU D VHFXULW\ EUHDFK RUJDQL]DWLRQV DUH DIIHFWHG LQ DQRPDOLHV LQ D FRPSXWHU QHWZRUN WUDIILF IORZ LQ
ILHOGV VXFK DV RSHUDWLRQV ILQDQFH V\VWHPV EUDQG LGHQWLI\LQJW\SHVRI LQWUXVLRQV LQ WKH QHWZRUN ,Q >@
UHSXWDWLRQDQGFXVWRPHUUHWHQWLRQ&\EHUDWWDFNVFDXVH DQG>@$5),0$DQG),*$5&+PRGHOVZHUHXVHGRQ
YDULRXV GLUHFW RU KLGGHQ FRVWV WR DQ RUJDQL]DWLRQ¶V WLPHVHULHVGDWDRIQHWZRUNWUDIILFWRSUHGLFWZKHWKHU
WDQJLEOH DQG LQWDQJLEOH DVVHWV MHRSDUGL]LQJ HYHQ LWV GHWHFWHG DQRPDOLHVDUHLQGLFDWLRQVRIUHDOF\EHUDWWDFNV
VXVWDLQDELOLW\LQVRPHFDVHV7KLVHPSKDVL]HVWKHQHHG RUMXVW IDOVH DODUPV DQG WR GHWHFW F\EHUDWWDFNV RQ D
IRU RUJDQL]DWLRQV WR SULRULWL]H F\EHUVHFXULW\ VR DV WR ''R6 QHWZRUN ,Q >@ SUHGLFWLYH WLPHVHULHV PRGHOV
PLQLPL]HWKHULVNRIDF\EHUDWWDFNEHLQJVXFFHVVIXO$Q ZHUHXVHGWRIRUHFDVWYXOQHUDELOLWLHVRIZHEEURZVHUV
RUJDQL]DWLRQWKDWFDQUHGXFHLWVDGPLQLVWUDWLYHFRVWVE\ ZKLOH LQ >@ D G\QDPLF ULVN DVVHVVPHQW VWRFKDVWLF
RSWLPL]LQJLWVF\EHUVHFXULW\GHIHQVHPHFKDQLVPVFDQ PRGHO LV XVHG WR LGHQWLI\ LQYHQWRU\HQKDQFHPHQW
GLYHUW PRUH PRQHWDU\ UHVRXUFHV WR RWKHU LQYHVWPHQWV RSSRUWXQLWLHVIRUFULWLFDOO\GLVUXSWHGV\VWHPV
IRUEXVLQHVVJURZWK'XHWRWKHKLJKFRVWVLQYROYHGLQ
DGRSWLQJ DQG LPSOHPHQWLQJ D SURDFWLYH F\EHUVHFXULW\ 2XU VWXG\ FRQWULEXWHV WR WKH UHOHYDQW UHVHDUFK E\
SROLF\ RUJDQL]DWLRQV XVXDOO\ GHYHORS LQHIIHFWLYH DSSO\LQJ PDWKHPDWLFDO PHWKRGV IRU WKH GHWHFWLRQ RI
F\EHUVHFXULW\ VROXWLRQV DV UHDFWLRQV WR F\EHUDWWDFN VLJQLILFDQW FRUUHODWLRQ DQG GHSHQGHQFH EHWZHHQ
LQFLGHQWV >@ ,PSOHPHQWLQJ DQ HIIHFWLYHO\ SURDFWLYH GLIIHUHQW W\SHV RI F\EHUWKUHDW DOHUWV ,Q RUGHU WR
LQIRUPDWLRQVHFXULW\SROLF\PDNHVWKH,7LQIUDVWUXFWXUH GHWHUPLQH WKH GHJUHHV RI WKHVH FRUUHODWLRQV DQG
PRUH SURGXFWLYH LQFUHDVHV LWV DYDLODELOLW\ DQG GHSHQGHQFLHV 6SHDUPDQ¶V FRUUHODWLRQ FRHIILFLHQW DQG
JXDUDQWHHV DQ RUJDQL]DWLRQ¶V DFWLYLWLHV WR FRQWLQXH 3RLVVRQ UHJUHVVLRQ VWRFKDVWLF PRGHOOLQJ DUH XVHG
XQLQWHUUXSWHG 7R LPSOHPHQWVXFKDQHIIHFWLYHOLQHRI 6LJQLILFDQW FRUUHODWLRQV DQG GHSHQGHQFLHV DPRQJ
F\EHUGHIHQVH DQ RUJDQL]DWLRQ QRW RQO\ KDV WR FHUWDLQW\SHVRIF\EHUWKUHDWDOHUWVDUHGLVWLQJXLVKHGWKDW
GHWHUPLQH WKH YDOXH RI LWV DVVHWV EXW DOVR WKH FDQ EH XVHG IRU HYHQW FRXQW SUHGLFWLRQV RI VXFK
F\EHUWKUHDW HQYLURQPHQW E\ GHWHUPLQLQJ FRUUHODWLRQV LQFLGHQWV
DQG GHSHQGHQFLHV EHWZHHQ YDULRXV W\SHV RI
F\EHUDWWDFNVDQGPDOZDUH
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
7KURXJK RXU FRQWULEXWLRQ ZH DVSLUH WR HQULFK WKH GDWDVHW FRQVLVWHG RI WKH IROORZLQJ VHOHFWLRQ RI
YDULHW\RIVFLHQWLILFPHWKRGVWKDWKDYHEHHQHPSOR\HG F\EHUWKUHDWDOHUWSURWRFROVGHWHFWHGE\WKH,'6
VRIDUIRUWKHDQDO\VLVRIF\EHUDWWDFNSDWWHUQUHFRJQLWLRQ
LQ FRPSXWHU QHWZRUNV¶ WUDIILF $V ZHOO DV WKH XVH RI
Markov,ARFIMA DQG FIGARCH WLPHVHULHV PRGHOV 7\SHVRIF\EHUWKUHDWDOHUWV
ZHSURSRVHWKHXVHRISUREDELOLVWLFUHOHYDQWWLPHVHULHV Type of alert Description of cyberthreat
PRGHOV OLNH WKH Poisson VWRFKDVWLFPRGHOLQRUGHUWR WORM/TROJAN () 7KLVDOHUWLVHPHUJHGIURPWUDIILF
GHWHUPLQHYDOLGGHSHQGHQFHUHODWLRQVEHWZHHQGLIIHUHQW WKDWLVUHODWHGWRWKHSURSDJDWLRQ
W\SHVRIF\EHUDOHUWV RIYLUXVHVDQGZRUPVDQG
FRQWDPLQDWLRQRIV\VWHPV
2. METHODOLOGY TOR $OHUWWKDWLQGLFDWHVWKDWLOOHJDO
FRPPXQLFDWLRQVDUHWDNLQJSODFH
2.1. Experiment set up: network description and VXFKDVHVSLRQDJHFULPLQDO
FRPPXQLFDWLRQVLOOHJDOILQDQFLDO
data mining approach
WUDQVDFWLRQVHWF
GPLSNMP $OHUWHPHUJHGIURPWUDIILFUHODWHG
7KHDOHUWORJVRIDQLQWUXVLRQGHWHFWLRQV\VWHP ,'6 WROHDNDJHLQIRUPDWLRQPDLQO\
DOUHDG\ GHSOR\HG LQ WKH QHWZRUN RI DQ RUJDQL]DWLRQ H[SORLWLQJYXOQHUDELOLWLHVRI
ZHUHXVHGIRUWKHIRUPDWLRQRIWKHDQDO\VLVGDWDVHW7KLV SURWRFROVVXFKDV6103
,'6LVSODFHGLQWKHHQWU\SRLQWQH[WWRWKHERUGHUURXWHU VOIP 7KLVDOHUWLVUHODWHGWRDWWHPSWVWR
RIWKHQHWZRUNRIWKHRUJDQL]DWLRQ7KHQHWZRUNVHUYHV H[SORLWYXOQHUDELOLWLHVIRULOOHJDO
DERXWXVHUVFDWHJRUL]HGLQFHUWDLQRUJDQL]DWLRQDO XVDJHRI,QWHUQHWWHOHSKRQ\
XQLWV(DFKXQLWVHUYHVDGLIIHUHQWVFLHQWLILFGLVFLSOLQH VHUYHUV
RU VXSSRUW GLYLVLRQ (DFK VXFK XQLW LV SURWHFWHG E\ D SQL 0XOWLSOHDWWDFNVUHODWHGWRWKH
GHGLFDWHGILUHZDOODQG9/$1VHJPHQWDWLRQVRSHUDWHV YXOQHUDELOLWLHVRIGDWDEDVHV
WKHORFDOLQIUDVWUXFWXUHXQGHULWVRZQPDQDJHPHQWDQG GPLRPC $OHUWVUHODWHGWRWKHH[SORLWDWLRQ
RIWKH53&35272&2/HJ
KDVDEVROXWHFRQWURORIWKHILUHZDOODQG873FDEOLQJ
PDOLFLRXVVRIWZDUHLQMHFWLRQ
IPMI $OHUWWKDWVLJQDOVSRVVLEOH
7KH ,'6 RSHUDWLRQ LV DW WKH IURQW RI DOO LQGLYLGXDO H[SORLWDWLRQRIV\VWHPFRQVROHVDW
ILUHZDOOV DQG WKH RQO\ FRPPXQLFDWHG DGGUHVVHV DYHU\ORZOHYHO
FRQFHUQHG WKH H[WHUQDO ,3 RI HDFK ILUHZDOO $OO XVHU MOBILE 0RELOHPDOZDUHDOHUWDERXW
WUDIILFZDV1$7HGRQLQFRPLQJRURXWJRLQJGLUHFWLRQV LQVWDOODWLRQRIVRIWZDUHWRPRELOH
7KHFROODERUDWLQJQHWZRUNRSHUDWLRQFHQWHUSHUVRQQHO VHDUFKWKDWH[SORLWHQGXVHU
KDYHWKHDEVROXWHFOHDUDQFHWRPDQDJHDQGRSHUDWHWKH GHYLFHVLHSKLVKLQJHWF
ERUGHUURXWHUVWKHFHQWUDOO\HQIRUFHGDFFHVVOLVWVDQG CNC &RPPDQGDQGFRQWUROZKLFK
WKHFHQWUDO,'67KH,'6DOHUWGDWDZHUHFROOHFWHGLQD LQGLFDWHVWUDIILFUHODWHGWRWKH
GDWDEDVHRIHYHQWVDQGWKDWGDWDZDVFRPPXQLFDWHGWR PDQDJHPHQWRIERWQHWVWKDWFDUU\
RXWF\EHUDWWDFNVVXFKDV''26
WKH UHVHDUFK DQDO\VW WHDP IROORZLQJ D SULYDF\ LPSDFW
DNS $OHUWDERXWVXVSLFLRXVTXHULHVWR
DVVHVVPHQW DQG DQRQ\PL]DWLRQ SURFHGXUH IURP WKH
WKHGRPDLQVHUYHUVUHODWHGWR
DXWKRUL]HG QHWZRUN DGPLQLVWUDWLRQ SHUVRQQHO $V D LQIRUPDWLRQOHDNDJH
UHVXOW WKH GDWDEDVH RI HYHQWV DQG DOO UHVHDUFK GDWD SPAMHAUS 8QVROLFLWHGHPDLOWUDIILF
SURFHVVHGLQ WKH FRQWH[W RI WKLV SDSHU FRQWDLQ QR SCAN 1HWZRUNDFWLYLW\UHODWHGWRH[WHUQDO
LQIRUPDWLRQ DERXW LQGLYLGXDO ,3 DGGUHVVHV WKDW DWWHPSWVWRUHFRQQDLVVDQFH
FRUUHVSRQG WRXVHU ZRUNVWDWLRQV RU DQ\ RWKHU FRQWHQW WRSRORJLHVQHWZRUNVHUYLFHV
WKDW FRXOG EH XVHG WR GLUHFWO\ RU LQGLUHFWO\ LGHQWLI\ D RSHUDWLQJV\VWHPVLQRUGHUWR
QHWZRUN XVHULH E\ H[FOXVLRQ QDUURZLQJ GRZQ WRD H[SORLWYXOQHUDELOLWLHV
YHU\ VPDOO QXPEHURISRVVLEOHVXEMHFWVRUFRUUHODWLRQ MALWARE $OHUWDERXWWUDQVIRUPHGQRUPDO
DQGFURVVPDWFKLQJ ZLWK RWKHU SXEOLF LQIRUPDWLRQ $ VRIWZDUHZLWKPDOLFLRXVSDUWVLQ
WKRURXJKDQDO\VLVRQWKHSULYDF\DQGOHJDOFKDOOHQJHV RUGHUWRH[SORLWXQDZDUHXVHUV
RIQHWZRUNUHVHDUFKFDQEHIRXQGLQ>@ DDOS &\EHUDWWDFNVUHODWHGWRGHQLDORI
VHUYLFHVXQDEOHWRRSHUDWH
COMPROMISED $OHUWDERXWV\VWHPVWKDWKDYH
7KH,'6V\VWHPXVHGLVWKHSuricata LQWUXGHUGHWHFWLRQ EHHQSHQHWUDWHG
V\VWHP>@EDVHGRQWKHOinkmaster UXOHVHW>@7KH
ORJILOHUHFRUGVRIF\EHUWKUHDWDOHUWVZHUHUHODWHGWRWKH
PRVWIUHTXHQWDQGFRVWOLHVWW\SHVRIF\EHUDWWDFNV2XU
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
PLVV LPSRUWDQW HYHQWV DQG RIIHU OHVV RSSRUWXQLW\ WR 2.4. Results
UHVSRQG
7KH UHVXOWV RI WKH UHJUHVVLRQV DUH VKRZQ LQ WKH
)RUWKLVGHSHQGHQFHDQDO\VLVZHPDGHXVHRID3RLVVRQ IROORZLQJWDEOHV
VWRFKDVWLF PRGHO 7DNLQJ WKH 3RLVVRQ 3UREDELOLW\
'LVWULEXWLRQ)XQFWLRQ 7DEOH'HSHQGHQFHRISQL F\EHUWKUHDWDOHUWRQ VOIP
F\EHUWKUHDWDOHUWSQL = f (VOIP)
Prob(Υ=y) = (e±Ȝ
Ȝyy y=« >@ZKHUH
'HSHQGHQWYDULDEOH64/
Ȝ: GLVWULEXWLRQ SDUDPHWHU RI Poisson Probability 0HWKRG0/40/±3RLVVRQFRXQW
4XDGUDWLFKLOOFOLPELQJ
Distribution Function FRQFHUQLQJ WKH HPHUJHQFH RI
F\EHUWKUHDWDOHUWVLQWKHQHWZRUNWUDIILFIORZDQG 9DULDEOH &RHIILFLHQW 6WG(UURU ]6WDWLVWLF 3URE
&
yREVHUYHGFRXQWVRIHPHUJHQFHRIHDFKF\EHUWKUHDW
DOHUWLQWKHQHWZRUNWUDIILFIORZ 92,3 (
&RQVLGHULQJWKHPHDQQXPEHURIF\EHUWKUHDWDOHUWVRI 92,3 í( ( í
W\SH i KDSSHQLQJ DWKRXU t GHSHQGLQJ OLQHDUO\ RQWKH 92,3 (
QXPEHU RI F\EHUWKUHDW DOHUWV RI DQRWKHU W\SH j DW WKH
VDPHKRXUt DQGRUDWWKHSUHYLRXVKRXUVttDV /5VWDWLVWLF
3URE/5VWDWLVWLF
E(yit|xjt )=Ȝt=ex΄jt*bj >@
7DEOH'HSHQGHQFHRIVOIP F\EHUWKUHDWDOHUWRQSQL
ZHILQDOO\WDNHRXUPRGHOFRQFHUQLQJWKHGHSHQGHQFH F\EHUWKUHDWDOHUWVOIP = f (SQL)
RIWKHSUREDELOLW\WKHPHDQQXPEHURIF\EHUWKUHDWDOHUW
W\SHi HPHUJLQJDWKRXUtRQWKHQXPEHURIF\EHUWKUHDW
'HSHQGHQWYDULDEOH92,3
DOHUWW\SHj DWWKHVDPHKRXUt DQGRUWKHSUHYLRXVWZR
KRXUVtt LQWKHIRUPRI 0HWKRG0/40/±3RLVVRQFRXQW
4XDGUDWLFKLOOFOLPELQJ
Prob(yit=Ȝit)=^>e– e (x΄jt*bj)*(ex΄jt*bj)yit]/yit!} + uit >@
9DULDEOH &RHIILFLHQW 6WG(UURU ]6WDWLVWLF 3URE
$FFRUGLQJ WR >@ µVXFK PRGHOV DUH HVWLPDWHG ZLWK & í í
PD[LPXP OLNHOLKRRG PHWKRGRORJ\ ZLWK WKH
64/ ( (
ORJOLNHOLKRRGIXQFWLRQEHLQJ
64/ ( (
ln(y,b)=Ȉt=1 n(- ((-ee x΄jt * bj+y
+ it*x΄jt*bj -lnyit !) >@ 64/ ( (
/5VWDWLVWLF
DQGWKHUHOHYDQWOLNHOLKRRGHTXDWLRQVEHLQJ 3URE/5VWDWLVWLF
șln(y,b)/șbj=Σt=1n(yit-ex΄jt bj)*xjt=0 >@ 7DEOH'HSHQGHQFHRISCAN F\EHUWKUHDWDOHUWRQSQL
F\EHUWKUHDWDOHUWSCAN = f (SQL)
IRUPDWWLQJWKHIROORZLQJ+HVVLDQPDWUL[
'HSHQGHQWYDULDEOH6&$1
ș2ln(y,b)/șbj*șbj΄=-Ȉt=1n(ex΄jt*bj*xjt*xjt΄) >@ 0HWKRG0/40/±3RLVVRQFRXQW
4XDGUDWLFKLOOFOLPELQJ
7KH DV\PSWRWLF HVWLPDWRUFRYDULDQFH PDWUL[ LV LQ WKH 9DULDEOH &RHIILFLHQW 6WG(UURU ]6WDWLVWLF 3URE
IRUPRI
&
[Ȉt=1 n(e x΄jt*bj)est*xjt*xjt΄)-1 >@ 64/ ( (
64/ ( (
7HVWLQJ IRU WKH VWDWLVWLFDO VLJQLILFDQFH RI WKH PRGHO¶V
K\SRWKHVHVDERXWWKHHVWLPDWRULQYROYHVXVHRIWKH/5 64/ ( (
VWDWLVWLFLQWKHIRUPRI /5VWDWLVWLF
3URE/5VWDWLVWLF
LR=2*Ȉt=1n[ln(Piest/Piestrestricted)] >@
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
7DEOH'HSHQGHQFHRISQL F\EHUWKUHDWDOHUWRQSCAN
F\EHUWKUHDWDOHUWSQL = f (SCAN) 7DEOH'HSHQGHQFHRICOMPROMISED F\EHUWKUHDWDOHUW
RQSCAN F\EHUWKUHDWDOHUWCOMPROMISED = f (SCAN)
'HSHQGHQWYDULDEOH64/
0HWKRG0/40/±3RLVVRQFRXQW 'HSHQGHQWYDULDEOH&203520,6('
4XDGUDWLFKLOOFOLPELQJ 0HWKRG0/40/±3RLVVRQFRXQW
9DULDEOH &RHIILFLHQW 6WG(UURU ]6WDWLVWLF 3URE 4XDGUDWLFKLOOFOLPELQJ
9DULDEOH &RHIILFLHQW 6WG(UURU ]6WDWLVWLF 3URE
& (
&
6&$1 ( (
6&$1 ( (
6&$1 í( ( í
6&$1 ( (
6&$1 ( (
6&$1 ( (
/5VWDWLVWLF
3URE/5VWDWLVWLF /5VWDWLVWLF
3URE/5VWDWLVWLF
7DEOH'HSHQGHQFHRICOMPROMISED F\EHUWKUHDWDOHUW
RQSQL F\EHUWKUHDWDOHUW 7DEOH'HSHQGHQFHRISCAN F\EHUWKUHDWDOHUWRQ
COMPROMISED = f (SQL) COMPROMISED F\EHUWKUHDWDOHUW
SCAN= f (COMPROMISED)
'HSHQGHQWYDULDEOH&203520,6('
0HWKRG0/40/±3RLVVRQFRXQW 'HSHQGHQWYDULDEOH6&$1
4XDGUDWLFKLOOFOLPELQJ 0HWKRG0/40/±3RLVVRQFRXQW
9DULDEOH &RHIILFLHQW 6WG(UURU ]6WDWLVWLF 3URE 4XDGUDWLFKLOOFOLPELQJ
& 9DULDEOH &RHIILFLHQW 6WG(UURU ]6WDWLVWLF 3URE
64/ ( ( &
&20352
64/ ( (
0,6(' í ( í
64/ ( ( &20352
0,6(' (
/5VWDWLVWLF &20352
3URE/5VWDWLVWLF 0,6(' í ( í
/5VWDWLVWLF
7DEOH'HSHQGHQFHRISQL F\EHUWKUHDWDOHUWRQ 3URE/5VWDWLVWLF
COMPROMISED F\EHUWKUHDWDOHUW
SQL f (COMPROMISED)
7KHHVWLPDWHGFRHIILFLHQWVE\WKH3RLVVRQUHJUHVVLRQV
Prob(yit=λit)={[(e)– e (x΄jt*bj)*(ex΄jt*bj)yit]/yit!} + uit >@LQ
'HSHQGHQWYDULDEOH64/
WKHDERYHWDEOHVJLYHWKHH[DFWIRUPRIWKHGHSHQGHQFH
0HWKRG0/40/±3RLVVRQFRXQW RIWKHHPHUJHQFHRIWKHPHDQQXPEHURIRQHW\SHRI
4XDGUDWLFKLOOFOLPELQJ
F\EHUWKUHDW DOHUW i DW DQ KRXU t RQ WKH HPHUJHQFH RI
9DULDEOH &RHIILFLHQW 6WG(UURU]6WDWLVWLF 3URE DQRWKHUKLJKO\FRUUHODWHG!F\EHUWKUHDWDOHUWj DW
& WKHVDPHKRXUWDQGWKHSUHYLRXVKRXUVt, t7KH\
&20352 DOVR SURYLGH IRU WKH FDOFXODWLRQ RI WKH UHOHYDQW
0,6(' ( SUREDELOLWLHVWKURXJKE(yit|xjt )=λt=ex΄jt*bj >@
&20352
0,6(' í ( í 7KH/5VWDWLVWLFRIWKHUHOHYDQWHUURUSUREDELOLWLHV
&20352 LR=2*Σt= 1n [ln(Piest/Piestrestricted)] >@ GHQRWHV WKH
0,6(' í( ( í
VWDWLVWLFDOVLJQLILFDQFHRIWKHPRGHO¶VK\SRWKHVHVDERXW
/5VWDWLVWLF WKHHVWLPDWRUV
3URE/5VWDWLVWLF
3. CONCLUSION
,Q WKLV SDSHU ZH DSSOLHG PDWKHPDWLFDO PHWKRGV WR
KLJKOLJKWSRVVLEOHUHODWLRQVKLSVEHWZHHQGLIIHUHQWW\SHV
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
Index of authors
B L
%DLQEULGJH6FRWW /H/RQJ%DR
%RJDOH7DGLOR(QGHVKDZ /LDQJ6KXDQJ
%RWKRV-RKQ0$ /LDQJ:HL
/LX;LDRRX
/XR+RQJ
C
&RURYHVLV<DQQLV
M
0LNDHLO$KPHG0RKDPPHG
D
0OOHU.ODXV5REHUW
'LJQXP9LUJLQLD
F O
)XUXWDQL0DVDQRUL 2ODZR\LQ/XNPDQ$
)DUXN1DVLU 2OR\HGH$EGXONDULP
2WDQL7RPR\XNL
G
*XLEDR;X P
*XSWD$EKLVKHN 3DODQLVZDPL0DULPXWKX
3DSDGRSRXORX(LULQL
3HQJ-LQ]KDQJ
H
3RSRROD6HJXQ
+DQ6RQJ
+H%DRKRQJ
R
5DPDPRRUWK\$QDQG
J
5DR$UDYLQGD6
-LDOLQJ/LX
K S
6DOPDQ0XKDPPHG
.LPXUD7DWVX\D
6DPHN:RMFLHFK
.XPDU$PEXM
6KDQ<L
.\ULD]DQRV'LPLWULV0
6WDQF]DN6ODZRPLU
6XQ0LQJMXQ
6XUDMXGHHQ%DNLQGH1D]PDW7
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
,78-2851$/,&7'LVFRYHULHV9RO0DUFK
T Y
7KDQRV.RQVWDQWLQRV*HRUJLRV <DPSROVNL\5RPDQ
7KRPRSRXORV6WHOLRV&$ <DQJ0LQJFKXDQ
7RXEH+LGHNL <DR6RQJ
<XER0X
V
9DUGRXOLDV*HRUJH Z
=DORQLV$QGUHDV
=KDQJ%RXKDQ
W
:DQJ<X
:DQJ<XQDWR
:DQJ;LDQELQ
:LHJDQG7KRPDV
,QWHUQDWLRQDO7HOHFRPPXQLFDWLRQ8QLRQ
International
Telecommunication
Union
Telecommunication
Standardization Bureau (TSB)
Place des Nations
CH-1211 Geneva 20
Switzerland
ISSN 2616-8375
Published in Switzerland
Geneva, 2018