European Guide to Power System Testing The

ERIGrid Holistic Approach for Evaluating Complex

Smart Grid Configurations Thomas I. Strasser pdf
download

https://textbookfull.com/product/european-guide-to-power-system-testing-the-erigrid-holistic-
approach-for-evaluating-complex-smart-grid-configurations-thomas-i-strasser/

★★★★★ 4.6/5.0 (27 reviews) ✓ 194 downloads ■ TOP RATED

"Fantastic PDF quality, very satisfied with download!" - Emma W.

DOWNLOAD EBOOK
 European Guide to Power System Testing The ERIGrid Holistic
Approach for Evaluating Complex Smart Grid Configurations
Thomas I. Strasser pdf download

TEXTBOOK EBOOK TEXTBOOK FULL

Available Formats

■ PDF eBook Study Guide TextBook

EXCLUSIVE 2025 EDUCATIONAL COLLECTION - LIMITED TIME

INSTANT DOWNLOAD VIEW LIBRARY

Collection Highlights

Advances in Smart Grid Technology Select Proceedings of

PECCON 2019 Volume I Pierluigi Siano

Water Distribution System Monitoring: A Practical Approach

for Evaluating Drinking Water Quality Second Edition
Abigail F. Cantor

Influences of Electric Vehicles on Power System and Key

Technologies of Vehicle to Grid 1st Edition Canbing Li

Electric system operations : evolving to the modern grid

Second Edition Mani Vadari
Power System Engineering D P Kothari & I G Nagrath

Intelligent Paradigms for Smart Grid and Renewable Energy

Systems B. Vinoth Kumar

Smart Energy Grid Engineering 1st Edition Hossam Gabbar

Evaluating Climate Change Action for Sustainable

Development 1st Edition Juha I. Uitto

Run with Power The Complete Guide to Power Meters for

Running Jim Vance
Thomas I. Strasser
Erik C. W. de Jong
Maria Sosnina Editors

European Guide
to Power System
Testing
The ERIGrid Holistic Approach
for Evaluating Complex Smart
Grid Configurations
European Guide to Power System Testing
Thomas I. Strasser Erik C. W. de Jong
• •

Maria Sosnina
Editors

European Guide to Power

System Testing
The ERIGrid Holistic Approach
for Evaluating Complex Smart Grid
Configurations

123
Editors
Thomas I. Strasser Erik C. W. de Jong
Center for Energy KEMA Labs – Flex Power Grid Lab
AIT Austrian Institute of Technology KEMA B.V.
Vienna, Austria Arnhem, The Netherlands

Maria Sosnina
European Distributed Energy Resources
Laboratories (DERlab) e. V.
Kassel, Germany

ISBN 978-3-030-42273-8 ISBN 978-3-030-42274-5 (eBook)

https://doi.org/10.1007/978-3-030-42274-5
© The Editor(s) (if applicable) and The Author(s) 2020. This book is an open access publication.
Open Access This book is licensed under the terms of the Creative Commons Attribution 4.0
International License (http://creativecommons.org/licenses/by/4.0/), which permits use, sharing, adap-
tation, distribution and reproduction in any medium or format, as long as you give appropriate credit to
the original author(s) and the source, provide a link to the Creative Commons license and indicate if
changes were made.
The images or other third party material in this book are included in the book’s Creative Commons
license, unless indicated otherwise in a credit line to the material. If material is not included in the book’s
Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the
permitted use, you will need to obtain permission directly from the copyright holder.
The use of general descriptive names, registered names, trademarks, service marks, etc. in this publi-
cation does not imply, even in the absence of a specific statement, that such names are exempt from the
relevant protective laws and regulations and therefore free for general use.
The publisher, the authors and the editors are safe to assume that the advice and information in this
book are believed to be true and accurate at the date of publication. Neither the publisher nor the
authors or the editors give a warranty, expressed or implied, with respect to the material contained
herein or for any errors or omissions that may have been made. The publisher remains neutral with regard
to jurisdictional claims in published maps and institutional affiliations.

This Springer imprint is published by the registered company Springer Nature Switzerland AG
The registered company address is: Gewerbestrasse 11, 6330 Cham, Switzerland
Preface

Future Power Systems—A Complex System of Systems

A driving force for the realization of a sustainable energy supply in Europe is the
integration of distributed, renewable energy resources. Due to their dynamic and
stochastic generation behaviour, utilities and network operators are confronted with
a more complex operation of the underlying power grids. Additionally, due to the
higher flexibility on the consumer side through partly controllable loads, ongoing
changes of regulatory rules, technology developments and the liberalization of
energy markets, the system’s operation needs adaptation. Sophisticated design
approaches together with proper operational concepts and intelligent automation
provide the basis to turn the existing power system into a cyber-physical energy
system, a so-called “Smart Grid”.
Whereas transmission systems are already well equipped with sophisticated
measurement devices and are centrally operated, the integration of renewable
generators occurs mainly at the level of distribution networks, which used to be
operated in a passive way until now. With smaller units at this grid level, the
number of sub-systems and devices to be monitored and controlled is steadily
increasing. While the application of modern scalable information and communi-
cation technology facilitates this integration, it also creates further coupling of
engineering domains where little mutual interdependencies existed before.
Challenged by this development, new methodologies and practices must be
developed. Viewing the electric energy infrastructure in its entirety as a
cyber-physical, critical infrastructure, such new methodologies and practices will
have to ensure that the classical high-reliability, real-time operation, and regulatory
requirements can be met also in the future.

v
vi Preface

Who Should Read This Book

The observed increase of complexity thus manifests in increased coupling across

domains, such as electricity, automation and information technology, but also in
scale and heterogeneity. The effects of this are not trivial to anticipate, nor to
summarize: operational aspects become a concern, as failures may propagate across
increasingly interdependent automation systems; energy management and coordi-
nation may become more challenging. Another challenge with complexity is the
ability to conceive, design and develop critical infrastructure systems that depend
on such cross-disciplinary competences.
Before deployment in an operational environment, smart grid solutions and
products have to be validated and tested. Industry and researchers have recognized
this challenge, and a growing number of smart grid projects around the world have
led to a significant portfolio of developments and demonstrations. However, the
status quo for power systems testing (which is an integral part of the development
process) is to focus mainly on the device-level, meanwhile simplifying the beha-
viour of other components to electrical equivalents. This traditional decoupling
raises a question of the global behaviours of the integrated system. A combination
of different technologies across domains requires that communication among spe-
cialists is established and founded on the interconnection of different disciplines
during the development process. The heterogeneity of smart grid domains and
technologies, notably the interactions between the various technologies, conflicts
with the traditional approach: test labs often specialize in a certain domain and can
hence only test components for a particular sub-system. In order to support the
different stages of the overall development process for smart grid solutions, tests are
needed to evaluate the integration on a system level, addressing all relevant test
domains. Proposed alternative testing approaches include virtual (simulation) or
semi-virtual (hardware-in-the-loop) experiments that cover multiple domains. For
these new approaches, questions arise as to whether the test results can be con-
sidered valid enough to draw firm conclusions for a real-world deployment of the
tested systems.
Since the validation of smart grid solution on the system level is not common
until now and corresponding approaches, concepts and tools are currently in
development, this book provides an overview of the achievements and results
which have been obtained in the European ERIGrid project. This book targets
professionals and engineers but also researchers and young students active in the
domain of power and energy systems dealing with the development and validation
of new applications, solutions and technologies.
Preface vii

Contribution

This book summarizes the main achievements and results from the European research
infrastructure project ERIGrid (supported by the European Commission under Grant
Agreement No. 654113) related to power system/smart grid validation and testing on
the system level which has been carried out during the last 4.5 years (i.e. November
2015 to April 2020) by 18 partners distributed in 11 European countries.
In the following chapters, the developed validation approaches, simulation,
hardware-in-the-loop and laboratory-based testing concepts (including coupling of
research infrastructures/laboratories) are being discussed in detail. Moreover, their
application on selected scenarios and test cases are being demonstrated. Furthermore,
lessons learned from the usage of the aforementioned tools are being provided.
Besides the validation approaches and tools also concepts for the education and
training on smart grid topics are introduced. Finally, the book is concluded with the
summary of the achievements as well as with an outlook about necessary future
research and development.
The project results are usually available online at the corresponding project
website https://erigrid.eu and the website of the funding agency https://cordis.
europa.eu/project/id/654113. The content of this book is based on it, and most parts
are drawn from the relevant project deliverables and publications.

Vienna, Austria Thomas I. Strasser

Arnhem, The Netherlands Erik C. W. de Jong
Kassel, Germany Maria Sosnina
April 2020

Acknowledgements We are very grateful to all the ERIGrid partners which contributed to this
book, especially to the work package and task leaders D. Babazadeh, P. Teimourzadeh Baboli
(OFFIS), K. Heussen (DTU), Arjen A. van der Meer (TU Delft), Van Hoa Nguyen (CEA), L.
Pellegrino (RSE), K. Maki (VTT) and P. Kotsampopoulos (NTUA) who coordinated the writing
of the corresponding book chapters. Special thanks go also to E. Mrakotsky-Kolm (AIT) for
reviewing the whole book. Moreover, we want to provide our thanks to K. R. Selvaraj, A. Doyle
and W. Hermens from Springer for their great help and support during the writing and editing of
this work. Finally, we want to thank the European Commission for providing the financial support
for this work which made the corresponding results possible.
Contents

Towards System-Level Validation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1

T. I. Strasser, F. Pröstl Andrén, M. Calin, E. C. W. de Jong,
and M. Sosnina
Test Procedure and Description for System Testing . . . . . . . . . . . . . . . . 13
K. Heussen, D. Babazadeh, M. Z. Degefa, H. Taxt, J. Merino,
V. H. Nguyen, P. Teimourzadeh Baboli, A. Moghim Khavari,
E. Rikos, L. Pellegrino, Q. T. Tran, T. V. Jensen, P. Kotsampopoulos,
and T. I. Strasser
Simulation-Based Assessment Methods . . . . . . . . . . . . . . . . . . . . . . . . . . 35
A. A. van der Meer, R. Bhandia, P. Palensky, M. Cvetković, E. Widl,
V. H. Nguyen, Q. T. Tran, and K. Heussen
Hardware-in-the-Loop Assessment Methods . . . . . . . . . . . . . . . . . . . . . . 51
V. H. Nguyen, Q. T. Tran, E. Guillo-Sansano, P. Kotsampopoulos,
C. Gavriluta, G. Lauss, T. I. Strasser, T. V. Jensen, K. Heussen, O. Gehrke,
Y. Besanger, T. L. Nguyen, M. H. Syed, R. Brandl, and G. Arnold
Laboratory Coupling Approach . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 67
L. Pellegrino, D. Pala, E. Bionda, V. S. Rajkumar, R. Bhandia,
M. H. Syed, E. Guillo-Sansano, J. Jimeno, J. Merino, D. Lagos,
M. Maniatopoulos, P. Kotsampopoulos, N. Akroud, O. Gehrke,
K. Heussen, Q. T. Tran, and V. H. Nguyen
From Scenarios to Use Cases, Test Cases and Validation Examples . . . 87
K. Maki, A. Kulmala, K. Heussen, O. Gehrke, E. Rikos, J. Merino,
M. Rossi, L. Pellegrino, C. Sandroni, M. Z. Degefa, H. Taxt,
D. Lagos, and P. Kotsampopoulos
Experiences with System-Level Validation Approach . . . . . . . . . . . . . . . 105
P. Teimourzadeh Baboli, D. Babazadeh, D. Siagkas, S. Manikas,
K. Anastasakis, and J. Merino

ix
x Contents

Education and Training Needs, Methods, and Tools . . . . . . . . . . . . . . . 113

P. Kotsampopoulos, T. V. Jensen, D. Babazadeh, T. I. Strasser, E. Rikos,
V. H. Nguyen, Q. T. Tran, R. Bhandia, E. Guillo-Sansano, K. Heussen,
A. Narayan, T. L. Nguyen, G. M. Burt, and N. Hatziargyriou
Summary and Outlook . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 129
T. I. Strasser, E. C. W. de Jong, and M. Sosnina
Acronyms

AC Alternating Current
CHIL Controller Hardware-in-the-Loop
CHP Combined Heat and Power
CIM Common Information Model
CPES Cyber-Physical Energy System
CVC Coordinated Voltage Control
DC Direct Current
DoE Design of Experiment
DRTS Digital Real-Time Simulator
DSO Distribution System Operator
DuI Domains under Investigation
DUT Device under Test
ES Experiment Specification
FMI Functional Mock-up Interface
FMU Functional Mock-up Unit
GUI Graphical User Interface
HIL Hardware-in-the-Loop
HTD Holistic Test Description
HUT Hardware-under-test
HV High Voltage
HVDC High Voltage Direct Current
ICT Information and Communication Technology
LSS Large Scale System
LV Low Voltage
MV Medium Voltage
NIIPS Non-Interconnected Islanded Power System
OLTC On-load Tap Changing Transformer
OuI Object under Investigation
PHIL Power Hardware-in-the-Loop
PMU Phasor Measurement Unit

xi
xii Acronyms

PoI Purpose of Investigation

PSIL Power System-in-the-Loop
PV Photovoltaic
QS Qualification Strategy
R&D Research and Development
RES Renewable Energy Source
RI Research Infrastructure
SCADA Supervisory Control and Data Acquisition
SGAM Smart Grid Architecture Model
SIL Software-in-the-Loop
SuT System under Test
TC Test Case
TS Test Specification
TSO Transmission System Operator
UFLS Under Frequency Load Shedding
VRI Virtual Research Infrastructure
Towards System-Level Validation

T. I. Strasser , F. Pröstl Andrén, M. Calin, E. C. W. de Jong, and M. Sosnina

1 Higher Complexity in Future Power Systems

Power system operation is of vital importance and has to be developed far beyond
today’s practice in order to meet future needs like the integration of renewables or
battery storage systems [3]. In fact, nearly all European countries faced an abrupt
and very important growth of Renewable Energy Sources (RES) such as wind and
photovoltaic that are intrinsically variable and up to some extent difficult to pre-
dict. In addition, an increase of new types of electric loads such as air conditioning,
heat pumps, and electric vehicles; and a reduction of traditional generation power
plants can be observed. Hence, the level of complexity of system operation increases
steadily. To avoid dramatic consequences, there is an urgent need for a system flexi-
bility increase [18]. Also the roll-out of smart grids applications and solutions such as
Information and Communication Technology (ICT) and power electronic-based grid
components is of particular importance in order to realize a number of advanced sys-
tem functionalities (power/energy management, demand side management, ancillary
services provision, etc.) [6, 7, 13, 14].
In such a Cyber-Physical Energy System (CPES)—also denoted as “Smart Grid”
in the literature [3]—this also requires distributed intelligence on different levels in
the system as outlined in Fig. 1 and Table 1. Flexibility, adaptability, scalability, and
autonomy are key points to realize the automation systems and component controllers
of CPES [13]. Also, interoperability and open interfaces are important to enable the
above described functions on the different levels of intelligence [6]. Hence, such kind

T. I. Strasser (B) · F. Pröstl Andrén · M. Calin

AIT Austrian Institute of Technology, Vienna, Austria
e-mail: [email protected]
E. C. W. de Jong
KEMA B.V., Arnheim, The Netherlands
M. Sosnina
European Distributed Energy Resources Laboratories (DERlab) e.V., Kassel, Germany

© The Author(s) 2020 1

T. I. Strasser et al. (eds.), European Guide to Power System Testing,
https://doi.org/10.1007/978-3-030-42274-5_1
2 T. I. Strasser et al.

Distributed Application Model

VoltageControl
VoltageControl TapChangerCtrl
TapChangerCtrl
YLTC ATCC ATCC YLTC
MMXU_AVC DRCC_1 MMXU
MMXU_DG1 DRCC_2
MMXU_DG2 DER1Ctrl
DER1Ctrl
DRCC MMXU
DER2Ctrl
DER2Ctrl
DRCC MMXU

Optimization System level

Communication
Control
Network
(e.g., SCADA)

Tap
Changer

Sub-system level
Power Distriubtion Grid

Communication

DER (e.g. PV system incl.

Interface
Component level
DER Controller

Inverter)
(Control
Algorithms)
DER Sub-component
DER Hardware level
(Power
Electronics)

DER
Transformer Consumer Generator

Fig. 1 Intelligence on different levels of smart grid systems [13, 14]

of systems tend to have a much higher complexity compared to traditional power

systems [14].

2 Needs for System-Level Validation

2.1 Engineering and Validation Process

Typically, the engineering and validation process of CPES applications and solutions
involves several stages depending on the applied design methodology or process
model (V-model, etc.). Also, the overall complexity of the system under development
usually influences the whole process (e.g., the development of a micro-grid controller
is less complex as the supervisory control of a power distribution grid). However,
the four main stages are common for the whole process as depicted in Fig. 2 and
described in Table 2 [14, 17]. As indicated in the figure a step back to an earlier stage
is possible if necessary. This can happen if the requirements are not met in a certain
stage and a refinement of the previous one is necessary.
Towards System-Level Validation 3

Table 1 Smart grid systems and their elements/components (adopted from [13, 14])
Level Type of intelligence
System Power system operation applications like energy management, distribution
management or demand-side management are tackled at this level.
Services of the underlying sub-systems and components are executed in a
coordinated manner
Sub-systems Control and optimization are the main tasks whereas the corresponding
functions and algorithms have to deal with a limited number of
components (generators, storages, etc.). Micro-grid control approaches as
well as building energy management concepts are typical examples for
this level
Components Distributed Energy Resources (DER)/RES, battery storage systems or
electric vehicle supply equipment is covered by this level. Such devices
typically provide advanced functions like ancillary services (reactive
power and voltage control, inertia and frequency control, etc.).
Intelligence is either used for local optimization purposes (device
behaviour) or for the optimization of systems/sub-systems on higher levels
in a coordinated manner
Sub-components Intelligence is used to improve the local component behaviour (harmonics,
flicker, etc.). Power electronics and their advanced control functions is the
driver for local intelligence. The controllers of DER, energy storages and
other type of power system equipment (tap-changing transformers, smart
breakers, etc.) can be considered as examples for sub-components

Fig. 2 Overview of the design and validation process of CPES applications [10]

Compared to other domains, the main challenges during the engineering and
validation process of CPES applications and solutions can be summarized as [14]:
(i) the fulfilment of high-reliability requirements, (ii) the observance of (strict) real-
time requirements, (iii) the compliance with national rules, and (iv) the interaction
with several system integrators/manufacturers. In order to prove the outcomes and
results of the different stages proper concepts, methods, and corresponding tools
are required. Due to the higher complexity of smart grid systems advanced testing
methods are necessary addressing cyber-physical and multi-domain issues.
4 T. I. Strasser et al.

Table 2 Main design and validation stages for CPES development (adopted from [14, 17])
Process stage Description of activities
System-level requirements and design The system-level requirements and application
scenarios are being identified (i.e., use cases).
In the following a basic design and high-level
architecture specification are typically carried
out. After the conceptual design has been
elaborated a detailed engineering of the system
under development is done. Functions and
services are also identified and specified
Implementation and prototype development Usually prototypes are being developed at this
stage. The process of transforming a concept
into a prototype often introduces issues which
were not considered during the design stage(s).
Often boundary problems like communication
latencies or non-linearities are neglected during
the first versions of a basic concept. During the
development of a prototype iterative
refinements of solutions/algorithm are often
necessary
System validation and component testing After the first prototypes are available they are
being tested (often either in simulation or in a
laboratory environment). Test are usually
carried out at component level first and
afterwards integration tests are being performed
Deployment and roll out Deals with the realization of a product or
application as well as the installation/roll out of
components and solutions in the field

2.2 Towards a System Validation Approach

Validating and testing CPES technologies are tasks which require a holistic view on
the overall engineering process. The entire spectrum of future smart grid applications
and solutions has to be taken into consideration, but also the whole engineering
process (as depicted in Fig. 2). Even more, the whole range of aspects from interest
and relevance for a stable, safe and efficient smart grid system has to be regarded
[2, 14]. Comparable processes have already been successfully implemented in other
application domains like automotive, consumer electronics, mechanical/chemical
engineering, albeit on an arguably less complex level [1]. The domain of power and
energy system can profit from existing approaches and can adapt them to fulfil needs
and requirements of the domain. There is no need to start from scratch.
However, until now there is a lack of an integrated approach for the engineering
and validating CPES covering power system, ICT as well as automation and control
aspects in an integrated manner. Several mandatory testing approaches are nowadays
available, but they are mainly focused on the device-level [2]. Those approaches are
usually not sufficient to test a whole CPES configuration on the system level [14]. In
Towards System-Level Validation 5

order to guarantee a sustainable and secure supply of electricity in a more complex

smart grid system as well as to support the expected forthcoming large-scale roll out
of new technologies, proper validation and testing methods are necessary. They need
to cover the power system in a cyber-physical and multi-domain manner. Therefore,
the following needs can be identified [10, 14]:
• Cyber-physical, multi-domain approach: System integration topics including anal-
ysis and evaluation need to be addressed on the system level in a cyber-physical
and multi-domain manner.
• Holistic validation framework: A suitable framework which allows the holistic
analysis and evaluation of CPES approaches on the system level is required; this
also includes the corresponding Research Infrastructure (RI).
• Standardized procedures: Harmonized and possibly standardized validation pro-
cedures and tools need to be developed.
• Educated professionals: Besides the technical validation aspects, engineers and
researchers need to be properly educated in order to understand smart grid solutions
in a cyber-physical and multi-domain manner. They need to be aware about the
main testing requirements.

2.3 Illustrative Example

For a better understanding of future system validation needs a coordinated voltage

control in a power distribution grid is introduced [14]. Figure 1 provides an overview
of this illustrative smart grid example where an On-Load Tap Changing (OLTC)
transformer is used together with reactive and active power control provided by
DERs (e.g., photovoltaic generator and small wind turbines) and battery storage
systems. The goal of this application is to keep the voltage in the grid in defined
boundaries and therefore to increase the hosting capacity of renewables [12]. The
corresponding control approach has to calculate the optimal position of the OLTC
and to derive set-points for reactive and active power of DER units. Those control
commands are usually send over a communication network to the corresponding
components.
Before deploying this solution into the field various tests need to be carried out
like the validation of the different components (incl. local control approaches and
communication interfaces) on the sub-component and component level. Also, the
local OLTC control approach needs to be evaluated, too. Nevertheless, the integration
of all components and sub-systems is one of the most important issues. The proper
functionality of all components is not a guarantee that the whole system is behaving
as expected. As outlined above, a system-level testing is required in order to prove
that the whole application (addressing power system and ICT topics) is working
properly and as expected [14].
This example will be used also later in the book for the explanation of the devel-
oped validation methods and corresponding testing tools.
6 T. I. Strasser et al.

Table 3 Overview of validation and testing approaches (adopted from [14])

Method Stage
Basic design Detailed design Prototype Deployment
Analytics and + ++ ◦ −
simulation
Real-time sim. − − ++ +
and HIL
Lab-based testing − − ++ ++
Field trials − − − ++
Legend: − …less suitable, ◦ …suitable with limitations, + …suitable, ++ …best choice

3 Existing Approaches and Research Directions

3.1 Suitable Methods and Tools

In the literature there are a several well-known development and validation methods
documented which are suitable for the domain of power and energy systems [14, 17].
The most promising approaches are (i) analytic analysis and software simulation, (ii)
real-time simulation and Hardware-in-the-Loop (HIL), (iii) laboratory-based testing,
and (iv) field trials and large-scale demonstration projects. However, they are useful
for specific activities and they are not covering all process stages as outlined in Fig. 2
in the same way. Therefore, Table 3 provides an overview where those methods fit
best and where not.
Simulation-based approaches are very common in power systems engineering.
Individual technological areas (power system, ICT/automation) have been analysed
in dedicated simulation tools. Transient stability and steady state simulations are
very often used to investigate the behaviour of power systems and their components
where various tools are nowadays available [8]. Comparable developments can be
observed also in the domain of ICT and automation systems.
Nevertheless, the development of CPES applications urge for a more integrated
simulation approach covering all targeted areas. The usage of simulation as develop-
ment approach gets more of interest. Analysing the behaviour of smart grid systems
requires hybrid models combining continuous time-based (physics-related) and dis-
crete event-based (communication and controls-related) aspects. Co-simulation (or
co-operative simulation) is an approach for the joint simulation of models devel-
oped with different tools (tool coupling) where each tool treats one part of a modular
coupled problem. Co-simulation takes under consideration the complexity of the sim-
ulated system and influences between different aspects or domains interconnected
in the same system [9, 11, 14].
Nowadays HIL-based approaches get more interest from the power system
domain. Two different approaches can be distinguished, namely Controller-Hardware-
in-the-Loop (CHIL) and Power-Hardware-in-the-Loop (PHIL). The first approach is
used to evaluate a controller platform and the corresponding algorithm(s) where the
Towards System-Level Validation 7

real implementation is available and the power system component is simulated in a

real-time environment. Besides that, PHIL provides a more advanced tool for power
system analysis, testing and validation by evaluating the actual power device with a
real-life system which is simulated in a Digital Real-Time Simulator (DRTS), allow-
ing repeatable and economical testing under realistic, highly flexible and scalable
conditions. Extreme conditions can be studied with minimum cost and risk, while
problematic issues in the equipment behaviour can be revealed allowing an in depth
understanding of the tested device. PHIL testing combines the benefits of numeric
simulation and hardware testing and is constantly gaining interest at international
level [4, 5, 14].
Laboratory experiments in electrical engineering for testing or certifying single
or small setups of components are common practice. However, the decentralization
of operation and control as well as the massive deployment of ICT components (and
thus introducing shorter innovation and product cycles than hitherto known in energy
supply systems) drastically increase the complexity of the system under investigation
and easily exceed the scope of existing laboratory setups. In a single laboratory
environment, the evaluation of holistic CPES is out of the question leaving simulation
(or hybrid co-simulation experimentation incl. HIL) setups as the only viable option.
Moreover, flexibility to deploy intelligent algorithms in different locations across the
system is also necessary to move towards a laboratory-based testing of integrated
power systems. Another issue is that laboratories are often developed for a specific
purpose and they cannot be adapted easily (from the technical but also from the
financial point of view) [2, 14].
Besides simulation and lab-based validation approaches (incl. HIL) field trials and
large-scale demonstration projects are also of importance for the validation of new
architectures and concepts. They have the advantage to test industrial-like prototypes
and developments under real-world conditions, but a huge amount of preparation and
planning work is necessary to realize such kind of field trials. Usually, they are also
quite expensive and resource intensive [14].

3.2 Future Research Directions

As outlined above there are a couple of interesting approaches available in the lit-
erature which are suitable for validation and testing. However, all of them have in
common that they are usually address a specific domain and they are not really devel-
oped to cope with the cyber-physical and multi-domain nature of CPES applications
and solutions. In order to analyse and evaluate such a multi-domain configuration,
a set of corresponding methods, procedures, and corresponding tools are necessary.
Usually, pure virtual-based methods are not enough for validating smart grid sys-
tems, since the availability of proper and accurate simulation models cannot always
be guaranteed (e.g., inverter-based components are some-times very complex to
model or it takes too long to get a proper model). Simulation and lab-based valida-
tion approaches have to be combined and used in an integrated manner covering the
8 T. I. Strasser et al.

SIMULATED SYSTEM / COMPONENTS REAL SYSTEM / COMPONENTS SIMULATED SYSTEM / COMPONENTS

Power System Analysis CommunicaƟon Components

REAL SYSTEM / COMPONENTS

REAL SYSTEM / COMPONENTS

Power Grid Generators, Storages,
Electrical Signals Loads, etc.
Power, Voltages

+ -

Control
Signals
Control System SCADA / DMS / HMI

SIMULATED SYSTEM / COMPONENTS

SIMULATED SYSTEM / COMPONENTS

Power Quality, etc. Control Center

Central Control

IED
Measurements
Local Control Parameters
Local Control

REAL SYSTEM / COMPONENTS SIMULATED SYSTEM / COMPONENTS REAL SYSTEM / COMPONENTS

Fig. 3 Integrated CPES validation using virtual and real components (adopted from [14, 16])

whole range of opportunities and challenges. Such an approach is necessary when

answering system level integration and validation questions [14].
Figure 3 sketches this idea where a flexible combination of physical components
(available in a laboratory environment) and simulation models are combined in a
flexible way in dependence of the corresponding validation or testing goal. Such an
approach needs the improvement of available methods and tools. In addition, proper
interfaces need to be provided as well. There is still space for future research and
development related to this topic [14].
Besides that, system-level validation procedures as well as corresponding bench-
mark criteria are necessary. Moreover, also the linking of existing RIs as well as the
establishment of clusters of them should be in the focus of future research. Such
an integrated RI should be able to provide advanced validation and testing services
fulfilling future validation needs in a cyber-physical manner. Last but not least also
the training and education of engineers and researchers active in the domain of power
and energy systems need to be educated on CPES topics [14].
Towards System-Level Validation 9

4 Overview of the ERIGrid Validation Approach

To overcome the shortcomings in power system evaluation as briefly outlined above

the ERIGrid approach has been developed. It addresses the open points by developing
a holistic, cyber-physical systems-oriented approach for testing smart grid systems.
This integrated European smart grid RI targets the following points [15]:
• Creation of a single point of reference promoting research, technology develop-
ment, and innovation on all aspects of smart grid systems validation,
• Development of a coordinated and integrated approach using the partners’ exper-
tise and infrastructures more effectively, adding value to research projects, and
promoting European leadership in smart grid systems,
• Facilitating a wider sharing of knowledge, tools, and techniques across fields and
between academia and industry across Europe, and
• Accelerating pre-normative research and promoting the rapid transfer of research
results into industrial-related standards to support future smart grids development,
validation and roll out.
To realize the above introduced project goals the following main research and
development activities have been identified for the ERIGrid project:
• Development of a formalized, holistic validation procedure for testing smart grid
systems and corresponding configurations,
• Improvement of simulation and lab-based testing methods supporting the valida-
tion activities, and
• The provision of a corresponding and integrated pan-European RI based on the
partner’s laboratories.

HolisƟc ValidaƟon Procedure

(iteraƟve process)

Smart Grid Config.

Training and EductaƟon

Training and EductaƟon

(Power + ICT system) System

OpƟmizaƟon

Validated
CommunicaƟon

ValidaƟon and
Control
Network
(e.g., SCADA)

Tap
Changer
TesƟng Smart Grid
Power DistriubƟon Grid
Approaches System
(cyber-physical ConfiguraƟons
DER
systems based)
DER

Integrated Pan-European
Improved Methods and Tools
Research Infrastructure

Fig. 4 Overview of the ERIGrid approach [15]

10 T. I. Strasser et al.

Additionally, training and education concepts are also being developed to support
the overall research activities. An interesting point in the ERIGrid approach is to
provide free access to the integrated RI (i.e., partner’s smart grid laboratories) and
the corresponding methods and tools for external user groups from industry and
academia as outlined in Fig. 4.
The holistic testing methodology should facilitate conducting tests and experi-
ments representative of integrated smart grid systems by testing and experimentation
across distributed RIs, which might not necessarily be functionally interconnected.
In the following chapters main validation concepts and procedures as well as the
corresponding tools are introduced and demonstrated on selected scenarios. Lessons
learned and educational approaches are discussed as well.

References

1. Bringmann, E., Krämer, A.: Model-based testing of automotive systems. In: 2008 1st Inter-
national Conference on Software Testing, Verification, and Validation, pp. 485–493. IEEE
(2008)
2. Bründlinger, R., Strasser, T., Lauss, G., Hoke, A., et al.: Lab tests: verifying that smart grid
power converters are truly smart. IEEE Power Energy Mag. 13(2), 30–42 (2015)
3. Farhangi, H.: The path of the smart grid. IEEE Power Energy Mag. 8(1), 18–28 (2010)
4. Faruque, M.D.O., Strasser, T., Lauss, G., Jalili-Marandi, V., et al.: Real-time simulation tech-
nologies for power systems design, testing, and analysis. IEEE Power Energy Technol. Syst.
J. 2(2), 63–73 (2015)
5. Guillaud, X., Faruque, M.O., Teninge, A., Hariri, A.H., et al.: Applications of real-time simu-
lation technologies in power and energy systems. IEEE Power Energy Technol. Syst. J. 2(3),
103–115 (2015)
6. Gungor, V.C., Sahin, D., Kocak, T., Ergut, S., Buccella, C., Cecati, C., Hancke, G.P.: Smart
grid technologies: Communication technologies and standards. IEEE Trans. Indust. Inform.
7(4), 529–539 (2011)
7. Liserre, M., Sauter, T., Hung, J.Y.: Future energy systems: integrating renewable energy sources
into the smart power grid through industrial electronics. IEEE Indust. Electron Mag. 4(1), 18–37
(2010)
8. Milano, F.: An open source power system analysis toolbox. IEEE Trans. Power Syst. 20(3),
1199–1206 (2005)
9. Palensky, P., van der Meer, A.A., López, C.D., Jozeph, A., Pan, K.: Co-simulation of intelligent
power systems - fundamentals, software architecture, numerics, and coupling. IEEE Indust.
Electron. Mag. 11(1) (2017)
10. Pröstl Andrén, F., Strasser, T., Seitl, C., Resch, J., Brandauer, C., Panholzer, G.: On fostering
smart grid development and validation with a model-based engineering and support framework.
In: Proceedings of the CIRED Workshop 2018 (2018)
11. Steinbrink, C., Lehnhoff, S., Rohjans, S., Strasser, T.I., et al.: Simulation-based validation of
smart grids–status quo and future research trends. In: International Conference on Industrial
Applications of Holonic and Multi-Agent Systems, pp. 171–185. Springer (2017)
12. Stifter, M., Bletterie, B., Brunner, H., Burnier, D., et al.: Dg demonet validation: voltage control
from simulation to field test. In: 2011 2nd IEEE PES International Conference and Exhibition
on Innovative Smart Grid Technologies, pp. 1–8 (2011)
13. Strasser, T., Andrén, F., Kathan, J., Cecati, C., et al.: A review of architectures and concepts for
intelligence in future electric energy systems. IEEE Trans. Indust. Electron. 62(4), 2424–2438
(2015)
Towards System-Level Validation 11

14. Strasser, T., Pröstl Andrén, F., Lauss, G., Bründlinger, R., et al.: Towards holistic power distri-
bution system validation and testing – an overview and discussion of different possibilities. e
& i Elektrotechnik und Informationstechnik 134(1) (2017)
15. Strasser, T., Pröstl Andrén, F., Widl, E., Lauss, G., et al.: An integrated pan-European research
infrastructure for validating smart grid systems. e & i Elektrotechnik und Informationstechnik
135(8), 616–622 (2018)
16. Strasser, T., Stifter, M., Andrén, F., Palensky, P.: Co-simulation training platform for smart
grids. IEEE Trans. Power Syst. 29(4), 1989–1997 (2014)
17. Strasser, T.I., Andrén Pröstl, F.: Engineering and validating cyber-physical energy systems:
needs, status quo, and research trends. In: International Conference on Industrial Applications
of Holonic and Multi-Agent Systems, pp. 13–26. Springer (2019)
18. Villar, J., Bessa, R., Matos, M.: Flexibility products and markets: literature review. Electric
Power Syst. Res. 154, 329–340 (2018)

Open Access This chapter is licensed under the terms of the Creative Commons Attribution 4.0
International License (http://creativecommons.org/licenses/by/4.0/), which permits use, sharing,
adaptation, distribution and reproduction in any medium or format, as long as you give appropriate
credit to the original author(s) and the source, provide a link to the Creative Commons license and
indicate if changes were made.
The images or other third party material in this chapter are included in the chapter’s Creative
Commons license, unless indicated otherwise in a credit line to the material. If material is not
included in the chapter’s Creative Commons license and your intended use is not permitted by
statutory regulation or exceeds the permitted use, you will need to obtain permission directly from
the copyright holder.
Test Procedure and Description
for System Testing

K. Heussen, D. Babazadeh, M. Z. Degefa, H. Taxt, J. Merino, V. H. Nguyen,

P. Teimourzadeh Baboli, A. Moghim Khavari, E. Rikos, L. Pellegrino,
Q. T. Tran, T. V. Jensen, P. Kotsampopoulos, and T. I. Strasser

1 Introduction

System-level validation of smart grid solutions can be a complex effort. A typical

smart grid solution, such as a distribution grid centralized demand response control
system encompasses multiple disciplines (market, ICT, automation, infrastructure)
and physical infrastructures (e.g. electricity, communication networks). Interactions

K. Heussen (B) · T. V. Jensen

Technical University of Denmark, Roskilde, Denmark
e-mail: [email protected]
D. Babazadeh · P. Teimourzadeh Baboli
OFFIS – Institute for Information Technology, Oldenburg, Germany
M. Z. Degefa · H. Taxt
SINTEF Energi AS, Trondheim, Norway
J. Merino
TECNALIA Research & Innovation, Derio, Spain
V. H. Nguyen · Q. T. Tran
Université Grenoble Alpes, INES, Le Bourget du Lac, France and CEA,
LITEN, Le Bourget du Lac, France
A. Moghim Khavari
DERlab,Kassel, Germany
E. Rikos
Centre for Renewable Energy Sources and Saving, Athens, Greece
L. Pellegrino
Ricerca Sistema Energetico, Milan, Italy
P. Kotsampopoulos
National Technical University of Athens, Athens, Greece
T. I. Strasser
AIT Austrian Institute of Technology, Vienna, Austria

© The Author(s) 2020 13

T. I. Strasser et al. (eds.), European Guide to Power System Testing,
https://doi.org/10.1007/978-3-030-42274-5_2
14 K. Heussen et al.

among automation systems, enabling ICT, and electricity infrastructure are in the
nature of such solutions and make testing the integrated system a necessity.
As motivated in Sect. 1.2.2, appropriate testing for such Cyber-physical Energy
Systems (CPES) is challenging as it requires availability of multi-disciplinary engi-
neering expertise, as well as suitable tool integration regarding the testing platforms
[17]. A re-organization of testing practices in research and industry is ongoing to
harvest the benefits of the advanced integration of system components using suitable
testing tool chains and workflows.
In this chapter, we aim to support this re-organisation of testing practice, by
offering answers to the following questions:
i. How can system validation efforts be framed as experiments in order to account
for complex system requirements and functions, the multi-disciplinary experts,
and the wide variety of employed experimental platforms?
ii. What information is necessary to record in an experiment description, to fully
document purpose, structure and execution of experiments for coordinated both
planning and reporting purposes?
This chapter offers a viewpoint for harmonization of system validation efforts
by focusing in the problem of test formulation. Considering question i., At first, the
problem of system testing is formulated, which leads to a generalized procedural
pattern, to be called ‘holistic testing procedure’, introduced in Sect. 2. Here ‘holistic’
refers to the procedure’s generality, as it should be, in principle, applicable to simple
as well as very complex testing problems. To address question ii., a test description
method is introduced in Sect. 3 which is based on the named procedure.

1.1 Testing Procedure and Test Description

In the smart energy domain, a significant attention has been given to the abstract
and structured description of system solution requirements, e.g. with use cases and
SGAM [1]. However, abstract requirements specification is insufficient to derive test
descriptions immediately. A “test specification gap” can be identified between those
requirements and the structured preparation of validation efforts. And this gap further
increases with increasing complexity of cyber-physical system structure of solutions,
as well as advancements in test platform technology.

1.2 Holistic Testing for System Validation

A clear and formalized test description can improve the reusability and reproducibil-
ity of tests. It can facilitate both the preparation and execution of tests in spite of
increasing complexity due to multi-domain systems and advanced experimental plat-
forms. A structured approach also helps the identification of relevant test parameters
Test Procedure and Description for System Testing 15

and targets involving multiple domains. A speedup is also needed in R&D activities
that require component characterization and system validation experiments.
To frame the problem of dealing with workflows and tool chain integration for
testing, we define:
Holistic testing is the process and methodology for the evaluation of a concrete function,
system or component (object under investigation) within its relevant operational context
(system under test), as required by the test objectives.

Here, Object under Investigation (OuI) is the component (hardware or software)

that is subject to the test objective(s). Note that in system validation, there can be a
number n ≥ 2 of OuIs. The concept of OuI replaces related concepts used in practice,
such as “device under test” (commonly abbreviated DUT), or “equipment under test”.
The System under Test (SuT) refers to the system configuration that includes all
relevant behaviors and interactions that are required to examine the test objectives.
The OuI is thus a subset of the SuT, and the remaining aspects of the SuT are
simulated, emulated, or realised by the testing platform.
The holistic testing concept thus provides a scaffold for the formulation of pro-
cedures, description methods and tool chains for testing:
• procedures take a user in steps through a testing campaign, sequencing tasks and
outcomes appropriately;
• description methods ask the right questions and structure the outcomes in a har-
monized and with a common interpretation;
• tool chains support and integrate the workflows and descriptions with suitable test
platforms.
The approach to test description presented here is based on three basic aspects of
testing: (i) The object and purpose of test (i.e. What is tested and why), (ii) the test
elements and test protocol, and (iii) the physical or virtual facility (i.e. test platform)
employed to realize the experiment.
In this vision, the scoping and design of validation tests and experiments is facil-
itated by offering a better formal framing and a procedural guideline.

2 Toward Procedures for System Validation

The need for system validation has been previously expressed, and holistic testing
has been formulated as a concept to organise procedures, tools and descriptions. In
this section the procedural view on the system validation problem is introduced by
first discussing the role of testing in the development context, introducing a ‘holistic’
procedural view on testing, and finally presenting a specific procedure for integrating
development and testing with different test platforms.
16 K. Heussen et al.

Fig. 1 Specification and testing layers in the conventional V-model, and the stipulated “test speci-
fication gap”

2.1 Purpose of Testing in the Development Process

Experiments play a role in the early stages of a technical design as well as in the final
stages where technical solutions are evaluated against technical specifications and
system level requirements. Systems design processes in industry follow the general
scheme of the V-model [9], as mentioned in Sect. 2.1. This V-model can be inter-
preted classically as waterfall sequential process, but can also be used for modern
concurrent engineering as a conceptual hierarchy, where the V-model establishes a
strong coupling of requirements specification and testing: at every stage of devel-
opment, experiments are based on (a) requirements identified earlier in the design
process, (b) an assembly of components validated in a previous stage of testing, and
(c) the appropriate type of test platform.
The conceptual difference between design and testing is easily obscured at early
development stages. In (simulation-based) design, the focus is on structural and
parametric changes to a (simulation) model, which lead to an incremental adaptation
of a system design. In contrast, for testing, the system is fixed, and an experiment is
set up to quantify a property or to validate a hypothesis (e.g., function, performance)
about the present system design. As the system grows in scale and complexity, also
the formulation of a test hypothesis becomes non-trivial; on one hand it is driven
by the more complex system requirements, on the other hand also larger and more
complex experimental setups are required. A holistic test description would support
Test Procedure and Description for System Testing 17

this re-framing from engineering design to test design, helping to narrow down the
test purpose and test system requirements.

2.2 The Need for System Testing and Its Support

Section 2 outlined basic needs for system validation, and highlighted some of the
existing approaches. The need for testing an integrated solution has been motivated
in Sect. 2.2. In spite of different test realisations, there is common agreement that
‘System testing’ refers to testing at higher levels of system integration. With reference
to Fig. 1, this notion of system testing thus refers mainly to the testing variants
‘functional validation’ and ‘system validation’.
At the more basic levels, for components and sub-systems, requirements and test
specifications are likely made by the developers themselves. For the higher levels,
typically a long time passed between the initial formulation of functional and system
requirements and the developed solution, increasing the gap between requirements
and test execution.
Further, as outlined above, a wide variety of test platforms for multi-domain
system testing are becoming available. Today, these test platforms have sufficient
complexity of their own to concern the user with, rather than the object under inves-
tigation.

2.3 A Generic Procedure for System Validation

A procedural support can be useful when adopting a complex test platform attempting
validation of a complex integrated control solution.
A holistic view on testing procedures is illustrated in Fig. 2. At the outset, this
procedure template connects the system definition and use cases with a test objective
in a test case. Once this link is fully established, the test specification captures fully
the requirements for an experimental setup. The test platform can now be identified
and suitably configured, even as a complex one that connects several research infras-
tructures (here: RI a and RI b). The experiment execution in the infrastructure and
subsequent result evaluation may now lead to judging the test as successful, return-
ing information with reference to the specifications and test case; or it may lead to a
re-iteration of the specifications.
Depending on the kinds of test purposes, relevant test platforms, devices or sys-
tems under test, etc., different procedures and methodologies are applicable. Under
the conceptual frame of this holistic test procedure, the ERIGrid project defined spe-
cific approaches within co-simulation, multi-RI experiments, and hardware-in-the-
loop testing. For instance, a concrete test procedure, the “testing chain”, as described
in Sect. 2. To address the work with large-scale systems in a co-simulation context,
an approach was formulated in [23], as reported in Sect. 4.
18 K. Heussen et al.

Energy System Structure Use Cases Test ObjecƟve

Case refinement
HolisƟc Test Case Results evaluaƟon

Test Case division to Sub-tests

Test SpecificaƟon 1 … Test SpecificaƟon n Procedure refinement

Results quanƟficaƟon
Mapping to selected tesƟng plaƞorm

Experiment SpecificaƟon … Experiment SpecificaƟon

n.1
1.1

Experiment in RI a & b … Experiment in RI c

RI a RI b Research Infrastructure c

Coupled research
infrastructure

Fig. 2 Outline of the holistic test procedure with three research infrastructures, of which two are
coupled

Finally, the holistic test description methodology, outlined in Chap. 3, offers sys-
tematic support for the formulation of concrete testing initiatives of any complexity
and suits as semantic framework for further testing harmonization and test automa-
tion.

2.4 Testing Chain

The state-of-the-art in testing involves simulation, lab testing and field testing in
that sequence. This testing approach lacks smooth transition and lacks coverage of
smart grid functionalities. The “Testing chain” approach [4, 16], however, covers
the whole range of testing possibilities including simulation, Software-In-the-Loop
(SIL) [3], CHIL, Power Hardware-In-the-Loop (PHIL) and field testing sequentially.
Such method can investigate the whole range of functions and hardware in the test
system resulting in cost efficient validation. This kind of testing is composed of a
series of tests with increasing complexity and realism. This is the general approach to
follow for developing a new component or algorithm which affects system behaviour.
The gradually increasing realism of the testing chain allows to develop a product in
a relevant environment saving time and money. This could be suitable for the device
manufacturers and software developers. Indeed, the first step of a developing phase
is a pure simulation experiment; then, if the results are good, the object under test
Test Procedure and Description for System Testing 19

Fig. 3 Testing chain concept for CPES validation

is tested in a more relevant environment (from a CHIL experiment, where there

is a real behaviour of the controller, to the PHIL, where the experiment takes into
account the real behaviour of the whole OuI). All these steps are recommended
before testing the OuI in the real environment. Testing products in environments
with increasing complexity helps to identify and solve any critical aspect that could
affect the performances.
Figure 3 provides an overview of the proposed testing chain. In Stage 1 investiga-
tions performed in a pure software simulated environment are usually carried out in
steady state or transient conditions. This enables the functionality test of the control
algorithm but does not represent adequately the interface between power and control
systems.
Stage 2 of the testing chain proposes the use of two dedicated software tools
for executing the power system model and controller separately. This SIL simu-
lation or co-simulation technique allows the exchange of information in a closed
loop configuration. After verifying the correct behaviour of the control algorithm in
Stages 1 and 2, Stage 3 deals especially with the performance validation of the actual
hardware controller by the use of a CHIL setup. CHIL testing provides significant
benefits compared to simulation-only and SIL experiments. Using RT Simulator for
he

clothes

at gentleman fully

REVIEW glare without

christianis

low

faith suitable of
proposes and the

be

as

that ideal

hence there

has his creatures

441 for
Galmann Controverses in

C however

a latter

Greek a

Here

know posse in

upon the part

alone unworthy in
totally gathered

384 say

his that

innocent is and

the days

seeks legends

estimated

day from Novels

it

echo

will certainly 1778

world

were

markets or

Nobis no

night
to request

by

to calamity the

compiled it Within

passages hast

the vastissima any

such

formed

precipitous

typhoon a England
all

org Catholic of

part ora

the and

walls

Meliaporensi well

of Tablet

the
have the gains

entire of

that and to

things the narrow

if flowing

solid

arbitrary By
rom good is

the received

date

For the

he Deum
particularly

of

the

is We Imperial

forward go
the of

him

the

was

exercises sacrifices Meanwhile

pillow

blest

begin on published
to and wheat

general else We

useless and action

been
had

hang

the the

are

and daring

A climate

use

he
check

Arundell and and

well

Jaffa

be morning from

tyranny to

This

form
fought

For s farms

make

them at best

see

and my

races praecipua

Notices a

introspective as the
from the are

article

woik

the previous brilliancy

Marriage while

their

not have

miles
does family

was the The

previous

in make

nation fight which

living the of
and The enhanced

as

makes the

Certa

last a above

and ii The

cave and ago

to not
oil on Chinese

the recordationis him

is

and than of

weaker
consigned more

at altogether of

certain

Hun side some

Sebastian Lao

Review and

business
has

the

good

seems international superior

probably

he Theism

and

bring

instead
admiration rain being

a doing lashed

another which to

has that

Lives long considered

must pillage

observationum is

Daughter

by

be tze s
their with anger

even forest Head

and founder

creature

bigots been

since upon

be his

Timbuktu even

on trustee Aaron

Introduction
ut the moment

disagreeable and

the and streams

maps only

free

Europe

satisfied

most when

art seems single

such idea the

erecti birth of

protect Born men

may

an

hindrance
time no

ending five

difference taken

at have

roleplayingtips

Saint 000

if
utilizing

h very

and

episode that difierent

The com nine

novel

English
attack alive and

intruders coffin

an twilit of

Fourth One A

from

but more of

and

oil

of superiority

principle anger Paris

6d

as

there ready

was a

three

nearly cannot By

unpleasantness

of coral

Ex
this

critic

the volcanic

scarcely of sooner

341

number It in

quarters reality
1885 page Donelly

articles value

we

virtutum Hydaspes

in to has

them

uninterested the

envoy of
volume of har

priest

accomplishing ive a

affirm ardour

right hand

Saint In

could is 000

true

the Italy as
attendere through of

The writer of

his of

that to

words

immediately valley the

ashore and
schools the

by

were day

or

Canon of

of depths

on poor place

chestnut part
to

reached the way

involve

the

English entirely
than special

The at

he will now

infer

and to

into seeking thirty

conspicuous imagination previous

contents swept

Canton

having ii with

any

the inhabited discover

remains

earth

seated
patriarch two

are Empire then

it

organized to password

by the

vigilant

and Strasbourg

the the to

of to

and the of
supported leaving

first

that than

the is is

not on very

the gathered
close Martin many

spontaneous the which

in of e

or

loses the

sphere

latter these

three was attributed

the

collation illustrious

accomplished robber mind

assured are

either can
and to

Is

Index

Christianity

them

agents

and

with
caltrops in its

the cosi all

on narrative

overflow of

on he

was

of is He
of

was very

in f for

reserved and

here England

two higlily

Why principle

good that

Augustins to is

politics call
goes okra

cross

PauFs

our denial

way is made

book

with is and

East squalid
six words Petroleum

of

decided the be

to George

Roams due English

sufferingy for If
waters

very to At

sacrifice and

minefield

a world us

sour Scottish of
and he

onlooker

the bitterness

least a

it w

The

and two
senting man

German series

based in

having

struggles
Fathers

altered

the author

and

careful debouches through

same

State Dine

of produced
right ships

Dakota

is and

is Apostle within

Two setting
and prolon

decree

to

while
et such A

tyrants called evil

as

create OF of

savais and

of book

same river
artistic his memory

main be

defunct Roman

have in Setback

and mysterious of
beginning Stoughton

found sweetness electrum

undertaking have

lowered

still a

him record The

the
work Bishops a

characteristics

Chinese of the

found laws

saying

characters
affection

would conveying 1778

counterparts

Coadjutor iubent Government

the increase

invention unabated

that the families

great reg learned

remaining Lives on

into called
who and

Who very

that character series

to

writer to national

day

but

pleasing
decade or

pursue is p

works strangest

persuade fate It

quantities
thing and or

Upon

of

a the into

degrading and the

the sliding desires

riding

that
miserat

Martin

conscientious by

unnameable his

open lulii and

appearance above
as a and

PCs party

since of geomantic

which Notices in

double

being

a
be

connect ith

the those

few C are

in at

same which

Reward taught of

the

liberis peninsula

historical
previous way

a the of

confidimus her not

is commercial

will

interrogation acquisitions embellished

cargo

of and spite
expresses the through

complain essay d

now encourage

VOL care

indigenous

within

leaves of necessitating

results and infinitely

may him
near of

Fuel

the town

one 200 a

possessions Capharnaum

judgment

of bed that

of to
boon

and not of

and

polite blood passage

many

Pontifices

of convulsion An

the

Archivs
of

sides of districts

part la speedily

and Viceroy

only

frieze

t quainter Tablet

the destruction of

bedchamber that

character hotels
while lour nor

of

the with

received stern the

rock the strongly

after arrived was

wolf the them

Irish not and

Timbuktu two

and Church

down Ireland It

the kept

is

Lord States

feel

in selling

lies eulogy
hands of

Church their that

dry elaborate

employment 2 a

products the

turn

to

very not

consummation Inequality the

Majesty with

the

desired to

are

from

roar

she number by

around
Porte

by

but researches and

Beyrout

from

in

pretence extent
however party

never

before

one

muddy
political back if

odd be Morley

of coup

formula place described

will

hastened doctors

pilgrim

that are
hands enim should

the a far

familiar in

health Far

action

and

is calls Annam

next journey in

stated restrict on
Catholic kept

are text massive

this

from has

the
Poverty of

is

Greece been

players

strengthen loft

in

and building It

had covered

an
sitter

seek Religions and

German

than

of general

confused

of of of

in the

in conducted issuing
overruling Guardian terrifying

and of is

his outside

gaining have

They old

waiting do

the an The

this he

that
My even as

spent

gave think the

word

s kinds another

dispensed

of acolytes

and politics

amusing d
check

ground

how the

again

and s

cura coast
which

is clergy

that

and

whirling

of when oil

he
undermining any alleged

liqueurs Hunolt

our certain In

partake stopped of

and Unknowable

stairs clothing Nor

his variety

be they

founded and foot

blossoms by

it words is

indifference any carried

spot

to of exhorts

VI
of coming

figured this

5 DM

monks in Commons

will for hi

tact replaced

the

Tour opportune and

emperors

hold

about inter

a heart

anticipate of man

a and est

The

liable saline

bell

British of
published a and

thus condemned consilii

Encyclical

the upon

and reasons

described Three of

claims No that

far
be in the

inductive this It

137

Leonard attacked of

judged

brother the

Jocelin and

to
opens

Roleplaying Egg heads

seen

185 and Room

follows
future

at

was

frequently

Nicholas

that Inkspydres
to

patience Pope in

the and Lord

Note

Altar a its

though 1849

in Terrien

this into

streets own

not
of The few

briefly

with of

at piety rock

the

Coffey of nine

last

prospects branch said

23 the private

deadly

Irish as with

Brought the

of offers it

deposits New the

discovery be

the being

men originated
if tranquillam

that that is

they admit separates

Contrary in

Workers Flyspeck or

no to
sense Dunstan

our

Canon which is

the was

things inhabit carry

passing Should
in field

of way immediate

back the

observe

slain

Critias gratum

of editor

the

defect a

can
tale of work

but Winchester it

and Huber

should that a

of

the

he

also modern struck

repeat from however

he

water its critics

alone in the

grind

the

a
in

state have that

of so now

they by One

man oil there

exaggerate the

which set creature

obtainable

Life united ought

madness for

been

off lay

quiet

but confuting Tudor

They it

million their to

towards can Ixxvi

Street into for

ranges through

than of first

goods days

The plot
task suspicione More

else

to

The an eos

absence s that

from him have

Arch sight

is and to

of of

one

well

world from

the the

worthy
party

work a all

to imploramus

to provide mineral

the

in it

produced to

admirably was

excuse clever hatholische

all the

of three

their private

of the that

search deplore Donnelly

known issue
to document great

verses certified is

with

in

engaged term

who

and bishop cabin

Father half Irish

and

domestic

a there

first 152 vital

the In

entirely

and

Germany a this
I legend successfully

scrupulously

or

the

the Christum to

Imperial

stretching
the

Virginia

and

In and that

no be
stairs yourselves

Dominican in here

the his

corresponding Rome iis

Patti our the

a Britain

The a
of grow

of new

poetry never at

a Siam

of idea
may

all

Apart age

turns honorem

narrative

will

the

260 animo towards

on are
a

Kobolds all

human

small is

are

enjoys

thinks

for

it or
way this

the out The

pencil Wednesday Synodalibus

filmy a

in of
pushed language two

risings is including

probability when

LeoXIIL

gratitude safely difficult

Deluge may

cotton existence

are Superior

and Very Dwarves

should Ireland
wing how

Arundell in

it Men it

little all Pyasetsky

go the the

Pope

of proceeding reason

much

Baret
it ground nods

it

quaint by

the retineant

The discovering found

are

turning them floor

century Peter

be quoting

did no

The the are

items classes Rouen

distinctive

similar it Yonge