Week 12
Week 12
P T
N
Geographic Information Systems
Dr. Bharath Haridas Aithal
Ranbir and Chitra Gupta School of Infrastructure Design and Management
IIT KHARAGPUR
Module 12: Data & Data Standards
Lecture 57: Open Source GIS softwares
E L
Open Source
P T
N
OGC domains
OGC standards
Organization structure
Membership
Collaboration
Open Source
E L
T
Open Source is a iterative development model & promotes free redistribution and
access to an end product's design and implementation details
P
It allows free re-distribution of the software without licensing fees to the deveoper
It requires that source code be distributed with the software or otherwise made available for
N
no more than the cost of distribution
It allows anyone to modify the software or derive other software from it, and to redistribute
the modified software under the same terms.
[Link]
E L
• Open Source is a licensing distribution model
• In many ways similar to commercial software
T
• Users need to understand the restrictions and obligations
P
• There are many kinds of Open Source licensing models
• GNU General Public License (“GPL”)
N
• GNU Lesser General Public License (“LGPL”)
• BSD, MIT, Apache
• Mozilla, IBM, Apple, Sun
Common Open Source Models
E L
• GNU General Public License (“GPL”)
T
Grants right to copy, modify and distribute
Requires that source code be made available to future licensees
P
Disclaims Warranties
May blow-up in face of patent assertion
N
• GNU Lesser General Public License (“LGPL”):
• Similar to GPL
• Somewhat easier for licensees to combine the LGPL code with a
separate program and distribute the combination under separate
licenses
• Often used with Open Source Libraries that are compiled into an
application program
E L
• BSD/MIT/Apache Style License:
T
o More permissive licenses
o Generally allow free distribution, modifying, and license change; much
P
like public domain software
o No future open source requirement
o May require attribution
N
o Variants may include non-standard restrictions
o E.g., no military use – but not OSI-compliant
o Disclaims Warranties
o Subject to third-party patent claims
Most Popular OSS Licenses
70%
E L •
•
Most OSS projects GPL
GPL incompatibility foolish (MPL, BSD-
T
old)
60% • Over 3/4 OSS projects use a top 5 license
P
50%
40%
N
30%
20%
10%
0%
BSD-old PD
GPL MIT/X MPL
[Link] Top ten licenses by project[Freshmeat 2010‐07‐31]
E L
Historical leads of open source
T
• 1970s: UNIX operating system developed at Bell Labs later AT&T
enforces intellectual property rights and “closes” the code
P
• 1983: Richard Stallman founds the Free Software Foundation
N
• 1993: Linus Torvalds releases first version of Linux
E
Documentation
T
USERS
P
Bug Reporters Core Developer(s) Patcher(s)
N USERS Maintainers
Open Source Dev. Model
E L
Org. 2: $$$
Org. 1: Org. 3:
T
Code in
New feature Documentation in,
funders code out
10110
0011
0110
DOCUMENTATION
P
Org. 4: OS Community
Community-funded $$$$$$$
0110 1100
N
Developers 0110 0110
0110
$$$
0110 1100
0110 1100
0100
Org. 7:
Ideas and money in, 0110 Org. 8:
code out
Code and money in,
code and money out
Credit: [Link] Holmes_2006a
E L
Recent advances in the world in last 6 years
• Indian govt (CDAC, NCST) release Linux in 12 languages
T
• Red Hat and fedora have been extremely profitable
• Sun releases Java Desktop System
P
• Virus fear could hurt Windows (WSJ headline, 2014)
N
• Munich shifts 14,000 desktops to Linux
T
• Sun
• uses Linux; supports some open source development efforts
• Forte IDE for Java and the Mozilla web browser
P
• Apple
• released core layers of Mac OS X Server as an open source BSD operating
system called Darwin; open sourcing the QuickTime Streaming Server and
N
the OpenPlay network gaming toolkit
• IBM
• uses and develops Apache and Linux; created Secure Mailer and created
other software on AlphaWorks
E L
• Red Hat Software, Fedora, Ubuntu, SUSE, Linux Mint, Debian
T
• Linux vendor
• ActiveState
P
• develops and sells professional tools for Perl, Python, and Tcl/tk developers.
N
Examples
• Operating Systems
E L
T
• Linux( Redhat, Fedora, Ubuntu, Suse, Linux Mint etc.,)
P
• FreeBSD, OpenBSD, and NetBSD: The BSDs are all based on
the Berkeley Systems Distribution of Unix, developed at the
N
University of California, Berkeley.
E L
T
• PHP is a very popular engine behind the "live content"
on the World Wide Web.
P
• Languages: Perl, Python, Tcl/Tk
• GNU compilers and tools: GCC, Make, Autoconf, etc.,
N
Open Office
E L
T
Leading open-source office software suite
• for word processing/ spreadsheets/ presentations/ graphics/ databases
P
Other features:
Available in many languages
N
Stores all your data in an international open standard format
Read and write files from other office software packages (MS Office, King soft)
You can download and use it completely free of charge for any purpose.
Neo Office
E L
Most popular open source office application for Mac OS X.
T
• Word Processing
• Spreadsheet
P
• Presentation
• Drawing
N
• Database
E L
(Open‐source Automated Library System)
T
A cooperatively developed, Web-based, open source program providing
Internet access to information databases and library collections.
P
There is no need to install software or purchase expensive computer hardware
N
for this powerful Internet accessed system.
• Sample Catalogs [Link]
• Vestal Senior High School [Link]
OpenBiblio
E L
T
[Link]
OpenBiblio is an easy to use, automated library system written in PHP
containing OPAC, circulation, cataloging, and staff administration
P
functionality. OpenBiblio library administration offers an intuitive interface
with broad category tabs and sidebar.
N
OpenBiblio Support
[Link]
Open Source Software
E L
T
Web Browser and Email
• Mozilla –‐ [Link]
P
• Firefox and Thunderbird
N
Digital Collections Management
• DSpace ‐ [Link]
• Greenstone ‐ [Link]
E L Blogs and
Content Management Systems
T
• WordPress - [Link]
P
• Joomla - [Link]
• Plone - [Link]
N
• ModX - [Link]
• Drupal - [Link]
• Atutor - [Link]
E L
FOSS4G:
Free and Open Source
Software for Geospatial
T
OSGEO:
The Open Source
Geospatial Foundation
N P
All of the products we'll talk about today are both free and open‐source
E L
Example Desktop System
Portability, interoperability
T
Geostatistics
Predictive modeling
P
View
Interact
Teach
N
raster Spatial
External GRASS Analysis
data vector Modeling
Database Visualize
engine:
Tables,
attributes DBF
E L
Summary
Open geospatial consortium (OGC)
T
OGC domains
OGC standards
P
Organization structure
Membership
N
Collaboration
E L
P T
N
E L
P T
N
Geographic Information Systems
Dr. Bharath Haridas Aithal
Ranbir and Chitra Gupta School of Infrastructure Design and Management
IIT KHARAGPUR
Module 12: Data & Data Standards
Lecture 58: Open Source GIS softwares: Introduction
E L
P T
Open Source Software Image Map
N
GDAL
OGR
GRASS/QGIS/FRAGSTAT – brief introduction
OSSIM
Open Source Software Image Map
E L
T
C++ software library that provides advanced remote sensing, image processing, and geo‐spatial
P
functionality
Includes orthorectification, precision terrain correction, rigorous sensor models, very large mosaics, and
cross sensor fusions, a wide range of map projections and datums, and a large range of commercial and
N
government data formats
OSSIM Planet ‐ an accurate 3D global geo‐spatial viewer that is built on top of OSSIM
E
GDAL is a translator library for raster
L
geospatial data formats...It also comes with
a variety of useful command line utilities for
GDAL, OGR
T
data translation and processing. The OGR Simple Features Library is a
C++ open source library (and
P
commandline tools) providing read (and
sometimes write) access to a variety of
vector file formats including ESRI
Shapefiles, S-57, SDTS, PostGIS, Oracle
N
Spatial, and Mapinfo mid/mif and TAB
formats.
E L
Possible OGR Sources in QGIS: AVCBin, BNA, CSV,
With GDAL tools you can: DGN, ESRI Shapefile, GML, GMT, GPX, GRASS,
GeoJSON, Interlis, KML, MapInfo FIle, Memory,
Report information about a file. MySQL, ODBC, OGDI, PGeo, PostgreSQL, REC, S57,
T
Copy a raster file, with control of output SDTS, SQLite, TIGER, [Link], VRT
format.
Warp an image into a new coordinate system.
Convert nearly black/white borders to exact
P
value.
Contours from DEM.
Tools to analyze and visualize DEMs.
N
Build a quick mosaic from a set of images.
Rasterize vectors into raster file.
Transform coordinates. Possible OGR Targets in QGIS: BNA, CSV,
And much more… DGN, ESRI Shapefile, GML, GMT, GPX,
GeoJSON, Interlis 1, Interlis 2, KML,
MapInfo FIle, Memory, MySQL, ODBC,
PostgreSQL, S57, SQLite, TIGER
E L
GRASS GIS - The World Leading Free GIS Software, one of the world’s biggest
open source project, official project of the Open Source Geospatial Foundation
P T
N
GRASS
E L
Geographic Resources Analysis Support System
T
• Geospatial data management
• Analysis
P
• Image processing
Commonly referred to as GRASS, • Graphics/maps production
this is a Geographic Information
System (GIS) used for geospatial • Spatial modeling
N
data management and analysis, • Visualization
image processing, graphics/maps
production, spatial modeling, and • Tons of tools + functions = Very complex analysis
visualization. • Now there's a simple user interface through QGIS
[Link]
E L
1984 developed at USArmy CERL as land management support system,
evolved into general purpose GIS
T
1999 GPL, international team of developers
P
Portable: all common OS, 32/64bit, code in C
N
Web-based infrastructure: SVN with on-line source code browser, bug
reports, users and programmers manual, wiki, IRC
E L
GRASS – DEVELOPMENT MODEL
P T
N
E L
P T
N
E L
P T
N
E L
Quantum GIS (QGIS)
•Quantum gis is a user friendly gis( a tool for manipulation of geographical data).
T
•It is an official project of OSGEO (Open Source Geospatial Foundation).
•Available under GNU General Public License
Linux
N P
Windows
Unix
Mac OSx
Features:
E L Cross platform
Free and Opensource
T
Robust support to vector data
Raster data processing
Digitizing
P
Plugin to other gis related
softwares
N
GPS tools support
OGC (Open Geospatial
Consortium) support
MAPSERVER (MapServer export)
OGR converter
Georeferencer
E L
P TFRAGSTAT
N
Introduction
E L
• FRAGSTATS is a spatial pattern analysis program for categorical maps.
T
• It simply quantifies the areal extent and spatial configuration of patches within
a landscape.
P
• It does not limit the scale (extent or grain) of the landscape subject to analysis.
N
• Landscapes of extreme extent and/or resolution may result in rather
cumbersome numbers and/or be subject to rounding errors.
• FRAGSTATS outputs data files in ASCII format that can be manipulated using
any database management program to rescale metrics or to convert them to
other units.
E L
Basic steps in running FRAGSTATS
T
Step1.
Starting the FRAGSTATS
P
1. File Menu
i) New
N
ii) Open
iii) Save
iv) Exit
2. Fragstat Menu
i) Set Run Parameters
E L
P T
N
E L
T
Input file type:
Landscape.--If Landscape mode is selected, then FRAGSTATS expects the designated
P
input file to be a single raster image; FRAGSTATS will produce the conventional output
for that landscape.
N
Batch File.--If Batch mode is selected, then FRAGSTATS will run the batch file specified
in the Input File text box and produce output for all of the landscapes designated in the
batch file.
E L
Grid Attributes
1. Cell Size (in meters)–Enter the size of cells
in meters in the input image.
T
2. Background Value.–[Optional] Enter the
value to be used for background cells.
This is only required if there are cells
P
interior or exterior to the landscape of
interest that you want to treat as
background
N
3. Number of Rows.–Enter the number of
rows in the input image. This is only
required if Input Data Type is ASCII or
Binary.
4. Number of Columns.–Enter the number
of columns in the input image. This is
only required if Input Data Type is ASCII
or Binary.
E L
Analysis Type
1) Standard.--If Standard mode is selected, then
FRAGSTATS will produce the conventional output for
the input landscape(s) consisting of the .patch, .class,
T
and .land files corresponding to the patch, class, and
landscape metrics.
P
2) Moving Window.--If Moving Window mode is selected,
then FRAGSTATS will conduct a moving window
analysis and output a new grid for each selected metric.
N
Patch metrics are not allowed in the moving window
analysis.
E L
P T
N
Landscape Metrics
E L
P T
N
E L
Class Metrics
P T
N
E L
P T
N India Geospatial Forum 2012
E L
Summary
Open geospatial consortium (OGC)
T
OGC domains
OGC standards
P
Organization structure
Membership
N
Collaboration
E L
P T
N
E L
P T
N
Geographic Information Systems
Dr. Bharath Haridas Aithal
Ranbir and Chitra Gupta School of Infrastructure Design and Management
IIT KHARAGPUR
Module 12: Data & Data Standards
Lecture 59: PROS & CONS of open source
E L
Open Source
P T
N
Cost of Ownership
Feature and quality
Principles and rights
Total cost of ownership
E L
Open source has a much lower price
Some software isn’t compatible with open
source
T
The number of Linux desktops is
meager compared to Microsoft
Free is a very good price Windows.
P
By choosing a Linux desktop, a user
The total cost of open source is lower forecloses on some software because it
may never be created for or ported to
N
Expertise vs Certified Experts Linux.
Vendors are starting to offer
guaranteed open source solutions.
L
Features & quality
E
• Proprietary software
• Open source is more Has more features
T
• Reliable It may be easier to use
peripherals like digital
cameras with proprietary
P
• Secure software
With both open source and
proprietary software, • More user friendly
N
effective security depends on
thoughtful deployment, A cloned program may
regular monitoring, and be just as user friendly
timely upgrades or other as the original
modifications.
Features & quality (cont.)
E L
• Customizable
• By it's very nature, any user with
enough expertise can tailor software to
• Powerful (Speed&Scale)
T
their needs.
• Some open source programs are • Better formats
generally faster and scale larger than
• Open source usually uses open formats.
P
proprietary alternatives,
• Open Office • The open source movement is partly a
response to incompatibility in
proprietary software.
N
• Network friendly
• Apple builds its OS X on BSD. The
Internet is a critical reason: Apple
recognizes they can't privately
innovate Internet functionality as well
or as fast as the open source
community
Deployment & maintenance
• Open source
E L
T
• License management easier
• Install any number of copies,
P
• open source companies don't bother with
complicated licenses
• no risk of illegal copies or license audits,
N
• anti-piracy measures (CD keys, product activation)
Deployment & maintenance(cont)
T
Greater independence from support
• For both open source and proprietary
companies software, experts depend on email lists
P
Even if a software company goes and community Web sites as well as
bankrupt, the community still has the contracted support.
source code.
N
"end of life" decisions or undesirable
• The quality and availability of help is
new features can't be forced on the proportional to interest and use,
users. especially in open source.
Users and Migration
E L
• Some open source software is just as
• Migration is too expensive
There may be unforeseen problems, as
T
when existing hardware isn't actually
easy to learn how to use
sufficient or when data isn't easy to
migrate.
P
• For better or worse, most users • It’s difficult to integrate open source &
are more familiar and more proprietary solutions
comfortable with proprietary
Integrating any two programs is often
software.
N
challenging.
• many open source solutions are
It may be difficult to integrate some
overtly cloning proprietary
open source and proprietary solutions.
interfaces and environments.
Principles and rights
E L
T
• Open source is more empowering
• Any user can fix the bugs or add the features that matter most to them.
P
• Open source frees the users to decide for themselves.
N
• Open source is community driven and community serving
• A large community of motivated, generous programmers work together.
E L
• Neither OSS nor proprietary always better
– But clearly many cases where OSS is better
Bottom line
T
– By definition, OSS gives more rights to its user community
P
• Policies must not ignore or make it difficult to use OSS where
applicable
N
– Can be a challenge because of radically different assumptions &
approach
Open geospatial consortium (OGC)
T
OGC domains
OGC standards
P
Organization structure
Membership
N
Collaboration
E L
P T
N
E L
P T
Geographic Information Systems
N
Dr. Bharath Haridas Aithal
Ranbir and Chitra Gupta School of Infrastructure Design and Management
IIT KHARAGPUR
Module 12: Data standards
Lecture 60 : GIS data standards
E L
Data standards
P T
N
Standardization levels
Elements of standardization
Standardization on application level
Metadata
E L
Data standards
The objective of the data standard is to allow the producer data and end user to interpret and
T
understand data same way
A standard will provide definition of data structure, data content and rules that will
P
Increase mutual understanding of the geographic data among the users
Eliminate the technical problems of exchanging the data
N
Increase the integration, combination and interoperability
E L
Standardization levels
Standardization can be carried out at three levels
T
Level 1: Generic standards
P
Ex: Data description language, query language, encoding, transfer syntax
N
Ex: Geometry, topology, quality, metadata
T
Data base system vendors
GIS vendors
P
Information technology companies
N
OGC works on the development of open solutions linked to the processing of
Geographical information
E L
Open Geospatial Consortium (OGC)
Established in the year 1995 by
T
Data base system vendors
GIS vendors
P
Information technology companies
OGC works on the development of open solutions linked to the processing of
N
Geographical information
The objective here is to efficient transfer of GIS data across systems of various
platforms
E L
Elements of standardization
The following are some of the elements being worked on in ISO 19100
T
1. Conceptual modelling and application schemas
2. Transfer format
3. Encoding
P
4. Spatial representation
5. Spatial referencing
6. Temporal characteristics
N
7. Data quality description and evaluation
8. Visualization/Portraying
9. Geographic information services and interface
10. Object catalogue
11. Metadata
E L
Elements of standardization
T
• All standardization work should be based on a common understanding
• The abstract representation of the real world features is called as conceptual model
P
• In standardization work, a formal conceptual schema is used o describe the
conceptual model for the universe of disclosure
N
• Standardization work is often based on object oriented modelling
• A conceptual schema language (UML – Unified modelling language) is used to
develop conceptual schemas or templates
E L
Elements of standardization
T
• The transfer format should provide transfer of geographical data sets that include
• Meta data
P
• Spatial data
• Attribute data
• The standard transfer format files should include rules for
N
• Transfer of geometry
• Transfer of links between geometry and attribute data
• Attribute data transfer data
• Transfer of metadata
E L
Elements of standardization
Encoding
T
Encoding rules allow geographic information to be coded into a system independent
data structure suitable for transport or storage
P
Components of data formats
Head
N
Index
Data dictionary
Data elements
E L
Elements of standardization
Spatial representation
T
Geographic datasets are represented spatially as either vector or raster data
At the superior level standard schemas should be developed to describe the
P
geometric and topographic primitives
This will increase the ability to share the GIS information among application users
N
Also improve the consistency of the datasets
E L
Elements of standardization
Spatial referencing
T
It can be based on referencing by coordinates or by geographic identifiers
The most important elements of CRS are
P
Datum
Anchor point
N
Prime meridian
Coordinate system – units, direction, sequence od axes
E L
Elements of standardization
Temporal characteristics
T
ISO 8601 specifies the use of Gregorian calendar and 24 hrs. local or Coordinated
universal time (UTC) for information exchange
P
This is used as primary temporal reference system for all GIS information
Specification of date and time of the day can be standardized as a sequence
N
Year/day/hour/minute (hours in 24 hrs. format)
E L
Elements of standardization
T
At the superior level, the objective of standardization is also to maintain the data
quality and handling the data quality [Link]. GIS data
P
Quality statements should consists following elements
Positional accuracy
N
Attribute accuracy
Temporal accuracy
Local accuracy
Completeness
E L
Elements of standardization
Visualization or Portray
T
Different computer graphic standards (OpenGL, PHIGS, GKS etc.) use different
attributes to visualize the geometry
P
At application level standardization can be performed with respect to cartographic
symbols
N
In standardization work the term portrayal is used instead of visualization
E L
Elements of standardization
T
Standards are important for the users to access and progress geographic data from
variety of sources across computing interface
P
This includes
Web server interface
N
Open information technology environment
User should be able to query the geo data existing at remote data bases and control
the processing happening
E L
Standardization on application level
T
Buildings Heights
Transport Control points
P
Utilities Annotation
Land use Text
N
Administrative units Styles
Water Trees
E L
Metadata
Metadata
T
Identification definition
They are stored in a database and it enables
Dataset
P
the users to know Overview
Extent
N
specified purpose Distribution
T
Constraint information Distribution
P
Data quality Extension information
Maintenance information Application schema information
N
Spatial representation Extent
Reference systems Citation
Content information Responsible party information
E L
Summary
Data standards
T
Standardization levels
Elements of standardization
P
Standardization on application level
Metadata
N
E L
P T
N
E L
P T
Geographic Information Systems
N
Dr. Bharath Haridas Aithal
Ranbir and Chitra Gupta School of Infrastructure Design and Management
IIT KHARAGPUR
Module 12: Data standards
Lecture 61: Open Geospatial Consortium (OGC)
E L
P T
Open geospatial consortium (OGC)
N
OGC domains
OGC standards
Organization structure
Membership
Collaboration
E L
Open Geospatial Consortium
Open Geospatial Consortium (OGC), an international voluntary consensus standards
T
organization, originated in 1994.
In the OGC, more than 500 commercial, governmental, nonprofit and research
P
organizations worldwide collaborate in a consensus process encouraging development
and implementation of open standards
N
OGC's member‐driven consensus process creates royalty free, publicly available, open
geospatial standards.
E L
Open Geospatial Consortium
VISION
T
Using location, we connect people, communities, technology, and decision making to
create a sustainable future for us, our children, and future generations
P
MISSION
N
To serve as the global forum for making location Findable, Accessible, Interoperable,
and Reusable (FAIR) via a proven consensus‐based collaborative and agile process
combining standards, innovation, and partnerships
E L
OGC ‐ Domains Aviation
Built Environment & 3D
T
Business Intelligence
Defense & Intelligence (D&I)
P
Emergency Response & Disaster Management
Energy & Utilities
N
Geosciences & Environment
Government & Spatial Data Infrastructure
Mobile Internet & Location Services
Sensor Webs
University and Research
E L
OGC standards baseline comprises more than 30 standards, including
CSW – Catalog Service for the Web: access to catalog information
GML – Geography Markup Language: XML‐format for geographical information
T
GeoXACML – Geospatial eXtensible Access Control Markup Language
KML – Keyhole Markup Language: XML‐based language schema for expressing geographic
P
annotation and visualization on existing (or future) Web‐based, two‐dimensional maps and
three‐dimensional Earth browsers
Observations and Measurements
N
OGC Reference Model – a complete set of reference models
OLS – Open Location Service (OpenLS)[5]
E L
OGC standards baseline comprises more than 30 standards, including
T
OGC Web Services Context Document defines the application state
of an OGC Integrated Client
P
OWS – OGC Web Service Common
SOS – Sensor Observation Service
N
SPS – Sensor Planning Service
SensorML – Sensor Model Language
E L
T
SensorThings API ‐ an open and unified framework to interconnect
P
IoT devices, data, and applications over the Web. Currently a
N
candidate standard waiting for votes.
SLD ‐ Styled Layer Descriptor
E L
OGC standards baseline comprises more than 30 standards, including
SRID, an identification for spatial coordinate systems
T
WaterML – Information model for the representation of
P
hydrological observation data
WCS – Web Coverage Service: provides access, subsetting, and
N
processing on coverage objects
WCPS – Web Coverage Processing Service: provides a raster query
language for ad‐hoc processing and filtering on raster coverages
WFS – Web Feature Service: for retrieving or altering feature
descriptions
E L
T
WMS – Web Map Service: provides map images
P
WMTS – Web Map Tile Service: provides map image tiles
WPS – Web Processing Service: remote processing service
N
GeoSPARQL – Geographic SPARQL Protocol and RDF Query
Language representation and querying of geospatial data for the
Semantic Web
WTS – Web Terrain Service (WTS)
E L
The OGC Baseline and OGC Reference Model
In developing a Web services application using OGC standards (and in learning about the
T
relationships between OGC standards) it helps to think of publish, find and bind as the key
P
functions for applications in a Web services environment
Publish: Resource providers advertise their resources.
N
Find: End users and their applications can discover resources that they need at run‐time.
Bind: End users and their applications can access and exercise resources at run‐time.
Source: [Link]
E L
P T
N
Source: [Link]
E L
Organization structure
1. Standards program: Technical Committee and Planning Committee work in a
T
formal consensus process to arrive at approved OGC® standards
P
2. Innovation Program: A global, innovative, hands‐on prototyping and testing
N
program designed to accelerate interface development and validation, and
bring interoperability to the market. Learn about the different initiatives
E L
3. Compliance Program: The OGC Compliance Program provides the resources,
T
procedures, and policies for improving software implementations'
compliance with OGC standards
N P
4. Community and Outreach Program: The OGC and its members offer resources
to help technology developers and users take advantage of the OGC's open
standards
E L
Membership
The OGC is an open membership organization
T
The OGC offers a range of membership options for industry, government, academic, research
P
and not‐for‐profit organizations interested in supporting the Consortium’s global mission
N
Collaboration
E L
T
The OGC has a close relationship with ISO/TC 211 (Geographic Information/Geomatics).
Volumes from the ISO 19100 series under development by this committee progressively
P
replace the OGC abstract specification.
N
Further, the OGC standards Web Map Service, GML, Web Feature Service, Observations
and Measurements, and Simple Features Access have become ISO standards
E L
Summary
Open geospatial consortium (OGC)
T
OGC domains
OGC standards
P
Organization structure
Membership
N
Collaboration
E L
P T
N
E L
P T
Geographic Information Systems
N
Dr. Bharath Haridas Aithal
Ranbir and Chitra Gupta School of Infrastructure Design and Management
IIT KHARAGPUR
Module 12: Data standards
Lecture 62 : National Spatial Data Infrastructure(NSDI)
E L
NSDI vision
P T
N
National Data Sharing and Accessibility Policy (NDSAP)
Need, objective and scope of the policy
Benefits of national policy
Type of data access
Pricing and legal framework
E L
NSDI Vision
T
That current, accurate and organized geospatial data will be
P
readily and continuously available and will be accessible on a
national, state, district and village level basis to contribute to the
N
economic, environmental and social growth of the country
E L
National Data Sharing and Accessibility Policy (NDSAP) – 2012
T
in digital or analog forms but generated using public funds by various
P
Ministries / Departments /Subordinate offices / organizations / agencies of
Government of India.
N
The NDSAP policy is designed to promote data sharing and enable access to
Government of India owned data for national planning and development
E L
Definitions (page 1 of 3)
Data: Data means a representation of information, numerical compilations and
T
observations, documents, facts, maps, images, charts, tables and figures,
concepts in digital and/or analog form.
P
Data Archive: A place where machine‐readable data are acquired, manipulated,
documented, and distributed to others for further analysis and consumption.
N
Data Generation: Initial generation / collection of data or subsequent addition
of data to the same specification.
Data set: A named collection of logically related features including processed
data or information.
E L
Definitions (page 2 of 3)
Geospatial Data: All data which is geographically referenced
T
Information: Processed data
Metadata: The information that describes the data source and the time, place,
P
and conditions under which the data were created. Metadata informs the user
of who, when, what, where, why, and how data were generated. Metadata
N
allows the data to be traced to a known origin and know quality.
Negative list: Non sharable data as declared by the departments/organizations
Restricted Data: Data which are accessible only through a prescribed process of
registration and authorization by respective departments/organizations
E L
Definitions (page 3 of 3)
Sensitive data: Sensitive data as defined in various Acts and rules of the
T
Government of India.
Sharable data: Those data not covered under the scope of negative list and
P
non‐sensitive in nature
Standards: Any application that embeds data handling functions (e.g., data
N
collection, management, transfer, integration, publication, etc.) and operates
on data in a manner that complies with data format and data syntax
specifications produced and maintained by open, standards bodies.
E L
Need for a policy
T
Evidence based planning of socio‐economic development
Sharing and utilization of data generated by government
P
departments
Efficient sharing of data among data owners and inter and intra
N
governmental agencies
E L
Objective of policy
T
To facilitate the access to Government of India owned shareable data and
information in both human readable and machine readable forms through a
P
network all over the country in a proactive and periodically updatable manner,
within the framework of various related policies, Acts and rules of Government of
N
India, thereby permitting a wider accessibility and use of public data and
information
E L
Scope of this Policy
The National Data Sharing and Accessibility Policy will apply to all data and information
T
created, generated, collected and archived using public funds provided by Government
of India directly or through authorized agencies by various
P
• Ministries
• Departments
N
• Organizations
• Agencies
• Autonomous bodies
E L
Scope of this Policy
The National Data Sharing and Accessibility Policy will apply to all data and information
T
created, generated, collected and archived using public funds provided by Government
of India directly or through authorized agencies by various
P
• Ministries
• Departments
N
• Organizations
• Agencies
• Autonomous bodies
E L
Benefits of the data sharing policy
T
Maximizing use
Avoiding duplication
P
Maximized integration
Ownership information
N
Better decision making
Equity of access
E L
Types of access
Open access: Access to data generated from public funding should be easy, timely, user friendly
T
and web‐based without any process of registration / authorization
Registered access: Data sets which are accessible only through a prescribed process of
P
registration / authorization by respective departments / organizations will be available to the
recognized institutions / organizations / public users, through defined procedures
N
Restricted access: Data declared as restricted, by Government of India policies, will be
accessible only through and under authorization
E L
Technology for sharing and access: A data warehouse
The main features of a data warehouse need to include
T
User friendly interface
P
Dynamic / pull down menus
Search based Report
N
Secured web access
Bulletin board
Complete Metadata
Parametric and Dynamic report in exportable format
E L
Pricing
Pricing of data, if any, would be decided by the data owners and as per the government policies
T
All Ministries / Departments will upload the pricing policy of the data under registered and
P
restricted access
Legal framework
N
Data will remain the property of the agency/department/ ministry/ entity which
collected them and reside in their IT enabled facility for sharing and providing
access
Conclusions of policy
E L
• It is necessary to develop institutional repositories, data centers on domain and national
T
levels that all methods of storing and sharing have to exist within the specific
P
infrastructure to enable all users to access and use it
• National Data Sharing and Access Policy aims at the promotion of a technology‐based
N
culture of data management as well as data sharing and access.
E L
Summary
NSDI vision
T
National Data Sharing and Accessibility
Policy (NDSAP)
P
Need, objective and scope of the policy
Benefits of national policy
N
Type of data access
Pricing and legal framework
Conclusion statement of policy
E L
P T
N
E L
P T
Geographic Information Systems
N
Dr. Bharath Haridas Aithal
Ranbir and Chitra Gupta School of Infrastructure Design and Management,
IIT KHARAGPUR
Module 12: WebGIS Through Geoserver
Hands on 63: Introduction to Web GIS and Geoserver
By: Chandan M C
E L
P T
Data Sharing
Geospatial Web Services
Open Geospatial Consortium
N
Web Architecture
Advantages of Geoserver
Geoserver overview and prerequisites
Geoserver step‐by‐step installation
Task1: publishing vector file
Creating workspace, store, adding and editing new data source
Evolution of GIS Data Sharing
E L
GIS users require reference map data maintained by other sources
T
GIS users rely heavily on “external” data sources. Therefore, data sharing and updating is an
extreme challenge
P
Current advanced technology like Web GIS can address issues regarding GIS data such as:
1. Sharing Distributed Web GIS
N
GIS (via Web
2. File format, CRS and Projection Services)
Media
3. Metadata distribution Distribution
(ftp)
4. Manipulation Downloading
Data (http)
5. Processing
6. Visualization
Shared
7. Updating Disc
Space
Types of Geospatial Web Services
Service
E L
Description
T
Web Map Service For map images generated from
(WMS) geographical data
P
Web Feature Supports requests for geographical
Service (WFS) feature data(with Vector geometry and
attributes)
N
Web Coverage for coverage data (grid or raster)
Service (WCS)
Web Processing OGC service for publishing of geospatial
Service (WPS) processes, algorithms, and calculations
Map Service Operation
E L
P T
NImage Source: Larry Spraker, NYSO
Geoserver
E L
Open‐source Java based web mapping service, platform independent, server side software
T
Functions of Geoserver:
Allows to publish individuals data on a network (share, process and edit)
P
Complies with OGC standards (WMS, WFS, WCS)
Supports wide variety of spatial data extensions
N
Basically designed for interoperability to publish data from any major spatial
data source using open standards
Has inbuilt browser‐based management interface and connects to multiple
data sources at the back end
E
Geoserver – Inputs and Services
L
Inputs to Geoserver can be delivered in number of open standard based services
P T
N Source‐ [Link]
Open Geospatial Consortium
E L
OGC is a non‐profit research organizations encouraging development
T
and implementation of open standards for geospatial content, services,
data processing and sharing
P
OGC has started a series of web‐based interoperability standards
initiatives since 1999
N
The OGC standards comprises more than 30 formats that cover services
including standards for delivering maps and spatial data online (WMS,
WFS, WCS, WPS, KML etc.
E L
Web Architecture
P T
N
Source‐ [Link]
Source‐ [Link]
Server Client Architecture
E L
P T
N
Websites Using Geoserver
E L
P T
N
[Link] [Link]
[Link]
Advantages of Geoserver
E L
Fully compliant to WMS 1.1.1, WFS and WCS (1.0 and 1.1) specifications
T
Mature support for all kinds of raster and vector database
On the fly re‐projection, for WMS and WFS, with an embedded EPSG database
P
supporting large number of projections
Integration with Geo‐Web Cache, for accelerated tile mapping (For ex. Openlayers)
N
Performance, on par with the fastest open source mapping servers, often faster
rendering than any major proprietary server
Full SLD support ‐ open standard to define map styles
User Manual with documentation and support
[Link]
Geoserver Overview
Prerequisite:
E L
T
• Java 8 (JDK,JRE) version to be installed
• XAMPP Software installation for Apache and Tomcat
P
• Set the environmental variables after installation of Java
(Windows > search > Edit the system environment variables >
N
Add path of Geoserver and Java under New tab)
Tasks:
1. Publishing Vector File (.shp)
2. Publishing Raster File (.tif)
3. Creating WMS Layer using QGIS
4. Integrate SLD file into Geoserver
Geoserver Installation
1. Make sure you have
E La Java Runtime
T
Environment (JRE) installed on your system.
GeoServer requires a Java 8 environment or
P
above. Java can be downloaded from this link
2. Download Geoserver from the link
N
3. Select the version of GeoServer as Stable
4. Click the link for the Windows installer
5. After downloading, double‐click the file to
launch
6. At the Welcome screen, click Next
Geoserver Installation
E L
7. Read the License and click I Agree
T
8. Select the directory of the installation, and then click Next
9. Select the Start Menu directory name and location, then click Next
N P
Geoserver Installation
E L
10. Enter the path to a valid Java Runtime
T
Environment (JRE). Geoserver requires a valid
JRE in order to run. The installer will inspect
P
your system and attempt to automatically
populate this box with a JRE if it is found, but
N
otherwise you will have to enter this path
manually. When finished, click Next
Note: A typical path on Windows would be
C:\Program Files\Java\jre8
Geoserver Installation
E L
11. Enter the path to your Geoserver data directory or
T
select the default (for first time users). When
finished, click Next
P
12. Enter the username and password for administration
of Geoserver. Geoserver’s Web administration
N
interface requires authentication for management
Note: Default Username: “admin”; Password:
“Geoserver”
It is recommended to change these from the defaults
When finished, click Next
Geoserver Installation
E L
13. Enter the port that Geoserver will respond on. The default port is 8080, though any valid
T
and unused port will work. When finished, click Next
14. Select whether Geoserver should be run manually or installed as a service
N P
Geoserver Installation
E L
15. Review your selections and (click the Back button for changes, if any). Otherwise, click Install
T
16. Installation starts. When finished, click Finish to close the installer
17. If you have installed Geoserver as a service, it is already running. Otherwise, you can start Geoserver
P
by: Start Menu> type “Start Geoserver”
N
Geoserver Home Page
E L
18. Open any web browser and type [Link] to access the Geoserver
T
Web administration interface
19. Login with username and password
N P
Geoserver Home Page
E L
T
Menubar
N P
Layer Preview
Layer Preview: Allows
E L
to view the
T
published layers on web
Menubar > Data > Layer Preview
P
You can view different layers by clicking on
link for an output format. Click the
N
OpenLayers link for a given layer to
visualize layer in a new tab
Task1: Publishing Vector File
E L
Firstly, gather the data (Dist_roads‐[Link]). This can be found in Vector
T
folder under Datasets_for_NPTEL
The archive contains the following five files:
P
1. Dist_roads‐[Link]
2. Dist_roads‐[Link]
N
3. Dist_roads‐[Link]
4. Dist_roads‐[Link]
5. Dist_roads‐[Link]
E L
T
• A workspace is a container used to group similar layers
together
P
• Menubar > Data > Workspaces
• Click the Add new workspace button
N
• You will be prompted to enter a workspace Name and
Namespace URI
• Enter Name as District and the Namespace URI as
[Link] > Submit
• The new workspace will be added to the Workspaces list
Task1: Publishing Vector File
E L
Creating a store and data source:
T
• Once the workspace is created, we are ready to add a
new store. The store tells Geoserver how to connect
P
to the shapefile
• Menubar > Data > Stores includes a list of stores,
N
type of store and the workspace that the store
belongs to
• In order to add the shapefile, you need to create a
new store
• Click the Add new Store button. You will see a list of
the data sources supported by Geoserver
Task1: Publishing Vector File
Adding vector data source:
E L
T
• Click on Shapefile. The New Vector Data Source
page will display
P
• Select the workspace District from the drop
down menu
N
• Enter the Data Source Name as Roads
• Under Connection Parameters, browse the
location URL of the shapefile on your local disc
• Click Save. You will now see New Layer page in
order to configure the Dist_roads‐clip layer
Task1: Publishing Vector File
Creating layer:
E L
T
• Once saved, on the New Layer
page, click Publish beside the
P
roads layer name
• The Edit Layer page defines
N
the data and publishing
parameters for a layer
• Enter a short Title and an
Abstract for the roads layer
Task1: Publishing Vector File
Editing layer properties:
E L
T
• Scroll down in the edit layer section
to Coordinate Reference Systems
P
tab
• Generate the layer’s bounding
N
boxes by clicking the Compute from
data and then compute from native
bounds links
• Scroll further down and press Save
Task1: Publishing Vector File
Previewing added layer:
E L
T
• In the layers tab, You can see layer
has been created
P
• Menubar > Data > Layer Preview
screen and find District: Dist_roads‐
N
clip
• Click the OpenLayers link in the
Common Formats column
• An OpenLayers map will load in a
new tab and display the shapefile
data
E L
Summary
Data Sharing – From disc space to web (distributed GIS)
T
Geospatial Web Services – WMS, WFS, WCS and WPS
Geoserver – Open source web mapping service, confining to OGC
P
Web Architecture – GUI, Server and DB
Advantages of Geoserver
N
Installation of Geoserver – Needs JAVA, Apache and Tomcat
Publishing vector file, creating workspace, store and layer preview
In the next session, we shall demonstrate Publishing a raster data and SLD
integration
E L
P T
N
E L
P T
Geographic Information Systems
N
Dr. Bharath Haridas Aithal
Ranbir and Chitra Gupta School of Infrastructure Design and Management,
IIT KHARAGPUR
Module 12: WebGIS Through Geoserver
Hands on 64: Geoserver – Raster and SLD Integration
By: Chandan M C
E L
P T
Task2: Publishing Raster File
N
Task 3: Creating WMS Layer using QGIS
Creating SLD File
Task 4: Integrate SLD File Into Geoserver
Applying Styles
Viewing Multiple Layers
Task2: Publishing Raster File
Creating Workspace:
E L Existing Workspace
T
• Gather the raster dataset named Interpolate_MYS.tif
• We will add the details to the workspace District, which we
P
already created
• Creating Store
N
1. Navigate to Data > Store
2. Click on Add new Store
3. You will be directed to New data Source
4. Under Raster Data Sources choose Geo TIFF
Task2: Publishing Raster File
Add Raster Data Source:
E L
T
• Under Basic Store Info, Choose the workspace (District).
Data Source Name: Interpolation and additional
P
description if required
• Enter Connection Parameters: Browse to the location on
N
your PC where the TIF file is stored
• After selecting layer, click on Save
Browse…
• Now you will be directed to New Layer Page. Click on
Publish.
Task2: Publishing Raster File
Editing Raster Data:
E L
T
• Enter details under Basic Resource Info: Name, Title and
Abstract. Mention as interpolation
P
• Do not change anything else
• Scroll down and Click on Save button
N
• After saving, you will be directed to Layers window, you
can see interpolation raster layer has been created
Task2: Publishing Raster File
E L
T
• Navigate to Menubar > Data > Layer
P
Preview
• Select Interpolation and click on
OpenLayers under Common formats
N
• Now you will see the Interpolation layer
on web successfully
E
Task 3: Creating WMS Layer using QGIS
Open Quantum GIS(QGIS) Desktop
L
T
Preparing data: Add a vector file ([Link])
Right click on layer > Properties > Symbology
P
Under Style, choose Save Style > SLD File (from
dropdown) and choose the path, file name where
N
you want to save the file
Click OK and close QGIS
E L
Task 3: Creating WMS Layer using QGIS
Open Geoserver
T
Choose the workspace, which we already
created in task1 “District”
P
Menubar > Data > Stores > Add New Store >
Vector Data Sources > Shapefile and provide
N
following information
• Workspace: District
• Data Source Name: Rainfall
• Description: Rainfall point layer
Connection Parameters > Browse for
[Link] from datasets > Save
Task 3: Creating WMS Layer using QGIS
Once saved, on the New Layer
E L
T
page, click Publish beside the
Rainfall layer name
P
In the Edit Layer page enter details
such as Name, Title and Abstract
Scroll down to Coordinate
N
Reference Systems tab > Native
Bounding box > Compute from
data > Lat/Lon Bounding Box >
Compute from native bounds
Scroll down and Save
E L
Task 3: Creating WMS Layer using QGIS
In the layers tab, not the Rainfall point
T
layer has been published
Menubar > Data > Layer Preview >
P
Select Rainfall > Openlayers
An OpenLayers map will load in a new
N
tab and display the shapefile data
E L
Task 4: Integrate SLD File Into Geoserver
Menubar > Data > Styles
T
Click on Add a new Style
Style Data > Name = Rainfall‐style;
P
Workspace = District; Format = SLD
Scroll down to Style Content > Choose
N
file > Browse for style saved from QGIS
> upload… > Validate (Check for no
validation errors) > Submit
E L
Task 4: Integrate SLD File Into Geoserver
Rainfall‐style has been created under
T
District workspace
Applying Rainfall‐style to Rainfall
P
shapefile:
• Menubar > Data > Layers > Select
N
Rainfall layer
E L
Task 4: Integrate SLD File Into Geoserver
Applying Rainfall‐style to Rainfall shapefile:
T
• Edit Layer > Under Publishing tab > Scroll
down to WMS Settings > Layer Settings >
P
Default Style > Rainfall‐Style (dropdown) >
Additional styles > Double click on District:
N
Rainfall‐Style and click on Save button
Applying Rainfall‐style
E L
Task 4: Integrate SLD File Into Geoserver
to Rainfall
T
shapefile:
• Menu bar > Data > Layer Preview, you can
P
see of District: Rainfall. Click on
OpenLayers under Common formats
N
• Loaded Style is similar to the QGIS
symbology style
E L
Task 4: Integrate SLD File Into Geoserver
Viewing multiple layers in single web page:
T
• Menubar > Data > Layer Groups > Add new
layer group
P
• Under Data tab give
• Name = Mysore_Layers; Title and abstract as
N
shown
• Select Workspace as District
E L
Task 4: Integrate SLD File Into Geoserver
Viewing multiple layers in single web page:
T
• First, Layers tab > Add Layer… > Add all three layers > Arrange layers
• Next, Bounds tab > Generate bounds > Save
P
Order:
N
1. Raster
2. Line
3. Points
E L
Task 4: Integrate SLD File Into Geoserver
P T Viewing multiple layers in single web
N
page:
• Menubar > Data > Layer Preview
> Select Mysore_Layers >
OpenLayers
E L
Summary
Task2: Publishing Raster File
T
Task 3: Creating WMS Layer using QGIS
Creating SLD File
P
Task 4: Integrate SLD File Into Geoserver
Applying Styles
N
Viewing Multiple Layers
That’s the end of Hands on sessions!
E L
P T
N