7/13/2012
V.Sathishkumar
What this session is about
A principled, scientific approach to designing and implementing embedded systems
7/13/2012
V.Sathishkumar
Hardware Components Hardware
Concept
Specification
HW/SW Partitioning
Estimation Exploration
Software Components
Software
Evaluation (area, power, performance, reliability, security, )
Whats an Embedded System?
Embedded systems =
information processing systems that interact with physical processes and are embedded into a larger product
Two types of computing
Desktop produced millions/year Embedded billions/year
Non-Embedded Systems
PCs, servers, and notebooks
The future of computing!
Automobiles, entertainment, communication, aviation, handheld devices, military, medical equipment
What is an Embedded System ?
An embedded system is a special-purpose computer system designed to perform a dedicated function & its an FIRMWARE
7/13/2012
V.Sathishkumar
7/13/2012
V.Sathishkumar
Embedding a computer
output analog
CPU
input
analog
embedded computer
mem
7/13/2012
V.Sathishkumar
Embedded System = Cyber Physical System
Areas
According to forecasts, future of IT characterized by terms such as
Disappearing computer, Ubiquitous computing, Pervasive computing, Ambient intelligence, Post-PC era, Cyber-physical systems. Embedded Systems Communication technologies
V.Sathishkumar 9
Basic technologies:
7/13/2012
Extending the motivation: Embedded systems and Ubiquitous computing
Ubiquitous computing: Information anytime, anywhere. Embedded systems provide fundamental technology.
Communication Technology
Optical networking Network management Distributed applications Service provision UMTS, DECT, Hiperlan, ATM Quality of service
Real-time Dependability
Embedded Systems
Robots Multicore processing Control systems Feature extraction and recognition Sensors/actuators A/D-converters
Pervasive/Ubiquitous computing Distributed systems Embedded web systems
7/13/2012 V.Sathishkumar 10
An Example Embedded System
Digital Camera Block Diagram
Components of Embedded Systems
Memory Controllers Interface
Software
(Application Programs)
Coprocessors
Processor
ASIC
Converters
Analog 7/13/2012
V.Sathishkumar
Digital
12 Analog
Components of Embedded Systems
Analog Components
Sensors, Actuators,
Digital Components
Processor, Coprocessors, Memories, Buses Controllers, Application Specific Hardwares
Converters
Analog-to-Digital (A2D), D2A,
Software
Operating systems Middleware Applications (MPEG-x, GSM-kernel, )
7/13/2012 V.Sathishkumar 13
Automotive Electronics Platform Example
V.Sathishkumar
Automotive Electronics Market Size
1400 1200 1000 800 600 400 200 Cost of Electronics / Car ($)
0
1998 1999 2000 2001 2002 2003 2004 2005
Market 8.9 ($billions)
10.5
13.1
14.1
15.8
17.4
19.3
21.0
90% of future innovations in vehicles: based on electronic embedded systems
Toyota Autonomous Vehicle Technology Roadmap
What can go wrong: BMW 745i
2, 000, 000 LOC Windows CE OS 53 8-bit P 11 32-bit P 7 16-bit P Multiple Networks Buggy!
improper synchronization between two digital electronic control units would stall the engine and lead to a catastrophic accident in some cases
Recent Toyota break/acceleration fiasco
BMW 850i, contd.
sensor sensor
brake
brake
ABS
hydraulic pump brake
brake
sensor
7/13/2012 V.Sathishkumar
sensor
18
Digital Convergence Mobile Example
Communication
Entertainment
Computing
Broadcasting
Imaging
Telematics
One device, multiple functions Center of ubiquitous media network Smart mobile device: next drive for semicon. Industry
V.Sathishkumar 19
7/13/2012
Mobile graphics/games
Resolution today ~176x208 480x320
In Japan, QVGA (320x240) is the norm Nokia series 90 is 640x320; Nokia N93 is 320x200 Sony Ericsson S700i, M600i, K800i: 240x320 IPhone, IPod Touch is 480x320
900 800 700 600 500 400 300 Millions of units
Jon Peddie Research
Handheld Multimedia Devices report MM phones Non 3D MM phones Native API based phones
Latest IPhone 4 has 960x640
200
To 1024x768 and beyond in the future
7/13/2012
100 0 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010
V.Sathishkumar
20
Device Shrinkage: Macs
7/13/2012
V.Sathishkumar
21
Growing Importancedriven world in which of ES .. embedded chips form the backbone of the electronics
we live ... they are part of almost everything that runs on electricity [Mary Ryan, EEDesign, 1995]
the global mobile entertainment industry is now worth some $32 blnpredicting average revenue growth of 28% for 2010 [www.itfacts.biz, July 8th, 2009]
Spending on GPS units exceeded $100 mln during Thanksgiving week, up 237% from 2006 More people bought GPS units than bought PCs, NPD found. [www.itfacts.biz, Dec. 6th, 2007] , the market for remote home health monitoring is expected to generate $225 mln revenue in 2011, up from less than $70 mln in 2006, according to Parks Associates. . [www.itfacts.biz, Sep. 4th, 2007] Accessing the Internet via a mobile device up by 82% in the US, by 49% in Europe, from May 2007 to May 2008 [www.itfacts.biz, July 29th, 2008]
The future is embedded Embedded is the future!
7/13/2012
Foundation for the postV.Sathishkumar PC era
22
Application Specific
Characteristics
Applications are known a priori Optimize for cost, area, power, and performance
Digital Signal Processing
Signals are represented digitally
Reactive
Reacts to changes in the systems environment
Real-time
Compute certain tasks before deadline
Distributed, Networked,
7/13/2012
V.Sathishkumar
23
Characteristics
Reliability
Probability of system working correctly provided that is was working at t=0
Maintainability
Probability of system working correctly d time units after error occurred.
Safety
Not harmful for user
Security
Confidential and authentic communication
7/13/2012 V.Sathishkumar 24
Real-Time Systems
A systems where correctness depends on logical results and the time the results are produced
Safety-critical: incorrect operation leads to human loss Mission-critical: incorrect operation leads to failed mission
V.Sathishkumar J.A. Stankovic et al. Strategic Directions in Real-Time and 7/13/2012
25
Popular Embedded Application ICS212 Lecture 2 Domains
7/13/2012
V.Sathishkumar
26
Aerospace
Flight control
Stability: real-time differential feedback loops
Positioning & navigation
GPS, INS
Instrumentation
Data acquisition, display, processing, and archive
Radar Communication
Automobiles
Engine management
Fuel, ignition, timing
Emission control Instrumentation
Data acquisition, display, processing, and archive
Safety & stability
Airbags, active control
Entertainment & comfort
Radio, A/C,
Robotics
Implies autonomous operation N physical degree of freedom Artificial intelligence Control heavy Mission oriented
Repair, search, rescue, investigate, and perform physically difficult tasks
Process Control
Industrial automation Plant monitoring and production control Similar to control systems but with emphasis on management
Sensor Nets
Many sensor nodes each capable of sensing, computation/storage, and communication
Structure safety Search and rescue Military use
Energy Efficient Distributed
Modern Sensor Nodes
UC Berkeley: COTS Dust UC Berkeley: COTS Dust UC Berkeley: Smart Dust
UCLA: WINS
Rockwell: W INS
JPL: Sensor W ebs
Multimedia
An exercise in
Signals, analog to digital conversion, quantization, sampling, processing, and digital to analogue conversion Information theory, entropy, Huffman codes, compression, lossless compression Images, audio, video
Virtual Reality Quality of service Think lots of data (formats and standards too)!
Consumer Electronics
Home appliances
Yesterdays appliances: add computation Tomorrows appliances: add networking (Internet)
Office electronics
Integration Electronic paper (filing, printing, sending, and receiving)
Home/office automation
Common fantasy about the automated home or office of the future with lights and appliances that operate by themselves or with minimal effort
Network Components
Stitching LANs
Bridge
Connects two parts of the same network
Router
Link networks using different network identities
Extending ports
Switch
Transmit to recipient only
Hub
Transmit to all
Handle large volume of highly structured data with little transformation
Medical Instruments
Perform diagnosis (screening/evaluation)
Data collection Appraisal of that data Developing a plan of action
Observation or monitoring
Sensing and instrumentation
Accuracy and precision
Other applications:
Radiation therapy Artificial hearts, arms, legs,
E-Business
Information processing systems
ATM Cash registers Scanners Credit-card readers
Often the interface behind a database Automation and convenience
Bomb Detection & Localization
Stadium with Sensors Deployed Automatic Camera Feed Guard moves with an XSM Mote, tracked by RIPS technology
Google Earth Illustration of Localization System
~12 Static XSM Motes (positions known )
Architecture
Rad detector, mobile phone mote
Mote network
Tracking service and user interface
Rad level servlet and camera glue code Nextel/ Internet
Internet
VGA to NTSC adapter
Camera control node (Linux)
Jumbotron controller
Summary of Application Domains
Looked at a number of application domains Large amount of overlap between these domains
Often each domain has associated standards, design methodologies, and certification programs
7/13/2012
V.Sathishkumar
39
Embedded System Design Challenges
Low cost
Mixed digital/analog requirements
Light weight
Reliability
Shrinking time-to-market
Short product lifetime Real-time processing Inherent concurrency HW/SW co-design Secure
Low power
Portable
Complexity
Ease of use
7/13/2012
V.Sathishkumar
40
High-end: Embedded Processors!
1,000,000,000 100,000,000
Sony Graphic Synthesizer IBM Power4 NVIDIA NV30 GPU NVIDIA NV25 GPU Sony Graphic Synthesizer Intel Pentium 4 Intel Pentium III Intel Pentium II IntelPentium NVIDIA NV40
10,000,000 Number of Transistors 1,000,000
Intel286 Intel8086 Intel 486 Intel 386
100,000 10,000
Intel8080
NVIDIA NV20 GPU Motorola G4 AMD Athlon XP Intel Centrino NVIDIA NV35 GPU ATI Radeon X800
1000
7/13/2012
Intel 4004
Intel8008
1970
1975
1980
1985
V.Sathishkumar
1990 1995
2000
2005
41
7/13/2012
V.Sathishkumar
42
Embedded programming
Do You Need to Know This Stuff ?
7/13/2012
V.Sathishkumar
43
Computer Engineers You will build and oversee the building of these systems
All close to he hardware code resembles this The concern for correctness and predictability of embedded systems code is simply a more critical form of what we want for all code
Electrical Engineers You will build and oversee the building of these systems.
You have to work with the computer guys You have to be able to talk to them You may have to teach them You may have to take over for them
Computer scientists youll know to do this or only work on web applications (and the like)
7/13/2012 V.Sathishkumar 44
7/13/2012
V.Sathishkumar
45
7/13/2012
V.Sathishkumar
46
7/13/2012
V.Sathishkumar
47
7/13/2012
V.Sathishkumar
48
7/13/2012
V.Sathishkumar
49
7/13/2012
V.Sathishkumar
50
7/13/2012
V.Sathishkumar
51
7/13/2012
V.Sathishkumar
52
7/13/2012
V.Sathishkumar
53
7/13/2012
V.Sathishkumar
54
7/13/2012
V.Sathishkumar
55
7/13/2012
V.Sathishkumar
56
7/13/2012
V.Sathishkumar
57
7/13/2012
V.Sathishkumar
58
7/13/2012
V.Sathishkumar
59
7/13/2012
V.Sathishkumar
60