uNlT-lll

DESIGN SYSTEM MULTIMEDIA

3.1 Introduction
a iombination oftext Ytth Multimediameans imageis nothingbut a Document docum:nt t acsimile

adocum*i:T:*11 convsrting of scanningand ameans provided

is inthe form ofpixelsaswhiteor codedinformation i"r".r"i"ilThe of pixels whenthenumber manageable is easily black.Theinformation 'd-sizepage contains low. At 200 dpi (dots per inch)' an is 'nio;zzloautupoin

r.

&'$t'\4tAi'n

or higher' supports system imagemanagement Document l$gPi to reduce areused techniques pixelsrates'Compression Forthishigher time' andtransmission the storage it is [email protected]' is used, encoding run length Forcompression ThisisadoptedbyCCITTasastandardinlg80.Thisalsocalled LHuffirrun.ncoding] Another standardis adoptedin 1984is called 9rgq4' .vodimensiona ilg thedata' to compression for used It is

asCCITT St A grayscaleencodingis processed is an impoptantrole in Compressionand decompresbion is oneexample' informationcomponent'Videoconferencing

MULTIMEDIA SYSTEMDESIGN

3.3

.\i>"'

of conferencing includes, text conversatio$, The categories doct'rnent conferencing and$toreandfonuardvideo conferencing. h 1990,th"@was the userto conference from their own desk. introduced, itallows i

Grayscaledor color images sizesarqlargertoaccomodate the pixeil,color informafion. Scanning of document images with high resolution requires efficientcompression anddecompression technologies. 400 dpi ib neededto c. Photograpttq_Imrys Photographic images areusedfrequentlyfor imagingsystems that areusedfor identificationsuchas"badges, fingerprintcards, photo identi{cationsystem Aresolution imageon a laser essential for reproducing aphotographic

Compression is alsothekey to multimediaapplications. Video conferencing is oneapplication ofmultimedia. Theotherapolications includes

i!

Iications /f,trcar"ul app '7{X"ulestate on-line videoclips / . /

y' ryn ' y't""urity

ediahelpandtrainingmaterial system foremployee identifi cation

MultimediaElement Multimedia applicationrequire dynSmichandling of data consisting oftexg voice,audiocomponents an{ imageanimation.The components ofmultimediaincludes: a. FacsimileGSgu!= Facsimiletransmissibn was usesthe Group3 compression standards. It is alsoknown asrun-length encolii[f----t Thepixel densityusedfor facsimileare in the 100to 200$i range. b. Documentlmages The pixels usedfor documentimagesare startat 300 dpi. An uncornpressedA-size is over I MB.

d. Geographic Information Systems Maps (GIS) lTwo typesof technologies are usedfor sJorage: anddbBlryof geosraphic maDs. - -

storage ullo*r u tob" dirpluy"9 on" pfii Bgstel Tup etE&U@lis assigned andidentified bymapcoordinates. It

is storifilano$6ct datamanagement system. Another applicationcombinesa.raster imaees that hasthe basfu color mapandvector overlaysshowingthe rail roadsor highwaysand plS applicationsassociate attributedatawith the man-made stuctures andrelatethem to coordinatein a mapy' e. VoiceCommands Voicecommands arean input voicerecognition consideration. It allow hands-firee usage ofcomputer applications by allowingcomrnand entry via s@ ratherthan a keyboardor pointing device.

Yl@3-ryIression,

;l?rffi

u*--"eg@ compression, reduces approximatery I

the sizereduces to verylarge \

3.4

GRAPHICS AND MULTIMEDIA

MULTIMEDTA $YSTEM DESIGN

Recogn itionof thecommand and trggiryg!&4@@ues powerful processing capabilities tocomponstate forditr"."*o _______E_ in6il
f. Voice Synthesis Voicesynthesis is easiertoachieve thanvoicerecognition. This is usedfor fully stored message or actualvoiceclip thatwerestring together. Another appro0his to breakdown the message cgglglglde_ form based canconical on phonetics.Digital signalprocessor usedfor thisapplication. g. Audi0 Messages 'Computer equippedwith microphonescan record an audio message andattachitwith anemailmessage

3.5

i. Full-motion stored and live video CD-ROM technologrhasprovided thebasisfor thbdevelopment of full motionvideo. The application for this technology is in CD_ RoM games' courseware trainingmaterialmurtimedi"o"-;;;*i;,, andreferdnce materiar'vdeo ccinferencing, murtimedia ema', video karaokesystems andso on. An important consideration for fu' motionvideois theneedfor

v v rtvr (lEt ., -r . i lP.ottirlcman+cn-lL:^L r^,, recurelents andhighdensity highperformance comprcssion techniques.

;;;;;; ;ffi;ffi;:

r-

li::::y::::3"i0:otlTr loadbut to address peakload. TheNTSC

andpotentiallyTIDTV standards.

be designed not for average

quality

/, I

/ #Ji ::i:T:,"1,:1,T,i::n"orogy,wlrbe*;i*"i;;?"ff

It requirelargevolumeof storage so compression techniques attempttomanage the storage. of decompression andplayba , Thg speed with propercadence is crucial for the audioriressage playbackto be h. Video Message message, video message ffi canbe embedded or attached to emailmessage. Videomessage range from a singles'napshotto full motionvider clips. The storage andplaybackrequirements areevenmorecomple for video messages. ILis storedin a shared video dataserveran displayed at thereceiver w: Audio and video messages require isochronous playbacl Isochronous playbackis definedasplaybackat a constant rate.

andimagereco?sffiEiion-:

DigitalHDTV availability places another ma design, thatofspegial effects such aszoom,freezeframe.

on the mergmg

areexample for suchstandardization. .

Vdeo Interface and Indeo @VD definitions and,ipple;rA;il ff;#.:

Standardization effortsarein progress. Intel,sDigital

Ratherthan storethe entirepicture for eachframe. Only the deltas from one frame to the next are stored and the frames are reproduced on thefly. Theentireframeis stored attheresyncruonization interval. j. Hblographiclmages creatinga unique photographic image without the use o'."r. rrt" pr,"rer";ii". **ir, Holographyis defined as the meansof

ofthe imageis calleda hologram.

3.6

GRAPHICS AND MUITIMEDIA

MULTIMEDIA SYSTEM DESIGN

3.7

oftheoriginal tn-continuous-wave lase

k. Fractals --Fractals areregularobjects withahigh degree ofirregularshape. It is a decompressed images. ofthe landdo . Generallyimagesuchasmapsshowingfeatures not compress well usingGroup3or Group4 '''' " 1t fractal compression, image is broken intosegments. adigitized A segment canbea fem or a leaf. After breaking up the image into segments, the individual segments arechecked against a libraryoffractals. The librarycontains st ofnumberscallediterated a compact functionsystems thecorresponding fiactal. codes, which will reproduce fiactalmakes compression andtimbconsumingtask. a verydemanding arepart of the Once compressed, the algorithm for decompression storedimage. is based on imagecontent. . Fractalcompression As multimediagrowsveryfast,fractals will becomeanimportant component ofsomespecialized integrated applications. \ :

lightis directed onanobjectin uffi6o_.

phy,a bearn ofcoherentlaser

"Thebeamis reflected,scattered anddiffractedbythe physicar features ofthe objectandarriveson a photographic prateat the same time that a part ofthe originarbeamarsoarrives at the photographic plate. Thetwo beams cause interference, which resultin a complex pattemofsffipesandwhorrs.Thedeveropedprate is calred a horogram. Whencoherent light passes throughthehologram,thehologram actsasa diffraction grating,bendingor difhactin! someofthe right beams to_ exactlyreverse the originarconditionof therightwavesthat created theobject. Holography canalsobeachieved in color. Usingpulselaserholography, a moving objectcanbemadeto appear at restwhena horogramisproducedwith the extremery rapid andhigh-intensity flashofa ruby raser. This approach is usedfor aircraft wingdesign. Holographimages canarsoberecorded on alrthernateriarsexcept photographic plate. Oneapplicationofholograpf, ir, f,oilgruft, o1, creditcardis used to ensure authentication. A three-dimensional hologramprojected by a special display monitorwould allow thedesi gnerto getinsideajet engineandview the enginein motion fiom the inside. This technology is makingrapidprogress andcanbecome . an tmportantcomponent ofmultimedia systems usedfor managing design documents or for manufacfuring tasks.
i

3.2 MultimediaApplications

In variety of multimedia applications, docurncnt/image thatrequires storage management is thefirst widely usedapplications format. of largevolumeofdatain documentimage

. Secondimportantapp alsoknownasi

3.8

GRAPH ICS AN D MULT]MEDIA

MULTIMEDIA SYSTEM DESIGN

3.9

Document imaqe management is intended for scanning documents andretainingtheirimag"r but tgggg.relgg andimagerecognition areintended for recognizing objects by analyzingtheir rasterimages. Imageprocessing applications are usedfor g19oma11!g, flggr and so llspcclions or for guidingrg@fsperforming specialized tasks. Thenextmultimedia applications is,accessible to desktop users in anoffice environment. 3.2.1 Documentlmaging Organizations suchasinsurance agencies, law offices,country and state governmentsand the fsderal governmentincluding the department ofdefense manage largevolumesofdocuments. lpchnologies developedfor irnagingare an indespensable ingretientin the applications thatwill evolveto create the efficient combination oftext, image, sound andvideocalledmultimedia. fiocument imrgi"g makesit possibleto store,retrieveanrt r graphicalrepresentations ofdat4. It alsoprovideelectronicinterchange ofdata. Fora documentto displayon aA-sizeitneed100dpi. one ofthe application ofimagingisEgllicalglaims processine. it avoidthe reenteringinformationfrom cliims forms into a computer database. optical character recognitionsystems now automaticalry handle thetaskofdata entryofkey fields. Thescanningresolution for images is range from 400to 600dpi, thenonly it isabletoprintthemonhighresolution laserprinters ranging from 300to 600 dpi capability.

The images arestoredin compressed form andaredecompressed to therequired resolution at theviewstations for display. efficiencyis definedasthe ratio in bytesof an . Compression uncompressed image to thesameimage aftercompression. efficiencyof over 2$] ir considereq_llghly . A compression d"rirubl" fo, db"u-"n i-un", fo,-or, offiryr,.-.. At rhi, l"u.l, anA sizeBage at 300dpi requires 75kbytesofstorage. n (_AIldocument image systems areworkflows, workflowdefines thesequence for scanning images, performing qualitychecks, performing dataentrybased on the contents of the images, indexingthem and

rrl :'::l:.ffi;::ilTjfu"1s*
Realtime image decompression ard displayspecial demands cin imageprocessing hardware.
decom

4to 8planes, ide l6 colors,8 planes provide256colors.

Thelhegepanwgre alsocalled 6it plane usethey are addressed EitETln ab-yte. Thebitplanes maybe configuredin
banks of 4 to 16bit planes each. hundreds of pirelspernanoseconos. Gray scaleimagesmay requireshigher speeds due to the a9ditional gravscale infonnation .tor"d in theimage thatmakes theimage sizemuchlarger, evenin compressed form. Gray-scale imageconsist ofpixel thathaveshades ofgpay ranging from l6to256dependin

';. )\,

3.'t0

, \ GRAPHICS AND MULTIMEDIA

SYSTEM DESIGN MULTIMEDIA

3.1'l

Similar to gray-scale images,color irnages featurecolgr hues instead of shades ofgray. The numberofcolors that canbe depcited depends on the numberofbits usedto definethepalette. Forcompleximages with gray-scale andcolorthe storage of pixel information getseven morecomplex. 3.2.2 Image Processingf and Image Recognition synthesis andimagercc lndocument imageworkflow management system, the original imageisnotalteredbutin imageprocessing system rnayalterthecontent ofim4geitself. Examplesof imageprocessing systems applicationinclude as in factory floor quality assurance systeqg mageenhancement, bs in satElfifesuspect itlentificationsystems, and ladditionto the compression anddecompressiontshniques,

3.2.2.1 ImAgeEnhancement uses somelevelsof imageenhancement. . Most ofdisplay system hlgreasing the sensitivity and contrast makesthe picturedarkerby r, lof o/pixelf. '"''lftre \J capabilities ofimage enhancemnt softwareincludes: A, /, rlt. ,l I . Ifuasn IfuoSn dibrotion-The overallimagedensityis calibrated, mlibration andtheimagepixelsareadjusted is apredefined level. imageis alignedby real+imEfor WThe I twisting caused by improperfeedingof paper. ft:rhtzt 3. Gray-scale rnrmalization-The overallgraylevelofan image + is evaluated to determine if it is skewed in onedireotionandif ' itneedcorrection. 2.
. \ l

ry.

4.

- Too much color makesa pictureloud andfuzzy. Soautomaticcolor intensity within predefined adjushnent bringsthecolor intensity ranges.

prtrces:ing systems awiderangd ornploy ofdgorithms forobject

I to view

5 . CpypryttoA picturewith very Iittle colorcontrast canbedull andmaynotbringoutthefull detailofthepicture. sgpwlion-

lmage synthesisand reconstruction systemsmav use a to calculate

rseurEarvvvrvr I ,-\

6. Frameaveraging tln. intensitylevel of the frameis aTeraged to overcome theeffects o@ tongf feabgliustins themiddle
3.2.2.2 ImageAnimation Imagescanbedisplayed sequentially at controlleddisplayspeed to provide imageanimationthat simulates realprocessed.

lmage recognition exist in many form. Optical character ( cognition(OCR)consraintsthegeneral imagingproblemto a specific t ea,recognitionofprinted characters. Handwritingrecognitionis usedby thepostoffice for recognitioh of handwrittenzip codefor mail sting.
-\'

3.12

GRAPHICS AND MULTIMEDIA MULTIMEDIA SYSTEM DESIGN

Imageanimation'is a technology thatwasdeveloped bylhtt Disnevandbroughtinto everyt o-" in'trr"form ofcartoons. . Theimageanimationis usedin as @.h autqmobileeneines' Theparts aremoEeo as imagesusing @/ CAV rnrt"*r, this images canbe setup for automated displayin an on-linetraining or maintenance mantal. Sg_lrser motionofthepartanditsigreracliqn Fg_lrser @ 3.2.2.3 ImageAnnotation This automated displayallows to ctearly clearlyvisualizethr the

3.r3

3.2.2.5 Handwriting Recognition Recently, the motivationfor handwritingrecognition hasbeen from pen:besed systems. Penbased systems aredesigned to allow :._-=the usertowrite commands on anelectronic tablet. Thehandwriting recognition system hastheabilityto recognize writer independent continuous cursivehandwriting accurately in real time. Two importantfactors for handwritingrecognirion,IG;kb or shapes beingentered anather,6toF oiiiDuno.the vectlFthut is *-rrp".t --' The sfrokes areparsed andis process r. it iscomparE thestroke with existing shapes. Thestrokeis compared with theprototype character setirgtil a matchisfound.
//\'Y 1'-

-.

: :": :::":li::l':,':o

wavs : irryte

withtheo@fr6liE@ ffi

stored ar ong

ll3lri;

Prc! tl,requ irestracking multipte image components associ ared

spatial alignments astheyareoverlaved.

location

ctericalstaff worktoenterthedata,ro.n",i;:0*;tjr;il1t'fi ,H:l:

Dataentry work hasbecomemore

Ifthere is no matchfound,a contextana ier rmay mhv be used to check maybechecked against a dictionary andcorrections maybeindicated based on thematches.

,\e:dL

: :

opticar characterRecognition (ocR) technorogy used for data entryby scanning typedor printedwordsin a form. Now a daysocR is ava'abrein softwarewith thecapab'ity to decipher a largenumber ofprintedfontsusedin manydocument image applications. OCRtechnology, usedasa means ofdata entry may be used asa taskfor reading number of invoice or for capturing #;" ;;;**, oftext' The captured text wilr beentered asa fierd in a database or it is in theform ofeditabledocuments.

Comparision with predefine characters canbevery processing intensive.Theremay be morethan one setof characters usedfor cursive styles. Multimediasystems will usehandwriting recognition asanother means of userinput. Handwritten memosusingpen-based machines may be interpreted asreadoutwhentheyareacomplexdocument 3.2.2.6 Non Textual ImageRecognition In communication theverbalcommunication istheprincipalmade for exchanging information.ln cornputer, alsothefransformation ofthe

10

ute!^6{"-L'n2 inrnXe m
3.14 GRAPHICS AND MULTIMEDII DESIGN MULTIMEDIA SYSTEM

3.15

It

human-machine interface tlratcourd beachieved bymurtimedia interface. whichallow these inputsin addition to text Imagerecognition hasbecome a majortechnology componenr in thedesigning, medical andmanufacturing fi elds. The conceptof ipaggtecoexdtion architecture : for example, a system, it hasthreeprocessing generap$ognition layer.The tirrt i that extract biic features ---ru.n a. tt"eranO"U

3.2.3 Full Motion Digital Video Applicati ons,/ Groupwaretechnologyas createdand evolved by Lotus developmentcorporation is designedto get all membersof an via the corporate n6tworkwith an abilityto organization connected pictures, thatmayhaveembedded images andsome exchan!;e messages complexdocuments. groups Therearethreemajorapplication for full-motionvideo. nainingandmanualandBusiness world. The Theyaregameindustries, groups. thisapplication figure3.I describes

I -

shared bythe next processing rayer, it anerwork or+ooffitbfu;r

Datafrom thepixel arrayfeeds directlyinto a

l_GByteRAM

fedto another5l2-MBvte RA DSp layerto a areusedto performthedifferent-task ofobject and scene recognition. that conFthe chips thatperformfunctions suchastheartificiarretinaareabre to performa majorpartof imagerecognition at the instant theimageis recorded. For imagerecognition, technorogies trrathavea directapprication in multimediaaresignificantlymorecomplex. col onnectingvarioust human brain.
and

%
Pay-per viewnewspaper game (iii)CD-Rom interactive (iv)lnteractive W Games andentertainment
J

Figure3.l The bestexampleis group. forall theabove application Somerequirements besharable but should haveonly Full motionvideoclipsshould copy. onesharable to attachfull motionvideo clips to other It shouldbepossible documentsuchasmemos,chaptertext, presentation.

Therecognition offaciarexpressions canbringaboutanimportant newdelelopment in makingmultimedia applications interactive andmore intuitive.

.e

?o'ar' ib"-lt

3.16

GRAPHICS AND MULTIMEDIA MULTIMEDIASYSTEM DES IGN

"tk%h4
3.17

usersshourdbeableto takesections ofa video crip andcombine thesections with sections from othervideocripsto form theirown new videoclips. All thenormarfeatures ofa vcR metaphor suchasrewind,fastfoiward,playand search shouldbeavailable. Full motion videocrip shourd be indexed, it shourd be abre to search from anypointwithinthevideoclip. usersshouldbeabreto pracetheir own indexing marksto rocate segments in thevideoclip. It shouldbepossibre to view the sameclip in differenttypesof formatwithout storingthe format. It shouldbepossible for users to moveandresize thewindow displaying thevideoclip. Theusers shourd beabre to adjustthecontrast andbrightness of the videoclip andalsoadjustthevolumeqfthe associated sound. Users shouldbeabletosuppress soundormixsbundfrom other sources. Whenvideoclips arespliced, the sound components arealso spliced automatibally. These arcsomerequirements forthe above mentioned apprication groups. 3.2.4 Electronic Messaging The first-generationmair systems provided a basictext rink

Theavailabilityofother techno{ogies suchasaudiocompression and decompression and fulr motion video hasopenednew waysin whichelectronic mail canbeused.

a messaging system requires a @ sophisticated infrastructure consisting ofthefollowing to support it,

.. Message stoye andforwardfacility '' Message transferagentsto route message to their finai destination across various nodes in multilevelnetwork. ' / Usersstorethe message in repositories asthey storeit in a filingcabinet. -Repositories for densemultimediacomponent,,u.h.u, images, video,fimes, audiomessages andfull_motion video clips. Ability for multipleelectronic hypermedia messages to share the samemultimedia components residing in different networks. Dynamicaccess andtransaction managersto allowmultiple users to access, editandprint these multimediamessages. @iEs anenterprise network. messaging database. to locateusers andservers across ofdynamicelectronic

The sgcondgpneratien oferectronicmail systems expanded this capabilityby providing crossplatfl

gllwith acapabiliry to attach otherfiles.

Electronic messagingsystems,providing a means for communicating a varietyofmultimediacomponents, includes a number of otherworkgroupq?e applications.

3.'t8

GRAPHICS AN D MULTIMEDIA

DESIGN SYSTEM MULTIMEDIA

full Srtored motionvideo

3.'t9

Duetb the preponderance oftheseapplications they arecaller' mail-enabled multimediaapplications it havealsomultimediacapability It is veryclosed to universal multimedia application..

rhlp@s$
thefollowingissues.

tionswouldrequire to addresseo

*dgaratlospfrcrycr$
-2-4ompresslot*"h"l.lt Mthe

by datatype.
*s anddecompression techniques. datais cqmpressed anddecompressed andhowtheyhandlec

ow fetchinginformation from servers is handled for display in a manneracceptable to users.

3.2.s A Universal Multimedia Application

A Universal MultimediaApplication means thattheapplicatior manipulates datatypesthatcanbecombined in a document, displaye, on a scree{r or piinted,with no special manipulations thattheuserneeds toperform. Thedocument of thistypemaybea phonebook, a colorbrochur, with picturesanddrawings, a memo,a phonemessage, a videophonr message or Iiveteleconferencing. An important consideration for anuniversal application is th, methodology fordisseminators ofthe information on a network. Thefigure3.2describes theuserscreen fora universal multimedir application.

OLE launched application

Audioand vicleo control

Figure3.2 still video, a mix of windowsfor displaying In figure3.2,wesee in windowwith live session a videoconference images, anddocument by the remoteuser beingmanaged progress a remoteline desktop documents; awindow for scanned participating inthe videoconference, mail electronic suchas anda coupleofotherwindowsfor application publishing. anddesktop 3.2.5.1 Full-Motion Video Messages Electronic mail is an important componentof office with text-only for manyproducts.Email wasstarted communications to textualandnon-tqxtual thenit progressed attachments, document attachment. to allow embedding hasimproved mail capabilities Theelectronic may consist Videomessages andvideomessages. ofvoice messages or live videowith full-motionpictureandsound. ofvideo snapshots

3.20

GRAPHICS AND MULTIMEDIA

MULTIMEDIA SYSTEM DESIGN

g.21

-p|ar&T

Thetwo important factors to imprement the fuil motionvideo messages are,the storage and transmiftulofu u"rv la.e" oolum dataatahigh*,.

Early desktop videoplayers used a VCR metaphor for controlling a videoclip. Themetaphor for indexingis morecomplex. Somekeypointsusedin indexingof stored videoclip. l. Unless tivevideo is stored, indexinginformation is lostsincethevideocannot be repeated.

3.2.5.2 Viewer Interactive Live Video A live camera is used to projecttheplayerinto thescene.When combined with technorogies used to create a sense ofvirtuar'rearity, viewerinteractivity,canbecameveryrealistic. ---_ Thedifference between fut motionvideoandviewerinteractive videoisgivenbelow,

separately; sygchroniatloll! veryimpor(ant, synchronization -- , mustbeachieved beforeplayback. 3.).eVendingontheapplication,indexing information mustbe / maintained separately for videoandaudio components of a videoclip.

It is easyto manage decompression anddisplayof full motion videobut it is not samein live video. Full motion video is usefulfor messages and information dissemination, but rivevideocanbeused for directinteraction, medicalapplications manufacturing manufactunng applications applications andsoon. and on. I ;"'uo'.pprruauons

3.3 Multimedia System Architecture

Theimportant aspect of multimedia systems areit encompasses a largevarietyoftechnologies andintegration ofmultiplearchitectures interactingin realtime andits cap userlntenaces. Thedesign is it c-n ooerate ofthe multimedia system with the
special h.rdr',ard wifhnr rt chnnging the ^lnlicefion software.

-'f

rc"nnologies used for botharesame. grabbers have f'rame " b".n ur.d to"aptur.i-ugesfor livedisplay in a GIJIdisntav
system, it is used asan imageprocessorto displaylive video lmagescapturedfrom a camera. It also ullow th. usr.rto
irncooc ar nna *:*5i,

disolav multinle

Standardization of multimediasystembasedon numberof hardwardinterfaces usedforvideo animationandcompression boards. Device-independent application programming interfac"r!\!D, theapplicationiFindG!fident from thehardware, andit operate *ittr anyhardware or operating environment thatsupport theAPi. Common file formatareusedfor differenthardware architecture andoperating environmenl

3;2.5:3 AudioandVideofndexing Indexingis mostlyusedin vcRs. using index the usercanmark a position on tape. Indexingalrows thepersonviewingthe tapeto markthestartof a program,a conversation or somescene of interest.

3.22

GMPHICSAND MULTIMEDIA

DESIGN MUTT]MEDIA SYSTEM

3.23

TheAPIs allow the application to supporta largenumberof drivers, it can work with pheripheralboards,softwaredesigned to replace hardware, andnetworkinterfaces. Theboardleveltechnologies allowa boardto adaptanumber ofdifferent standards using microcode logic. softwarecompression anddecompression driverscanreplace hardware boards andtheAPIs allowsthe apprication developers to developapplication that canwork with software driversaswell as hardware drivers. Thefigure3.3describes thearchitecture ofmultimediaworkstation environment. Theleft sideis nonmultimedia system andtheneeded architecture for multimedia svstem.
Multimedia work stationarchetecture

3.3.1 High Resolution Graphics Display suchas MCA, CGA, EGA, VGA, 8514 standards Graphics for GUIs. highresolution andXGA uses Thefunctionofgraphicsandimaginghavethreelevels.f;rovided capabilities. monitorarchitecture with different of single by three classes acquisition memory also.servesI . VGA mixing: In this,theimage memorythereby fixing itspositionand ai thedisplavsource slzeon screen. and 2. VGA mixingwith scaling:Useof splar Klallows sizing izingthewi ndow pos itioning of imagdiT$Tffiefinedwii@Es causes the imageto beretrivedagain. 3. Dual-bufferedVGAm in a theoriginalimages maintain
image in a displav buffer.

Dual-buffer schemes

ap4ffi
Graphiqf userintefface

tu,r,r"O,"ffi
Multimedi4,tz drlver $dpfort

In all theseschemes, the actual sourceof the graphicsto be or the comboboard board,a motherboard mergedwith a separate itself boards Thenew qeneration ofMFG (ModularFrameGrabber)

System hardrryarc (Multimed1g,6rrabIed)

\ Add-onngltinyf,f devices and'p'ef,rpherals

Figure3.3

' purpose and.4Mbytesof general storage. processing (DSP)areusedfor image Processor Digital Signal graphics board throughanoptional34020based daughter thatintegrates pass VGA with double buffering. with through equipped 3.3.2 IMAArchitecture Framework MultimediaAssociatiory(IMA) hasa taskgroup Thelnteractive that' to deflre thearchitectural frameworkfor multimedia with a charter provide interoperabi Iity.

; 't

Theadd-on multimediadevices andperipherals includescanners, video camera vcRs and sound equipmentalong with their corresponding devicecontrollerandencoding hardware. ' Software driversis needed to providethe interface between the applica GUIs aredesigned to support windowsapplication.

3.24

GRAPHICS AND MULTIMEDIA

MULTIMEDIA SYSTEM DESIGN

3.25

The task group hastwo areaof concentration,i)

tlS deSttop

3.3.3 NetworkArchitecture for Multimedia Svstems large volumeofimages andvideomessages arebeingftansmiued throughLAN aswell asWAN usingAsynchronous Transfer Mode technology, it is developedby tfige.ailgasr" anTBBNt-'-----:---:corhmunrcatron. Theincreasing useofe-mailandgroupware products hasplaced extensive demands on thenetworking infrastructure ofcorporations. ln general networkcongestion canbeattributedto acombination ofthe followingleading causes; accessins thenetwork. .tiNumber of users ..frn"r"u""d computingpower andthe ability to run multiple applications concurrently. /' .{Transmission of largevolumeofdatasuchasvoice,dataand videomessages. -ffiased .tfr" traftic loudon existingbackbone networks.

defines theclasslibrari The IMA architectureis basedon defining.interfaces to a

fasources and it provide VOservices. fne ngure l.4d;;h thearchitecture@ce buses.

Multimedia architecture basedon interface bus

@
Application compatibility 'layer

of client/server architr.lu.. for a wide rangeof applications.

ive applications. S-&aphics intens ;|tffi and videobased multimedia applications thatiequire largevolumes ofdatastorage.

a. Task BasedMulti-level Networking

Network file server
area

Thebroadcastnetworksprovideauniformsolutionforalltasks, butnewtechnologies increased, it isnotsuitable to satisfr ttrefull demand. Groupware technologies havemadethe issueof customizing the networkto the taskmoreapparant. . $4 _b

'

.>/v';,,y'' 'r r'(

3.26

GRAPHICS AND MULTTMEDTA

MULTIMEDIA SYSTEM DESIGN

3.27

ft".'$" btok* down into followiag types based on .,^^._ tnelr requlrements for yolumGof data,sources-gfdalagud transfer speed;

@l$"-{b,(..t+ ffitatransfer for images I)inA

"

imagingnetworks,abackbone networkis used to provideimageserver, print serverandfax serverto hostlinks. O@t g4teway ed wlX!.stations. In a imagingnetwork,imagingobjectsareduplicated on host and it is discarded afteruse. This process is more complexin the network. ThenextSection discuss this issue irt server sidepointview. b.-High SpeedServer to Server Links Duplicationis definedastheprocess of duplicating anobject thatwill remainsynchronized with the souG astheprocess ofmainraining two or more &!.!!sal!el isdefined copies ofthe same obiectin a networkthatperiodically resynchronize to useEiGr andmorereliableaccess to tffi Everychange in areplicated copies ofan objectis immediately reflectedin the mastercopyandall otherreplicated copies to ensure thatthenextusergetd a fully updated version.Replication periodically rangefrom oneminuteto 24 hours. 3.3.4 Networking Standards + Ethernet and token ring are very well known networking standards.Increasing demands in the amountof datahansferandthe is attempt to rnovethebandwidth outof 100Mbi attemptto change thetopologyofthe network..

.ffita
J-Data

tr ansfei6iaTili5ind video cIips

dup Iicationsto userworkstations

ffi e p l

i ca ti oa nmong ser ver s Buttransfer of images ismore demanding than

text. :gp:n. pageof text may be as largeas A ZS kbytes,but evena blackand white imageofa pagemay rangefrom 60 kbytesto 220 kbytes, a gray scale orcolor imagerange from I Mbyteormore. Tlansferof audioand video clips are more demanding than imag.

onthe I l:f",rttp. technology used, avideo_phon" qruiityton rf_otionuil." o*;t#a" mayrange from2 seconds to a frame bei'g disprayed to 15to 30times asecond. Onemore problem ismom.ntufpuur"whileOirpf"Vi"!$. videoclip.
Higherclasses ofservicerequire moreexpensive 'ls rlr me seryers supporting theworkstation ruLrr
t

contains i.@nding

The userand the seler'plaoed in

:.

Atiott"ru,.iliEfisfer

is between seryers withinthenetwork

the samenetwork. For document

The Asynchronous TransferMode Topo designed for broadband applications in publicnetworks.Its designis applicable to high speed multimediacommunications in localarea networks.

q/ 3.28

."r-a
MULTIMEDIA SYSTEM DESTGN

GRAPHICS AND MULTIMEDII

3.29

contalnrng erthertext datapacketsor compressed images, rear-iim, ArM is usedfor transferring real-timemultimediadatain loca networksat speeds higherthan 100Mbits/sec.

groupthatdeveloped theFDDI standard for fiberoptic f*tt networkshasbeenat work since1984on a proposed FDDI II anda standard is evolving. The new standard takesthecurrentrealiticsinto account ahdis to allow for shielded pair aswell asunshielded pair 9eingdesigned connections in additionto fiber. Thecurrent wiring closetfor telephone connections canbetsed for immediate networkingsupport, andthis networkcanbeextended usingfiber backbones to link a variety. of networks. The ANSI standard for FDDI allows for singlemode&r from 100Mbits/ secto several gigabitsper secandlargedistance networkingandFDDI is well suitedfor highperformance backbone networksto complement andextendcurrentLANs. FDDI usingfibertechnology will alsoprovidethehighbandwidth rg.ggired for wo ed workgroupwith high *t t. "tDI "

,rrlJ!

_p;

ANSI.

standard andAIM is adopted ascell-switching rtaldJd

CCITTasthe ISDN.AIM wascloselvlinkedto the syr_rchronous optica

network that can operateat speeds rangingfrom I 00 to 622Mbits sec.

ArM hasevolved fromthatto rocar aswelraspublicswitche

AfM canmanage a mix ofdatatypes, includingtextdata, voic imageandfi.rllmotionvideo. Thedesign andfunctionality direction r ATM is guidedbytheATM forum andit is flexibreinoperations ovr 100Mbits/sec. FDDI (Fiber Distrrbu teC. Data InlCdace| Thecapabililies ofFDDI Network alow it to beconfigured in varietyofnetwork configurations a and it act as th" tl interconnects differenttypesof LANi-

AIM andFDDI tbchnologies reduce congestien in multimedia networks. fFe netwo* speea in eO *d L0! f{lttr/ qg9

The benefits of shared medianetworks areease of installation, lackofcommonequipment andconnectionless operation. Some difficulties arewiringexisting buildings andfaultisolation, is addressed by usingwiring hubs.
u ired hythquser; rdthgl

it requires the userto be capable of supporting the networkspeed.

t1

3.32

GRAPHICS AND MULTIMEDIA

MULTIMEDIA SYSTEM DESIGN

The hypermedia.document is a 4efinition ofa document andi sgl0f pointers to hernio l.ocate various ere t, ot!86-.nt. , The userss=srli4glg d6cqent, but thelocations of the variou components that constifutethe documentaretransparent. b. Hyperspeech Recenttrends of multimedia and cellular_phone network stimulated the of l-purposespeechinterfaces

3.33

l*".h rttr.sis isant

Some of,the terevision broadcasting standards includingNTsc, PAL, sEcAM, NHK andsoon. These standards rangein resolution f.o-;525 li*r fonNTf C to glg linesforFrench $aqdgrdl A workisinprogress forbringifig HDTV asa globalbroadcasting standards. The J services de a ll25USchanged thedirection from analoe to .----------digital. @ been developed andcommerc ializpd.

(/ ro, example,a mail message can be usedto *.n"*," hyperspeech file that a usercanbeingto navigate on a serective basi Instead oflisteningtheentiremessage theusercanjump from concetr to concept.So a usercanget a synopsis ofa reportin a very shor time. Handling remotely accessible voicemail in a similar manner ma eechrecognition to handi hyperspeech searches. Speechsynthesisand speechrecognitionrequire, hi1 micfoprocessors, d$ital signal processo.s, _performance code -

tra defin lines, Figure 3.5 showsthe progression of Rdsolution ofTelevision pi.tur...
motionl [video phone) video \-_Y |

"o

rrrr llo7\

frd

:lryl"s

decod insoTsoIG_ gding and

converting theanalog spe.c!intoacompu, W=lpgition, action'into-$Lgxt, oneimportant iffi oFbo-lhTpeech synther andspeech recognition is cadence thatis proper continuity of t, sequence ofhigbraT!g@ thespeech. 3,a.2 . Definti Televisionl
The developmentof computersin one side, parallely t development in electronicworrd is attempting to raisethe resoruti levelofcommercial television broadcastins.

vioeol \e!9!y'

l i .,,,, lrrGi
100K

I l
t

\'g
:
:

, Hiqher.

ioen-nition-\i
/-*

/-{ I (Fax);de-function ; digitatvideo /---S./ (Workstation) :

-\---l :

Wry|

qgyi

Al

Universal

l*

lffii tw/;

i
1M

@l-

:
10M

i Photosraph o!inj,,"jn
100M
1G

,ry

@fu" oi" ltusion

Figure3.5 The digital FIDTV is aohrmerciartj broadcast by 1997and,the UDTV is broadcast by 2000. Ttgere aresometectrnotqlie,n."frrury tojump from HDTVto UDTV.

3.34 It requiresthe deve.lopment

GRAPHICS AND MUTTIMEDIA

commerciany availabre price,highspeed video processins rs. and th I &r wAN. The developmen,otdtn Our.. industry fordisplay andcommunications,
tJsersin office wil beabreto experience studioquality ' UDTV resolution for videomessages andfull motio,n videodirpluy. ofcolor monitorat this 150 will

Thewandcanbeused to makesimpleselections with conventional mouse, orto performmid airtraceof runes. u @ to which it is atCached.
H--{-"'-^^r'"

Thewand,shaped likegsmall pistolwith a buttonon vrrsa * v top, P t u uses orientationinformationto thecomputer

A typical displayimagewith a 2550x 3300pixel resolution requires 7-5Mbits for uncompressed storage. A grayscare or coror imageofthe samesizerequires 7.5Mbytesofstorageforcompressed page.Also transferring 7.5Mbges on a r 0-Mbits/sec networkcan takeunacceptable d'ration ofseverar seconds. Timeis alsoanimportant factor.

Threedimensional displayareunderdevelopment. The2-D displaybased ontechnology developed for pilot. one implementation ofthis consist ofa vibrating mirrormounted thatcreates ona headband . d,ffiPdh"rri"""t i."g. m"t appears to float in space beforetheviewer. These displays arecapable ofoverlaying realtimevisualimages

@daturn"ffiism

t.nt
pointi d Displays. ngdevices ur""rr.n,to,nunipffirn-=a+
a 3D displaysystem.It is achieve.d usingholopphy 3-D technology areconcemed pointing with two areas; device

_w

' synchronizes the imagesothat,despite headmovement, the labels remainnextto the correctobjectno mauerwherethey arein thevisual
+

t .hniqu.r.

Holography usespamtelglgrs to project thered,blueandgreen cornponedts of lighttoprovide athree_dimensional effect.

The development of 3-D pointing devices and systems is an importantcomponent in mutlimediasystems. The universityof washington's seattre based HumanInterface ;wand technolory beingdeveloped for Digital EquipmentCorporation.

Thevirtual retina, theresultof another ongoingprojecton HIT ' lab, two scenes, oneto each eyeJ creating illusionofa 3-D display. :vntes th thetechnqlogies theuserhasto wearsomelri

derreloped byTexas Instruments Inc;uses laserofthree differenl6]6iJ

to projectimages onamovingsurface sweeping a 3-D cylindricaldiqpray volume' .1 Standardizedlibrary intefices such as the programmer's

Wlaboratory

isinthefore front"fr'"*

41erar

I I

r
3.36
GRAPHICS AND MULTIMEDIA

16

nnur-rrr*ro'osysrr*orsroN

V tf - { ' . - X - - . *-1f,rA6si

Initially the images displayin a l0_cubicfoot display, about 3 feetin diametor and r-r/zfeet high,visibrefrom a[ sides. The3-D images aremanipurated from SunMicrosystems Inc.*il;;;;. The displaywould beusedfor a varietyofapplication, ,u.h J, medicalimaging forprobingor operations,'biotechn"f"g, *l*, O,"O of situationalawareness apprications asair traffic contror.Another example,doctors/anarysts cantargetthe fuil heartcavity or specific partof a heartsueh asa valueto be displayed in 3-D. An interesting development with DSp,isflredevelopment ofFuzzy

digitalcellulartelephone system, digitalservice in harddiskdrives and faxldatamodems andalsousedin videoandaudiosignalprocessing forofticecomputers. The main manufacturers includes, Texas instruments, AT& T. NEC andAnalog Devices, in addition,DSp GroupInc;

D i g i t a l w i r e l e s sc o m m u n i c a t i o n ss . uch as Personal cordless phone areall applications of DSp. Harddiskdrivescontinueto grow denser andsmaller.ptgll4t_ pontributor to this miniaturization, ior asDSP

@rcessor is thekey@al

ofFuzry Gtsp).use Iogi. in.irrt'^;fu*interface ofthefuture.

lr-

a. DSPArchitecture andApplicatiors . DSf operating system architecture wouldcontain thefollowing subsystems.

resol utionfacsimileEGtili

s as well as

1. MemoryManagement DSParchitecture providedynamicallocation of arays from multiplesegments, including RAM, SRAM andDRAM. 2. Hardwareinterrupt Handling
.-!'->

gnto multimedia ?two-dimensional disJii| calculation, fuzzybtic allo;ffi C

fhe benefits of FLSps over DSps are the comqutallonal Pj. -* isbetterthanDSps. ' 3.4.5 Digit"l Signut gat uguHloeepebrqhipscontinues to grcwrapidly in the useof ICs. It alsousedin application suchasthe European.

It mustminimizethe intemrptlatency to ensure fastresponse for . real-time events. 3. Multitasking DSPs ' MultitaskingDSPs need real-timekemelthatplovidepreemptive multitaskinganduserdefinedanddynamictaskprioritization.

MULTIMEDIA SYSTEM DESIGN

3.30

3.3r
tomove fromone

GRAPHICS AND MULTIMEDIA

E@llowreaders

orto other do cumelFfrilCh_EsE isaglensionglfupertext I e.neFrol ot h)?e*ext in i thattheseelectonic

thatcan be

of devices, communicationbetweenlocal andwide areanetwork.

3.4 Evolving T.

a Systems

will also include virtualry anffiriiinforriration

conversion information.

rrnese documenffiiU Sl momn+ieer. **Orffi

fte encqrylg,ted-rdonnution *,lr conu"rt andu&F cuments theuserbas.d on*hr." tlrutur., iril-ru-t"d-*dwhat vnatequrpment equi tr is s
:-'------'-'"-'

in eleckonicstorage ru.h u

Multimedia applications usea numberoftechnologies generated for both commercialbusiness applications aswell asthe videogame indusfties. The gap between thesetwo areahasbeennarrowingasgame become morecomplex andmultimedia applications start makinguseof interactive videotechniques developed originallyfor gamesystems. The digitalTV will accelerate theintegration ofbusiness andgamesystem technologies. 3.4.1 HypermediaDocuments Technical andbusiness documents areincreasingly being@n in electronic form,theyalsoreadin electronic form. Fastnetworkallowedthis hypermedia documents. audioor full-motionvideo. Ithas iectssuchasimages, _
I
1
I

vailableastrg Lrqer's de.shop.

hypermedia documents.It is usedfor erectroniq mail andworkflow applications providea rich function@ariety '--- of --:'----':-+_ information t1pes.
^--l!--r: -

The flunctioqQ@foas introduced to diqpbX_vi deo-glip,rjn . hypermedia products documents. such as Lotus Notesusethese teaturesto provide hpermedia capabilities.

rer*-pt,*inbinin@ organized access to Ooiu

Hf.r"T-TirobreTwh@e
ts

documents, thehypermedia documents needs to storeonryreference to the documents.Thesereferences areresolvedbeforethe document is presented to theuser.

this the embedded components may arsobe in"tuffin",

In

Hypertextimplements theo.g-i-tion @ natural associations of informu,to@ suuctre paperbased in as text documents. , ' It allowsauthors to link information together create information paththrougha largevolumeofrelatedtext in documents. annotate existing text pnd appendnoteffi bifiEErap-hic , information or to otherreference material.

,.
3.38

N.. .f7.

.nd$"q

."rft.,f"r\ql

1P{)
MULTIMEDIA SYSTEM DESIGN

GRAPHICS AND MULTIMEDIA

3.39 I cellularphone is a major4pplication

4. Inter Thsk Synchronization and Communication - Mechanism for intertask communication includemessage queues, sgmaphgrgs, shared memoryandquick response.u"nffi+ 5. Multiple Timer Service
. Jhe ability for the developer to set system check interrupr managedtimers to control and syn _.. real-umeapDlrcattons.

9igital celltilarplpne. transmissions atISDN DSPswill

l. u*d rou""o*plirtt,h" -od".', -u,h-in,"n*trrJffii*i*irugh at moduldio*,Oemoaul modem data rate undryrt"* po*t.onrurnption. s
devhloped by TI, IBM and Intermetrics for multimediawork, will

6. Device-IndependentVO twoformof interaction-

1,

3.5 Defining Objects for Multimedia

. use ofDSP hasevolved fromtraditionar generarpurpose DSp to application specific andcustomir" DSPdevelopedto providefunctions such ascommand execution anddeviceinterfacing. DSParchitecture werealteredto allow designers to takebetter advantage ofthe directionin whichtheywereheading.Thisis theway for development of DSPfrom puremathengineto general purpose DSPandthento anapplication specificDSp. An application specific DSp is designed for oneapplication-used by a largenumberof users a customizable DSp is designed to beused by a largenumber of similarapplications. imcdia components suchasfacsimile transmission images, holograms, interactive video,live video,audioandsoon arethedata typesstoredin multimediaobjects. These datatypes requiredifferentwaysof handline thedataand processing for storage andptrieval. Thebasictypesincludetext, image, audio,holograms andfullmotionvideo. 3.5.1 Text Text is a simplest datatypeandrequirevery lessstorare._Text andcanbeindexed, r"urffiffi-* flatatypecanbefieldsin adatabase Textfieldsareur"d fo. nm"r, udd**r. andavarietyofdataattrib,r6il-An electrgnic mailEessagec interface logic andsoon. d"rcripti

--

suchas -eld ------name and location ofrecipient, name and location ofsenderand so on.

3.40

AND MULTTMEDTA 9RAPH|CS

' 'Themajorattriblte oftext include paragraph styling,font families -ancisizes. .F*-Hypertextis anapplicationoftext to providea search of specidc tr"l rtt

includes Thevisibleimages from avideocamera. captured photographs andstill frames somedurationin a bitnaP by inputdevh. Al@iTrg from, is captured ned of pixelsin predefi gy to capture thecolorandintensity niethodolo x grid. The grid canrangefrom 340 240to 600pixels/inch.
?-

is3subqbiect. otherobiect include images, souna and full motion videol

3.5.2 Imases
r-

Imageobjectswillberepresented in graphics orencoded form,andno qrrecr renuonshlpbetween successive representation in time. It includedatatypessuchasdocument imug"r, fu"ri-ile systems, fractals, bitmaps, metafiles andstill pictures. Thefigure 3.6describes a hierarchy ofthe objectclasses uflder images. ImageHierarchy

atthetarget. sothatthe imagecandecompressed Therearetwo waysto handlethir; ont it ull i*ug"tffi method,sono needto store in onespecificcompressed compressed ln thisthereisno system. usedin multimedia Anotherapproach on thetype andsource method.lt common may from scanner scanned form"t Soinffiation ofimagefile. is a aboutcompression

b. Nonvisible --as butdispiayed asimages Noffii6Glmages arenotstored tet leralfgauge. example pJpssureauge, images, c. Abstract Ir
asreal-world thateverexisted imases arenot images Abstract arithmetic based on some images theyarecomputergenerated obiects:
,/

<. calculauons.

3.42

GRAPHICS AND MULTIMEDIA

xo?llter senera
Thediscrete functions resultin stilr imagesthatremain constant on a temporalscale.

Fractal' areexamplbfcir abstfact-images,lit -.rEbverirr is r o r result vrutt

of D some UIIIS
vr

3.6

Itimedia Data fnterface Standards

theelectonic

industryandtelephony/telegraphy industries hasbecome thebasis of computer multimediastandard ization. standardization ofmultimediahasbeen necessaiy dueto itsnature documents, a varietyof ttq[ge pi;tfo.-s a"d userworkstation on the same hetwork shar"dby multiple use

@functions suchoperation

areusedto showanimated imagesand .

3.5.3 Sudhq$ voice ^

Storedaudio and voice objectscontaincompressed audio similarto videoobjec! havea time dimension if, i {1freg!.ncy andpitch is very important, I. Soplay theaudiothe speed should#tin constant rate.
\

Thesolution for theabove problem is standardization will bein sgele$.' Jb" rt""d".dr "re 1"""-d t nrmrizlo fo^L-^l^-, ^ J---^ ^ - -- :/r prwide technolory advances withoutaffecting ottE tuffi
For eachlayerthereis a well definedsetof interfaces. 3.6.1 File Format for Multimedia Systems
i

The areaof standard file formatsandfiIe interchange format is verydynamic. Thefirst standardizationoffile formatis in Microsoft windowsandO Thefollowinglist givesthefi le storage forma! interchange format andapplication programming interfaces to multimediadevices. - This is a file format <t thatcontain bitmap,cororandcororparefte information. F - Resources ty.t.lt""g. el" e. e standard diffirmat----

andanysoundannotation 3.5.4 Full-Motion and Live Video

FullMotion Video is,it isprestored video crips, rive video means, itis liveandbeprocessed whileit isbeing captured bythe.u,nrru.
to have theinformation about I@"portant that the videoaspresented to the

os/2.
Wntic
,

t"rt "-""totryl 2.vtrrt""t 1 ttan instrument

Interface (NflDI)- Thisinterface r andmusical

decompression unitthenit pffi

3.44

GRAPHICS AND MULTIMEDIA

DES]GN SYSTEM .MULTIMEDIA

R r FCstDT '
..1'

-A MIDI formai DigitarInterface -oIlu"sicar instrument .-+-:withina RIFF envelop provides a moredmple;fiGEF - - -----r'-7ul"*FileFormat/ @resentationasRGBvalues.
Audio File Format A disital filr

r.o.zv$:g rlgggllg st"ndurd1

and Apple'sQuickTime,Intel'sDVI @igital VideoInterface) widely formatthatwereused aretheearliest Microsoft'sAVlstandards workstations. for commercial 1. Intel's DVI wasdefinedto providea

?(-V \

d pvt

F
\^l$?
il/ h^YT

ZQ.n A

f"rt e"-"t (nfF) {his format allows embeddinl FileFormat (wMF) - Thisisavector graphit
chips ranges a varies for displaysin requirements designed custom DVI. Forexample designed to support andprocessor chipis lntel'si750B. based low end,software for enhancing Thechipi750B isdesigned PCvideoandit canbeusedasa accelerator. that it can operate DVI chip hasthe advantage A dedicated with theprocessing in realtime andshare videoprocessing software by DVI technolory,fastercentralprocessors the hostCPU. Enhanced canprovidebetterimagequality. graphics, audibandfull high-resolution Manipulatingimages, power. AdvancedDVI chips motion video cantakethe processing and DVI boards will boost power. DVI silicon gelieson a to run it givesDVI chipsthepotential programmable videoprocessor, algorithms. a range ofvariescompression 3.6.3 Apple's QuickTime to support designed byApple computer, developed This standard "multimedia to be gap$c standatd applications. Quicktimeisdesigned l Thqvarious data qTns hasshown comp6nents granhic fortime-based . inthefigure3.7.

graphics andotherfile formaiswithin a documenl-

]@$3
formatused by

MultimediaMovie Format(MMM) - This formatused for digital videoanimation-

/fApp$l!ryfqrmat
for@ime

- Thisfoqnatdefinedas a standard
enabled system. This is the setol ontrols.

DigitalVideo CommandSet(py$l)-

Video-MediaControl Interface includingplay, rewind,recordandsoon. 13.3pdg's Audio Interchange File Fqrmat- Apple's standard . fiG f" e data. Messaging (VIM) - Developed {,{ Vendor-Independent by a cross product messages. I 5. SDTSGIS standard-The gpatiarDataTransfer standard is __ defined to providea commons@ic andcartographic data.
12
.a'

3.46

GRAPHICS AND MULTIMEDTA

MULTIMEDIA SYSTEM DESIGN

3.47

Componentso

imeArchitecture.

AVI compatible hardware allowsenhancingperformance through hardware-acclerated compression algorithms.suchasDVI andMpEG

3.7 Multimedia Databases ' Y f) y

lmagec6mpression

docum?nt gndapplications.

i
Component rw(ager

Figure3.7 Thedefinition of-QuickTime has bden extended to include the

following . Systemsoftware
-........'_s

managementsystem. . Provide simultaneous access to multipleusers. . Improvement ofmultidimensional information flowwithinthe

orgtuilzz[ron.
-e

. -FileFormat

. C_ompression / Decompression algorithm . HumanInterfaceStandard. 3.6.4 Microsoft'sAVI : Microsoft'sAudio Vdeo

Reduction oftime andmoney spent onphotocopvine bv reducins theneedfm distributing multiplepaper copies. Facilitation of rapid and correct responses to reiluestsfor rqonnatlgtl throughstored visualinteraction. . information into a manageable !>nversion of paper-based oocuTlents.

Interface Standard, similarto Apple's Quick rime, offerslow-costlow resolutionvideoprocessing for the averagedesktopuser* AVI is a layeredproduct,softwareonly solution. This standard play I 5 frames/sec of v,ideo in a I 60 x 120pixel windows. AVI is scalable andallowsusers to setparameters suchaswindow size,framerate,qualityandcompression algorithmthrougha number ofdialog boxes.This allowstheusertoadjustthe operatingparameter n based on otherapplicationin use.

3.7.I Multimedia Storage and Retrieval

irements for retivelandsoon.

3.48

GRAPHICS AND MULTIMEDIA

MurrtmeorA sYsrEM DEstGN

3.49

a. Massive Data Volumes Paperrecords, andfil-lgrtup"r search andaccess anddistribute. * diffi"ultto irt"$"te, l, old andinfrequently reference documents for some periodoftime. "{. frIdtimedia Object Storage

requires Locatingpaperdocumenbfilms andaudioor videotapes masgive files,andrequire majororganimtional searching through storage proper to theiroriginal sequence eftirtto ensure thattheyareretumedin locations. storage locating. Indexingis alsomorecomplexthan
G

afurpermedia
require vfy_de0se-storage. For example,a Sr"4.edia l2 inchopticaldiskplattercanstore 99y!9r of information.. $ Full motionvideoandaudio,th.thirddir*rtgryltime itimpact on the sizegf the compressed data. For example8-bit soundclip requires 50kbytes/sec. Similarly, avideoclip requires 1.5MbitVsec. The speed ofretrival is imporlantconsideration,.it depends on storagelatencysize of data,transmission media and speedand tS--'--------.-..-_-decornpfe$f9n_efldency. Indexingis essential for fastretrieval of information. d. Multimedia DocumentRetrival Ide.ntifyinga multimedia documentis bv storaseolatter ' i,aeginCefiOd andits.relative These objectscan no"itionon

l l
I
"l I

b. StorageTechnologies film, audio,or videotapes and Storingof informationon paper, of data,text andgraphics. directcamerainput aresi4ilar to the storage But it is very slow andthefailurerateis high. documents. mediumofmibrofikn thephysical from failuredamalges Recovery andit cfi selossbfrT6ffi ation. a high levelof mechanical Microficheandmicroflim it produce of microfilm media. deterioration failureandphysical thisnoise factoris it printed from in documents problemandit disturbing cause compression microficheormicrofilm. ofmultimedia technologlfor a storage storage Therearetwo mass documents; -.l5pfical and systems storage

. i

Accessing obiectsin the multimediaobjectdirectoryfunction. __-------_--Anothera@otion videoistheability to clip partsofit andcombineffih with another set. 3.7.2 DatabaseManagementSystemfor Multimedia Systems of different forms of informationincludingtext, fhe storage for application developers and @llenge database managers.

Managing a few optical disk platters is much simpler than managing a muchlargermagneticdisk farm.

3.50 '

GRAPHICS AND MULTTMEDIA

MULTIMEDIA SYSTEM DESIGN

3.51

l i

Mostofmultimediaapplicationsarebasedoncommpnications technologies suchaselectronic mail,thedatabase systein mustbefully

b. Object-Oriented Databasefor Multimedia The main principleof objectprogramming is codereusable, modularityandease ofmaintenance. once the classis defined,alr the objectswithin it are given attributesof the class. class definitionusedfor deyelopingand maintainingcomplexmultimediaapplication in additionto itsuses. Object database capabilities includes,message passing, extensibilityandhierarchical structure areimportantfor multiinedia systenis. essage Passin lows objectto interact by invokingeach iocess ofhandlingoffdata from onecomponent of application to another. *---)
other
*-",r,-'"-_,-.

theexistingRelational Database Management System

tendingRDBMSto

ide objectprogrammin

ing theobject-oriented database that supportstandard thedatabase andtheapplication to oriented

Multimediaapplications combine all typesof datai.e.,textual, nontextual video, audioandsoon. Key limitationofrelational database system for implementing

thatthesetof operations, /Fxtensibility mgans structures.and consFdfurtstlTafa-re available to operations arenot fixed. Developers candevelop newoperations for theirown applications. Threekeyconcepts ofobject-oriented software technology that areimportantfor multimediasvstems:

ffiapsulation
?F6i.t*iation

-)-Qfassification

cruJriu*iltlfined
alphanumericform of data. For binary and free form text it usethe datatype Binary LargeObject(BLOP). It is usedfor images or other datatypes. linary Relational database tableinclude thelocation information for the BLOBS. The extended relationaldatabase provideobjectorientec environment thatsupport bothencapsulation andinheritance.

supportfunction suchas dataconversions andpresentation of data adopted to theuserenvironmeni. Hsu.!"fig softwaiei,

todescribe rear worrd entities, it also

is one of the advantage of object oriented

theapplication to knowtherrnrti*ing;I;;rh"ila. {oesnotneed tt

3.52

GRAPHICS AND MUTTIMEDIA

DESIGN SYSTEM MULTIMEDIA

3.53

Theinheritancemechanism ailowsbuildingobjects rapidtywith created by inheritingtheathibutes andmethods ofexistingclasses. 3.7.3 DatabaseOrganization for Multimedia Applic"tio^ The following are somekey issuesof data organization for multimediasystem;
--1

Key features . Multiple independent in system. datastructure . Uniformdistributed byclients. access . A singlepoint for recovery server. ofeachdatabase . Convenient to suit requirement. datareorganization
a

r{Data Independence ,.-T CommonDistributedDatabase Architecture

,-24

ofobjectsclasses. Tunabilityandcreation Expandability.

d:Diqibured Database Servers

'/2

3. Distributed DatabaqqServeril serversaie a dedicatedresourceon a Distributed database to a numberofapplications. networkaccessible andthe serveris built for gowth andenhancement Thedatabase anddistributed to growtheapplication theopportunity networt provides to thedata. access 4. Multimedia Object Management

o{Mult'

med ia ObjectManagement

1. Datalndependence Flexible access by a numberof database requires that the data beindependentfrom theapprication sothatthefutureapplication can access the data. Key features ofdata independent designs are,
a
-#

Storage design is independent of specificapplications. Explicit datadefinitionsareindependent ofapplicatignprograms. Uwrs neednot know the physicalstoragestructureand data format. Integrity assurance is independent ofapplication programs.
sls.

a'

ofmultiplecopies. storage will not supportthe This system Managementfor Multimedia System 3.7.4 Transaction that of events asthesequence is defined Multimedii transaction editor print a hypermedia to display, request starts whena usermakes document. thehlpermedia whentheuserreleases Thetansactioniscomplete thecopy in back. The editedversionanddiscard documentandstores memory.

. Recovery is independent ofapplication program. 2. Common Distributed I)atabaseArchitecture The insulatio d distributed application accesspresent the opportunity to employ common distributeddatabase architecture. -

I
i 3.54 GMPHICSAND MULTIMEDIA
I

During the courseof transaction the usermay add new data elements, includinglive full motionvideousingvideocamera attached to theworkstation. In a general datatransaction, it become morecomplexwhen datahasto beretrievedfrom multiple dataffi useruntilall of itscomponenb areavailable for display andnegotiations

I
I I i
I

' i l
{.
I

I .l

MULTIMEDIA SYSTEM DESIGN

3.30

3.3r
tomove fromone

GRAPHICS AND MULTIMEDIA

E@llowreaders

orto other do cumelFfrilCh_EsE isaglensionglfupertext I e.neFrol ot h)?e*ext in i thattheseelectonic

thatcan be

of devices, communicationbetweenlocal andwide areanetwork.

3.4 Evolving T.

a Systems

will also include virtualry anffiriiinforriration

conversion information.

rrnese documenffiiU Sl momn+ieer. **Orffi

fte encqrylg,ted-rdonnution *,lr conu"rt andu&F cuments theuserbas.d on*hr." tlrutur., iril-ru-t"d-*dwhat vnatequrpment equi tr is s
:-'------'-'"-'

in eleckonicstorage ru.h u

Multimedia applications usea numberoftechnologies generated for both commercialbusiness applications aswell asthe videogame indusfties. The gap between thesetwo areahasbeennarrowingasgame become morecomplex andmultimedia applications start makinguseof interactive videotechniques developed originallyfor gamesystems. The digitalTV will accelerate theintegration ofbusiness andgamesystem technologies. 3.4.1 HypermediaDocuments Technical andbusiness documents areincreasingly being@n in electronic form,theyalsoreadin electronic form. Fastnetworkallowedthis hypermedia documents. audioor full-motionvideo. Ithas iectssuchasimages, _
I
1
I

vailableastrg Lrqer's de.shop.

hypermedia documents.It is usedfor erectroniq mail andworkflow applications providea rich function@ariety '--- of --:'----':-+_ information t1pes.
^--l!--r: -

The flunctioqQ@foas introduced to diqpbX_vi deo-glip,rjn . hypermedia products documents. such as Lotus Notesusethese teaturesto provide hpermedia capabilities.

rer*-pt,*inbinin@ organized access to Ooiu

Hf.r"T-TirobreTwh@e
ts

documents, thehypermedia documents needs to storeonryreference to the documents.Thesereferences areresolvedbeforethe document is presented to theuser.

this the embedded components may arsobe in"tuffin",

In

Hypertextimplements theo.g-i-tion @ natural associations of informu,to@ suuctre paperbased in as text documents. , ' It allowsauthors to link information together create information paththrougha largevolumeofrelatedtext in documents. annotate existing text pnd appendnoteffi bifiEErap-hic , information or to otherreference material.

MULTIMEDIA SYSTEM DESIGN

3.30

3.3r
tomove fromone

GRAPHICS AND MULTIMEDIA

E@llowreaders

orto other do cumelFfrilCh_EsE isaglensionglfupertext I e.neFrol ot h)?e*ext in i thattheseelectonic

thatcan be

of devices, communicationbetweenlocal andwide areanetwork.

3.4 Evolving T.

a Systems

will also include virtualry anffiriiinforriration

conversion information.

rrnese documenffiiU Sl momn+ieer. **Orffi

fte encqrylg,ted-rdonnution *,lr conu"rt andu&F cuments theuserbas.d on*hr." tlrutur., iril-ru-t"d-*dwhat vnatequrpment equi tr is s
:-'------'-'"-'

in eleckonicstorage ru.h u

Multimedia applications usea numberoftechnologies generated for both commercialbusiness applications aswell asthe videogame indusfties. The gap between thesetwo areahasbeennarrowingasgame become morecomplex andmultimedia applications start makinguseof interactive videotechniques developed originallyfor gamesystems. The digitalTV will accelerate theintegration ofbusiness andgamesystem technologies. 3.4.1 HypermediaDocuments Technical andbusiness documents areincreasingly being@n in electronic form,theyalsoreadin electronic form. Fastnetworkallowedthis hypermedia documents. audioor full-motionvideo. Ithas iectssuchasimages, _
I
1
I

vailableastrg Lrqer's de.shop.

hypermedia documents.It is usedfor erectroniq mail andworkflow applications providea rich function@ariety '--- of --:'----':-+_ information t1pes.
^--l!--r: -

The flunctioqQ@foas introduced to diqpbX_vi deo-glip,rjn . hypermedia products documents. such as Lotus Notesusethese teaturesto provide hpermedia capabilities.

rer*-pt,*inbinin@ organized access to Ooiu

Hf.r"T-TirobreTwh@e
ts

documents, thehypermedia documents needs to storeonryreference to the documents.Thesereferences areresolvedbeforethe document is presented to theuser.

this the embedded components may arsobe in"tuffin",

In

Hypertextimplements theo.g-i-tion @ natural associations of informu,to@ suuctre paperbased in as text documents. , ' It allowsauthors to link information together create information paththrougha largevolumeofrelatedtext in documents. annotate existing text pnd appendnoteffi bifiEErap-hic , information or to otherreference material.