Introduction Materi Minggu 1 – Pendahuluan Sistem Multimedia – Casi Setianingsih
Sistem Multimedia
- Signal Processing
- Image Processing
- Audio Processing
- Video Processing
Sistem Multimedia
Istilah “Multimedia”
Terdiri dari dua bagian :
Multi (multus) : “numerous, multiple”
Media (medium): “middle, center”. Agen untuk
sesuatu, digunakan untuk mendistribusikan dan
merepresentasikan informasi.
Secara umum, multimedia dapat didefinisikan
sebagai penggunaan multiple agent (agen ganda)
seperti teks, audio, video, citra untuk
mengirimkan dan mempresentasikan informasi
kepada pengguna.
Istilah “Media”
Dapat dikategorikan menjadi beberapa
kriteria :
Perception media
Representation media
Presentation media
Storage media
Transmission media
Perception Media
“Bagaimana manusia memperoleh
informasi”
Kita memperoleh informasi dari apa yang
kita lihat dan apa yang kita dengar
Media Visual:
Text, graphics, images, video
Media Audio:
Music, sound and voice
Representation Media
“Bagaimana informasi diencode di dalam komputer”
Bagaimana informasi direpresentasikan secara internal
kepada komputer.
Beberapa Pilihan :
Text is encoded in ASCII
An audio data stream in PCM (Pulse Coded Modulation)
Image in JPEG format
Video in MPEG format
Presentation Media
“Media apa yang digunakan untuk memasukkan ke
komputer dan mengeluarkan informasi dari komputer”
Merujuk ke device-device fisik yang digunakan sistem
untuk mereproduksi informasi untuk manusia, misal
device audio dan device visual.
Input:
Keyboards, cameras, microphone, Head Mounted Device
(for VR input)
Output:
monitors, speakers, printer
Storage Media
“Dimana informasi disimpan”
Merujuk ke berbagai macam benda yang
menyimpan data komputer, seperti magnetic
tapes, magnetic disks, or digital optical disks
(CD-ROM, CD, DVD)
Transmission Media
“Media yang digunakan untuk
mentransmisikan data”
Merujuk ke benda fisik seperti berbagai jenis
kabel, (coaxial cable, twisted pair, fiber
optics), radio tower, satellite – yang
mentransmisikan sinyal telekomunikasi.
Perbedaan antara media transmisi dan media
penyimpanan adalah kapabilitas untuk
mentransfer dara secara kontinyu melalui
jaringan komputer.
Image Processing
Bagaimana komputer melihat?
Key Stages in Digital Image Processing
Image
Restoration
Morphological
Processing
Image
Enhancement
Segmentation
Image
Acquisition
Object
Recognition
Problem Domain
Representation
& Description
Colour Image
Processing
Image
Compression
taken from Gonzalez & Woods, Digital Image Processing (2002)
Key Stages in Digital Image Processing:
Image Aquisition
Image
Restoration
Morphological
Processing
Image
Enhancement
Segmentation
Image
Acquisition
Object
Recognition
Problem Domain
Representation
& Description
Colour Image
Processing
Image
Compression
taken from Gonzalez & Woods, Digital Image Processing (2002)
Key Stages in Digital Image Processing:
Image Enhancement
Image
Restoration
Morphological
Processing
Image
Enhancement
Segmentation
Image
Acquisition
Object
Recognition
Problem Domain
Representation
& Description
Colour Image
Processing
Image
Compression
taken from Gonzalez & Woods, Digital Image Processing (2002)
Key Stages in Digital Image Processing:
Image Restoration
Image
Restoration
Morphological
Processing
Image
Enhancement
Segmentation
Image
Acquisition
Object
Recognition
Problem Domain
Representation
& Description
Colour Image
Processing
Image
Compression
taken from Gonzalez & Woods, Digital Image Processing (2002)
Key Stages in Digital Image Processing:
Morphological Processing
Image
Restoration
Morphological
Processing
Image
Enhancement
Segmentation
Image
Acquisition
Object
Recognition
Problem Domain
Representation
& Description
Colour Image
Processing
Image
Compression
taken from Gonzalez & Woods, Digital Image Processing (2002)
Key Stages in Digital Image Processing:
Segmentation
Image
Restoration
Morphological
Processing
Image
Enhancement
Segmentation
Image
Acquisition
Object
Recognition
Problem Domain
Representation
& Description
Colour Image
Processing
Image
Compression
taken from Gonzalez & Woods, Digital Image Processing (2002)
Key Stages in Digital Image Processing:
Object Recognition
Image
Restoration
Morphological
Processing
Image
Enhancement
Segmentation
Image
Acquisition
Object
Recognition
Problem Domain
Representation
& Description
Colour Image
Processing
Image
Compression
taken from Gonzalez & Woods, Digital Image Processing (2002)
Key Stages in Digital Image Processing:
Representation & Description
Image
Restoration
Morphological
Processing
Image
Enhancement
Segmentation
Image
Acquisition
Object
Recognition
Problem Domain
Representation
& Description
Colour Image
Processing
Image
Compression
Key Stages in Digital Image Processing:
Image Compression
Image
Restoration
Morphological
Processing
Image
Enhancement
Segmentation
Image
Acquisition
Object
Recognition
Problem Domain
Representation
& Description
Colour Image
Processing
Image
Compression
taken from Gonzalez & Woods, Digital Image Processing (2002)
Key Stages in Digital Image Processing:
Colour Image Processing
Image
Restoration
Morphological
Processing
Image
Enhancement
Segmentation
Image
Acquisition
Object
Recognition
Problem Domain
Representation
& Description
Colour Image
Processing
Image
Compression
Aplikasi dari Image Processing
Document Handling
Signature Verification
Biometrics
Fingerprint Verification /
Identification
Fingerprint Identification Research
at UNR
Minutiae
Delaunay Triangulation
Matching
Object Recognition
Object Recognition Research
reference view 1
reference view 2
novel view recognized
Indexing into Databases
Shape content
Indexing into Databases (cont’d)
Color, texture
Target Recognition
Department of Defense (Army, Airforce,
Navy)
Interpretation of Aerial
Photography
Interpretation of aerial photography is a problem
domain in both computer vision and registration.
Autonomous Vehicles
Land, Underwater, Space
Traffic Monitoring
Face Detection
Face Recognition
Facial Expression Recognition
Hand Gesture Recognition
Smart Human-Computer User Interfaces
Sign Language Recognition
Human Activity Recognition
Medical Applications
skin cancer
breast cancer
Morphing
Inserting Artificial Objects into a
Scene
Virtual Reality & Motion
Tracking
- Signal Processing
- Image Processing
- Audio Processing
- Video Processing
Sistem Multimedia
Istilah “Multimedia”
Terdiri dari dua bagian :
Multi (multus) : “numerous, multiple”
Media (medium): “middle, center”. Agen untuk
sesuatu, digunakan untuk mendistribusikan dan
merepresentasikan informasi.
Secara umum, multimedia dapat didefinisikan
sebagai penggunaan multiple agent (agen ganda)
seperti teks, audio, video, citra untuk
mengirimkan dan mempresentasikan informasi
kepada pengguna.
Istilah “Media”
Dapat dikategorikan menjadi beberapa
kriteria :
Perception media
Representation media
Presentation media
Storage media
Transmission media
Perception Media
“Bagaimana manusia memperoleh
informasi”
Kita memperoleh informasi dari apa yang
kita lihat dan apa yang kita dengar
Media Visual:
Text, graphics, images, video
Media Audio:
Music, sound and voice
Representation Media
“Bagaimana informasi diencode di dalam komputer”
Bagaimana informasi direpresentasikan secara internal
kepada komputer.
Beberapa Pilihan :
Text is encoded in ASCII
An audio data stream in PCM (Pulse Coded Modulation)
Image in JPEG format
Video in MPEG format
Presentation Media
“Media apa yang digunakan untuk memasukkan ke
komputer dan mengeluarkan informasi dari komputer”
Merujuk ke device-device fisik yang digunakan sistem
untuk mereproduksi informasi untuk manusia, misal
device audio dan device visual.
Input:
Keyboards, cameras, microphone, Head Mounted Device
(for VR input)
Output:
monitors, speakers, printer
Storage Media
“Dimana informasi disimpan”
Merujuk ke berbagai macam benda yang
menyimpan data komputer, seperti magnetic
tapes, magnetic disks, or digital optical disks
(CD-ROM, CD, DVD)
Transmission Media
“Media yang digunakan untuk
mentransmisikan data”
Merujuk ke benda fisik seperti berbagai jenis
kabel, (coaxial cable, twisted pair, fiber
optics), radio tower, satellite – yang
mentransmisikan sinyal telekomunikasi.
Perbedaan antara media transmisi dan media
penyimpanan adalah kapabilitas untuk
mentransfer dara secara kontinyu melalui
jaringan komputer.
Image Processing
Bagaimana komputer melihat?
Key Stages in Digital Image Processing
Image
Restoration
Morphological
Processing
Image
Enhancement
Segmentation
Image
Acquisition
Object
Recognition
Problem Domain
Representation
& Description
Colour Image
Processing
Image
Compression
taken from Gonzalez & Woods, Digital Image Processing (2002)
Key Stages in Digital Image Processing:
Image Aquisition
Image
Restoration
Morphological
Processing
Image
Enhancement
Segmentation
Image
Acquisition
Object
Recognition
Problem Domain
Representation
& Description
Colour Image
Processing
Image
Compression
taken from Gonzalez & Woods, Digital Image Processing (2002)
Key Stages in Digital Image Processing:
Image Enhancement
Image
Restoration
Morphological
Processing
Image
Enhancement
Segmentation
Image
Acquisition
Object
Recognition
Problem Domain
Representation
& Description
Colour Image
Processing
Image
Compression
taken from Gonzalez & Woods, Digital Image Processing (2002)
Key Stages in Digital Image Processing:
Image Restoration
Image
Restoration
Morphological
Processing
Image
Enhancement
Segmentation
Image
Acquisition
Object
Recognition
Problem Domain
Representation
& Description
Colour Image
Processing
Image
Compression
taken from Gonzalez & Woods, Digital Image Processing (2002)
Key Stages in Digital Image Processing:
Morphological Processing
Image
Restoration
Morphological
Processing
Image
Enhancement
Segmentation
Image
Acquisition
Object
Recognition
Problem Domain
Representation
& Description
Colour Image
Processing
Image
Compression
taken from Gonzalez & Woods, Digital Image Processing (2002)
Key Stages in Digital Image Processing:
Segmentation
Image
Restoration
Morphological
Processing
Image
Enhancement
Segmentation
Image
Acquisition
Object
Recognition
Problem Domain
Representation
& Description
Colour Image
Processing
Image
Compression
taken from Gonzalez & Woods, Digital Image Processing (2002)
Key Stages in Digital Image Processing:
Object Recognition
Image
Restoration
Morphological
Processing
Image
Enhancement
Segmentation
Image
Acquisition
Object
Recognition
Problem Domain
Representation
& Description
Colour Image
Processing
Image
Compression
taken from Gonzalez & Woods, Digital Image Processing (2002)
Key Stages in Digital Image Processing:
Representation & Description
Image
Restoration
Morphological
Processing
Image
Enhancement
Segmentation
Image
Acquisition
Object
Recognition
Problem Domain
Representation
& Description
Colour Image
Processing
Image
Compression
Key Stages in Digital Image Processing:
Image Compression
Image
Restoration
Morphological
Processing
Image
Enhancement
Segmentation
Image
Acquisition
Object
Recognition
Problem Domain
Representation
& Description
Colour Image
Processing
Image
Compression
taken from Gonzalez & Woods, Digital Image Processing (2002)
Key Stages in Digital Image Processing:
Colour Image Processing
Image
Restoration
Morphological
Processing
Image
Enhancement
Segmentation
Image
Acquisition
Object
Recognition
Problem Domain
Representation
& Description
Colour Image
Processing
Image
Compression
Aplikasi dari Image Processing
Document Handling
Signature Verification
Biometrics
Fingerprint Verification /
Identification
Fingerprint Identification Research
at UNR
Minutiae
Delaunay Triangulation
Matching
Object Recognition
Object Recognition Research
reference view 1
reference view 2
novel view recognized
Indexing into Databases
Shape content
Indexing into Databases (cont’d)
Color, texture
Target Recognition
Department of Defense (Army, Airforce,
Navy)
Interpretation of Aerial
Photography
Interpretation of aerial photography is a problem
domain in both computer vision and registration.
Autonomous Vehicles
Land, Underwater, Space
Traffic Monitoring
Face Detection
Face Recognition
Facial Expression Recognition
Hand Gesture Recognition
Smart Human-Computer User Interfaces
Sign Language Recognition
Human Activity Recognition
Medical Applications
skin cancer
breast cancer
Morphing
Inserting Artificial Objects into a
Scene
Virtual Reality & Motion
Tracking