S KOM 0809126 Table of content
DAFTAR ISI
ABSTRAK ............................................................................................................... i
ABSTRACT .............................................................................................................. ii
KATA PENGANTAR ........................................................................................... iii
UCAPAN TERIMA KASIH .................................................................................. iv
DAFTAR ISI ........................................................................................................... v
DAFTAR TABEL ................................................................................................. vii
DAFTAR GAMBAR ........................................................................................... viii
BAB I PENDAHULUAN ....................................................................................... 1
1.1
Latar Belakang ..........................................................................................1
1.2
Rumusan Masalah .....................................................................................4
1.3
Batasan Masalah ........................................................................................4
1.4
Tujuan Penelitian .......................................................................................4
1.5
Manfaat Penelitian .....................................................................................5
1.6
Sistematika Penelitian ...............................................................................5
BAB II KAJIAN PUSTAKA .................................................................................. 6
2.1
Sistem Terdistribusi ...................................................................................6
2.1.1 Karakter Sistem Terdistribusi..............................................................7
2.1.2 Grid Computing Systems .....................................................................8
2.1.3 Algoritma Pemilihan Koordinator .....................................................10
2.1.4 Fault Tolerance .................................................................................12
2.1.5 Replikasi ............................................................................................14
2.1.6 Distributed Crawler ..........................................................................15
2.2
Twitter API ..............................................................................................16
2.2.1 REST API..........................................................................................16
2.2.2 Search API.........................................................................................17
2.2.3 Streaming API ...................................................................................19
2.3
Twitter Crawler .......................................................................................19
2.4
Hazelcast .................................................................................................20
Willi, 2015
Distributed twitter crawler
Universitas Pendidikan Indonesia | repository.upi.edu | perpustakaan.upi.edu
BAB III METODOLOGI PENELITIAN.............................................................. 22
3.1
Desain Penelitian .....................................................................................22
3.2
Persiapan Alat dan Bahan Penelitian .......................................................24
3.3
Studi Literatur ..........................................................................................25
3.4
Proses Pengembangan Perangkat Lunak .................................................27
BAB IV HASIL PENELITIAN DAN PEMBAHASAN ...................................... 30
4.1
Hasil Pengembangan Perangkat Lunak ...................................................30
4.1.1 Analisis Kebutuhan Perangkat Lunak ...............................................30
4.1.2 Desain Sistem ....................................................................................35
4.1.3 Implementasi .....................................................................................42
4.1.4 Pengujian ...........................................................................................45
4.2
Pembahasan Eksperimen .........................................................................48
4.2.1 Pemilihan Koordinator ......................................................................48
4.2.2 Pendistribusian Tugas Pengumpulan Tweet ......................................54
4.2.3 Penggabungan Hasil Pengumpulan Tweet ........................................61
4.2.4 Replikasi ............................................................................................62
BAB V KESIMPULAN DAN SARAN ................................................................ 66
5.1
Kesimpulan ..............................................................................................66
5.2
Saran ........................................................................................................66
DAFTAR PUSTAKA ........................................................................................... 67
Willi, 2015
Distributed twitter crawler
Universitas Pendidikan Indonesia | repository.upi.edu | perpustakaan.upi.edu
ABSTRAK ............................................................................................................... i
ABSTRACT .............................................................................................................. ii
KATA PENGANTAR ........................................................................................... iii
UCAPAN TERIMA KASIH .................................................................................. iv
DAFTAR ISI ........................................................................................................... v
DAFTAR TABEL ................................................................................................. vii
DAFTAR GAMBAR ........................................................................................... viii
BAB I PENDAHULUAN ....................................................................................... 1
1.1
Latar Belakang ..........................................................................................1
1.2
Rumusan Masalah .....................................................................................4
1.3
Batasan Masalah ........................................................................................4
1.4
Tujuan Penelitian .......................................................................................4
1.5
Manfaat Penelitian .....................................................................................5
1.6
Sistematika Penelitian ...............................................................................5
BAB II KAJIAN PUSTAKA .................................................................................. 6
2.1
Sistem Terdistribusi ...................................................................................6
2.1.1 Karakter Sistem Terdistribusi..............................................................7
2.1.2 Grid Computing Systems .....................................................................8
2.1.3 Algoritma Pemilihan Koordinator .....................................................10
2.1.4 Fault Tolerance .................................................................................12
2.1.5 Replikasi ............................................................................................14
2.1.6 Distributed Crawler ..........................................................................15
2.2
Twitter API ..............................................................................................16
2.2.1 REST API..........................................................................................16
2.2.2 Search API.........................................................................................17
2.2.3 Streaming API ...................................................................................19
2.3
Twitter Crawler .......................................................................................19
2.4
Hazelcast .................................................................................................20
Willi, 2015
Distributed twitter crawler
Universitas Pendidikan Indonesia | repository.upi.edu | perpustakaan.upi.edu
BAB III METODOLOGI PENELITIAN.............................................................. 22
3.1
Desain Penelitian .....................................................................................22
3.2
Persiapan Alat dan Bahan Penelitian .......................................................24
3.3
Studi Literatur ..........................................................................................25
3.4
Proses Pengembangan Perangkat Lunak .................................................27
BAB IV HASIL PENELITIAN DAN PEMBAHASAN ...................................... 30
4.1
Hasil Pengembangan Perangkat Lunak ...................................................30
4.1.1 Analisis Kebutuhan Perangkat Lunak ...............................................30
4.1.2 Desain Sistem ....................................................................................35
4.1.3 Implementasi .....................................................................................42
4.1.4 Pengujian ...........................................................................................45
4.2
Pembahasan Eksperimen .........................................................................48
4.2.1 Pemilihan Koordinator ......................................................................48
4.2.2 Pendistribusian Tugas Pengumpulan Tweet ......................................54
4.2.3 Penggabungan Hasil Pengumpulan Tweet ........................................61
4.2.4 Replikasi ............................................................................................62
BAB V KESIMPULAN DAN SARAN ................................................................ 66
5.1
Kesimpulan ..............................................................................................66
5.2
Saran ........................................................................................................66
DAFTAR PUSTAKA ........................................................................................... 67
Willi, 2015
Distributed twitter crawler
Universitas Pendidikan Indonesia | repository.upi.edu | perpustakaan.upi.edu