indeso workshop romy
Master Internship:
SAR-VMS-AIS Correlation to
Identify Illegal Fishing Vessels in
Indonesia
Romy ARDIANTO
Master of Science in Computer Science and
Decision Systems (CSDS)
Institut Mines-Télécom
Internship Supervisors
Guillaume HAJDUCH
Yannis HARALAMBOUS
▪ Head of Expertise and
Innovation Department
at CLS Brest
▪ Senior Professor at Computer
Science Department,
TELECOM Bretagne
▪ Service Manager of the
Sentinel-1 Mission
Performance Center
▪ Head of Master of Science in
Computer Science and
Decision Systems (CSDS)
Program
▪ Author of “Fonts & Encodings”
book
2
06-Oct-17
Institut Mines-Télécom
Soutenance de stage – Romy ARDIANTO
Master’s Degree in France
Degree
One of the top French
engineering school in
Information Technologies
and Telecommunications
Higher
Education
System in
France
Ecole
d’ingénieur
Master
Thesis
Internship
(highly
recommended)
Research
Master
Program
Internship
Université
Research
3
06-Oct-17
Institut Mines-Télécom
Modèle de présentation Télécom Bretagne
Outline
Context
•
•
•
INDESO project
CLS company
Objective of the internship
Access to satellite data
Estimation of VMS and AIS positions based on SAR
echoes
Correlation of satellite data (SAR-VMS-AIS) and SAR
detection performance characterization
Characterization of the non-VMS fishing fleet
Conclusion
4
06-Oct-17
Institut Mines-Télécom
Soutenance de stage – Romy ARDIANTO
Context
5
06/10/2017
Institut Mines-Télécom
Soutenance de stage – Romy ARDIANTO
Monitoring of marine and fisheries
resources against illegal fishing activities
INDESO project (Infrastructure Development of Space
Oceanography)
•
•
Collaborative project between France and Indonesia (2013 –
2017)
Mission:
─ To protect our marine ressources against illegal fishing activites
and establish sustainable fisheries in Indonesia
Moratorium of ex-foreign fishing vessels
•
6
06/10/2017
Temporary suspension of issuance of fishing licenses for all
Indonesian waters for vessels constructed abroad (2014 2015
Institut Mines-Télécom
Soutenance de stage – Romy ARDIANTO
INDESO
Build, develop and operate an operational center for monitoring & forecast
Implement a large capacity building plan to transfer technology & knowledge
Expand & enhance result-oriented downstream applications
Fight IUU Fishing
Monitor Fish Stocks
Monitor Coral reefs
Shrimp Farming
Seaweed Farming
Integrated Coastal
Zone Management
Oilspill Monitoring
7
06/10/2017
Institut Mines-Télécom
Soutenance de stage – Romy ARDIANTO
CLS (Collecte Localisation Satellites)
Created in 1986, a subsidiary of CNES, Ifremer &
ARDIAN
Pioneer provider of monitoring and surveillance
solutions :
•
•
•
Sustainable management of fisheries
Environmental monitoring
Maritime safety and security
506 collaborators :
•
•
8
06/10/2017
336 in France (Toulouse, Brest and Bidart)
170 headquarters and offices around the world
Institut Mines-Télécom
Soutenance de stage – Romy ARDIANTO
Organizational Chart
9
06-Oct-17
Institut Mines-Télécom
Soutenance de stage – Romy ARDIANTO
Objective of the internship
To perform a joint analysis of VMS (Vessel Monitoring System) and
AIS (Automatic Identification System) data with ship targets in SAR
imagery (Synthetic Aperture Radar)
• Evaluate correlation coefficient
• SAR detection performance characterization
• Identify illegal fishing vessels present in SAR imagery
Software applications written in Python were developed in order to
perform this joint analysis automatically
10
06/10/2017
Institut Mines-Télécom
Soutenance de stage – Romy ARDIANTO
Methodology
Venn Diagram Correlation of SAR, VMS and AIS
SAR correlated with VMS
Illegals detected by SAR,
not reported by AIS
SAR correlated with
VMS and AIS
VMS
SAR
AIS correlated with
VMS
Illegals
SAR correlated with
AIS
Illegals not detected by
SAR and AIS
AIS
Illegals not detected by
SAR, reported by AIS
Illegals detected by SAR,
reported by AIS
11
06-Oct-17
Institut Mines-Télécom
Soutenance de stage – Romy ARDIANTO
Access to satellite data
12
06/10/2017
Institut Mines-Télécom
Soutenance de stage – Romy ARDIANTO
Satellite Data
13
06-Oct-17
Institut Mines-Télécom
Modèle de présentation Télécom Bretagne
Estimation of VMS and AIS
positions based on SAR echoes
14
06/10/2017
Institut Mines-Télécom
Soutenance de stage – Romy ARDIANTO
Interpolation/extrapolation of VMS and AIS
data based on SAR echoes
Methodology
Linear interpolation/extrapolation
•
Based on 2 successive points having the date closest to
the date of SAR echoes
Geodetic calculation used: Vincenty's formulae
•
•
15
06/10/2017
Widely used in geodesy to calculate the distance between
two points on the surface of a spheroid accurate to
within 0.5 mm
Consist of 2 methods: Direct and Inverse
─ Direct method: computes the location of a point that is a
given distance and azimuth (direction) from another point
─ Inverse method: computes the geographical distance and
azimuth between two given points
Institut Mines-Télécom
Soutenance de stage – Romy ARDIANTO
Interpolation
Algorithm
1.
2.
3.
4.
5.
Selection of VMS/AIS data with ± 3h on the date of SAR echo
Selection of 2 positions closest to the date of SAR echo
Apply inverse method to calculate the geographical distance between point A
and B
Calculate the interpolation distance (based on the geographical distance
between point A and B, time interval between A and B, and time interval
between interpolated point et point B)
Apply direct method to determine geographical coordinate of the interpolated
point
2014/12/07 09:00:00
2014/12/07 09:10:00
2014/12/07 08:50:00
Point A
Interpolated point
on the date of
SAR echo
Point B
Time interval of interpolation
16
06-Oct-17
Institut Mines-Télécom
Soutenance de stage – Romy ARDIANTO
Extrapolation
Algorithm
1.
2.
3.
4.
5.
Selection of VMS/AIS data with ± 3h on the date of SAR echo
Selection of 2 positions closest to the date of SAR echo
Apply inverse method to calculate the geographical distance and azimuth
between point A and B
Calculate the extrapolation distance (based on time difference between the
date of point B and SAR echo, and the speed of vessel point B)
Apply direct method to determine geographical coordinate of the extrapolated
point
2014/12/07 08:50:00
Point A
2014/12/07 09:00:00
Point B
2014/12/07 09:10:00
Extrapolated point
on the date of
SAR echo
Time interval of extrapolation
17
06-Oct-17
Institut Mines-Télécom
Soutenance de stage – Romy ARDIANTO
Estimation of VMS position (1/2)
Example: estimation of VMS position applied on a SAR imagery in the Arafura Sea :
RS2_FNB_1FSINB20150110_091825_00000022xF0W_16bxx_36926_71407_0sauh1
Vessel 1
Vessel 2
18
06-Oct-17
Institut Mines-Télécom
Soutenance de stage – Romy ARDIANTO
Estimation of VMS position (2/2)
19
06/10/2017
Institut Mines-Télécom
Soutenance de stage – Romy ARDIANTO
Correlation of satellite data (SARVMS-AIS) and SAR performance
characterization
20
06/10/2017
Institut Mines-Télécom
Soutenance de stage – Romy ARDIANTO
SAR Doppler effect (1/2)
Doppler effect (Doppler shift)
• Definition: the change in frequency or wavelength of a
wave for an observer who is moving relative to the
wave source
• Radar applications:
─ Speed measuring
─ Moving target indication
• Illustration of Doppler effect:
21
06-Oct-17
Institut Mines-Télécom
Soutenance de stage – Romy ARDIANTO
SAR Doppler effect (2/2)
Doppler effect application to estimate the real position of
SAR echo
D y = R´
v
= K ´v
V
D y : Décalage Doppler [m]
R : Distance cible par satellite [m]
v :Vitesse radiale cible [m / s]
V :Vitesse sol du satellite [m / s]
K : DopplerShiftCoefficient
22
06-Oct-17
Institut Mines-Télécom
Soutenance de stage – Romy ARDIANTO
Distance parameters (Dneigh and Dmax)
SAR echo
Interpolated/extrapolated VMS/AIS
SAR-VMS-AIS Correlation to
Identify Illegal Fishing Vessels in
Indonesia
Romy ARDIANTO
Master of Science in Computer Science and
Decision Systems (CSDS)
Institut Mines-Télécom
Internship Supervisors
Guillaume HAJDUCH
Yannis HARALAMBOUS
▪ Head of Expertise and
Innovation Department
at CLS Brest
▪ Senior Professor at Computer
Science Department,
TELECOM Bretagne
▪ Service Manager of the
Sentinel-1 Mission
Performance Center
▪ Head of Master of Science in
Computer Science and
Decision Systems (CSDS)
Program
▪ Author of “Fonts & Encodings”
book
2
06-Oct-17
Institut Mines-Télécom
Soutenance de stage – Romy ARDIANTO
Master’s Degree in France
Degree
One of the top French
engineering school in
Information Technologies
and Telecommunications
Higher
Education
System in
France
Ecole
d’ingénieur
Master
Thesis
Internship
(highly
recommended)
Research
Master
Program
Internship
Université
Research
3
06-Oct-17
Institut Mines-Télécom
Modèle de présentation Télécom Bretagne
Outline
Context
•
•
•
INDESO project
CLS company
Objective of the internship
Access to satellite data
Estimation of VMS and AIS positions based on SAR
echoes
Correlation of satellite data (SAR-VMS-AIS) and SAR
detection performance characterization
Characterization of the non-VMS fishing fleet
Conclusion
4
06-Oct-17
Institut Mines-Télécom
Soutenance de stage – Romy ARDIANTO
Context
5
06/10/2017
Institut Mines-Télécom
Soutenance de stage – Romy ARDIANTO
Monitoring of marine and fisheries
resources against illegal fishing activities
INDESO project (Infrastructure Development of Space
Oceanography)
•
•
Collaborative project between France and Indonesia (2013 –
2017)
Mission:
─ To protect our marine ressources against illegal fishing activites
and establish sustainable fisheries in Indonesia
Moratorium of ex-foreign fishing vessels
•
6
06/10/2017
Temporary suspension of issuance of fishing licenses for all
Indonesian waters for vessels constructed abroad (2014 2015
Institut Mines-Télécom
Soutenance de stage – Romy ARDIANTO
INDESO
Build, develop and operate an operational center for monitoring & forecast
Implement a large capacity building plan to transfer technology & knowledge
Expand & enhance result-oriented downstream applications
Fight IUU Fishing
Monitor Fish Stocks
Monitor Coral reefs
Shrimp Farming
Seaweed Farming
Integrated Coastal
Zone Management
Oilspill Monitoring
7
06/10/2017
Institut Mines-Télécom
Soutenance de stage – Romy ARDIANTO
CLS (Collecte Localisation Satellites)
Created in 1986, a subsidiary of CNES, Ifremer &
ARDIAN
Pioneer provider of monitoring and surveillance
solutions :
•
•
•
Sustainable management of fisheries
Environmental monitoring
Maritime safety and security
506 collaborators :
•
•
8
06/10/2017
336 in France (Toulouse, Brest and Bidart)
170 headquarters and offices around the world
Institut Mines-Télécom
Soutenance de stage – Romy ARDIANTO
Organizational Chart
9
06-Oct-17
Institut Mines-Télécom
Soutenance de stage – Romy ARDIANTO
Objective of the internship
To perform a joint analysis of VMS (Vessel Monitoring System) and
AIS (Automatic Identification System) data with ship targets in SAR
imagery (Synthetic Aperture Radar)
• Evaluate correlation coefficient
• SAR detection performance characterization
• Identify illegal fishing vessels present in SAR imagery
Software applications written in Python were developed in order to
perform this joint analysis automatically
10
06/10/2017
Institut Mines-Télécom
Soutenance de stage – Romy ARDIANTO
Methodology
Venn Diagram Correlation of SAR, VMS and AIS
SAR correlated with VMS
Illegals detected by SAR,
not reported by AIS
SAR correlated with
VMS and AIS
VMS
SAR
AIS correlated with
VMS
Illegals
SAR correlated with
AIS
Illegals not detected by
SAR and AIS
AIS
Illegals not detected by
SAR, reported by AIS
Illegals detected by SAR,
reported by AIS
11
06-Oct-17
Institut Mines-Télécom
Soutenance de stage – Romy ARDIANTO
Access to satellite data
12
06/10/2017
Institut Mines-Télécom
Soutenance de stage – Romy ARDIANTO
Satellite Data
13
06-Oct-17
Institut Mines-Télécom
Modèle de présentation Télécom Bretagne
Estimation of VMS and AIS
positions based on SAR echoes
14
06/10/2017
Institut Mines-Télécom
Soutenance de stage – Romy ARDIANTO
Interpolation/extrapolation of VMS and AIS
data based on SAR echoes
Methodology
Linear interpolation/extrapolation
•
Based on 2 successive points having the date closest to
the date of SAR echoes
Geodetic calculation used: Vincenty's formulae
•
•
15
06/10/2017
Widely used in geodesy to calculate the distance between
two points on the surface of a spheroid accurate to
within 0.5 mm
Consist of 2 methods: Direct and Inverse
─ Direct method: computes the location of a point that is a
given distance and azimuth (direction) from another point
─ Inverse method: computes the geographical distance and
azimuth between two given points
Institut Mines-Télécom
Soutenance de stage – Romy ARDIANTO
Interpolation
Algorithm
1.
2.
3.
4.
5.
Selection of VMS/AIS data with ± 3h on the date of SAR echo
Selection of 2 positions closest to the date of SAR echo
Apply inverse method to calculate the geographical distance between point A
and B
Calculate the interpolation distance (based on the geographical distance
between point A and B, time interval between A and B, and time interval
between interpolated point et point B)
Apply direct method to determine geographical coordinate of the interpolated
point
2014/12/07 09:00:00
2014/12/07 09:10:00
2014/12/07 08:50:00
Point A
Interpolated point
on the date of
SAR echo
Point B
Time interval of interpolation
16
06-Oct-17
Institut Mines-Télécom
Soutenance de stage – Romy ARDIANTO
Extrapolation
Algorithm
1.
2.
3.
4.
5.
Selection of VMS/AIS data with ± 3h on the date of SAR echo
Selection of 2 positions closest to the date of SAR echo
Apply inverse method to calculate the geographical distance and azimuth
between point A and B
Calculate the extrapolation distance (based on time difference between the
date of point B and SAR echo, and the speed of vessel point B)
Apply direct method to determine geographical coordinate of the extrapolated
point
2014/12/07 08:50:00
Point A
2014/12/07 09:00:00
Point B
2014/12/07 09:10:00
Extrapolated point
on the date of
SAR echo
Time interval of extrapolation
17
06-Oct-17
Institut Mines-Télécom
Soutenance de stage – Romy ARDIANTO
Estimation of VMS position (1/2)
Example: estimation of VMS position applied on a SAR imagery in the Arafura Sea :
RS2_FNB_1FSINB20150110_091825_00000022xF0W_16bxx_36926_71407_0sauh1
Vessel 1
Vessel 2
18
06-Oct-17
Institut Mines-Télécom
Soutenance de stage – Romy ARDIANTO
Estimation of VMS position (2/2)
19
06/10/2017
Institut Mines-Télécom
Soutenance de stage – Romy ARDIANTO
Correlation of satellite data (SARVMS-AIS) and SAR performance
characterization
20
06/10/2017
Institut Mines-Télécom
Soutenance de stage – Romy ARDIANTO
SAR Doppler effect (1/2)
Doppler effect (Doppler shift)
• Definition: the change in frequency or wavelength of a
wave for an observer who is moving relative to the
wave source
• Radar applications:
─ Speed measuring
─ Moving target indication
• Illustration of Doppler effect:
21
06-Oct-17
Institut Mines-Télécom
Soutenance de stage – Romy ARDIANTO
SAR Doppler effect (2/2)
Doppler effect application to estimate the real position of
SAR echo
D y = R´
v
= K ´v
V
D y : Décalage Doppler [m]
R : Distance cible par satellite [m]
v :Vitesse radiale cible [m / s]
V :Vitesse sol du satellite [m / s]
K : DopplerShiftCoefficient
22
06-Oct-17
Institut Mines-Télécom
Soutenance de stage – Romy ARDIANTO
Distance parameters (Dneigh and Dmax)
SAR echo
Interpolated/extrapolated VMS/AIS