Abstract:
Streaming videos from multiple cameras mounted on an unmanned aerial vehicle is desirable for applications such as rescue and search, remote sensing, aerial mapping and disaster response. In this research, the goal is to develop a real time system that can help in flying an unmanned aerial vehicle using vision and other telemetry sensors to estimate the states of vehicle. Using this system, a combined view from multiple cameras will be displayed on a single screen. Moreover, this is a GPS based vision system that will gather all the necessary telemetry information from onboard sensors. Further this telemetry sensor data is overlapped on the video, to be sent to the display screen on receiver end.
H.264 multi view video coding has been proposed to transmit all videos efficiently using LS 3000/5 long range audio video 2.4GHz transmitter. The video footage is digitally recorded at H.264 compression rate and processed. This scheme encodes video frames along with telemetry sensor data and then transmits each description using a single transmission path.VRX-24L Video and Audio receiver is used to receive and send flight data to Ground Control Station. Using such multiple vision sensors on an unmanned aerial vehicle is quite challenging since it adds more number of video data that has to be monitored simultaneously on a single screen. However, in multi-view videos, users will have a choice to watch any preferred viewpoint. This digital video recorder also has an advantage of permanent storage of video footage while maintaining excellent video quality for many useful applications. The developed system provides real time feedback from multiple cameras to control and maneuver an UV when it is operated beyond the visual range. The experimental testing is done from long range 15km LOS and data is transmitted with high SNR.
