Skip to content

Karthikay2002/DRONEYES

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
 
 
 
 
 
 

Repository files navigation

DRONEYES

Inspiration:-

We are in a time where the outcomes of poaching are given a lot of value and money even though it is considered illegal. Every day we are losing hundreds of mammals belonging to endangered species this is mainly due to the lack of enforcement and proper government regulations.

Proposed Solution:-

The prototyped solution would have a life-changing impact on the lives of animals and probably help us catch the predators too. Implementing this technology solution into the real world, it reduces the poaching curve to the minimum. Not only being the eyes from the sky, our prototype can get the clear image of the terra-firma and detect what is what with the help of its camera.

It flies down to a stealth level and sends us the interactive feedback of the place by taking a video or a photo. This solution can detect people, weapons, animals, trees and many more. Further developments in this project include the predicting of the type animal and the exact location of the hunt, so that the task force could immediately come to the respective place and act. The respective organizations need not require any strains and moreover it need not rely on other solutions by utilizing the product. The lives of animals will get saved from poaching.

The prototype will change into an “Aerial surveillance” once it takes off to the heights of the skies/clouds once we market it and make it even more scalable. This is completely remote controlled (for now at least).

Using the latest advances in Machine Learning and Computer Vision, we are trying to transform the lives of the muted ones (animals).

DRONEYES can describe what’s going on the ground through the video output we get on the user side. It can help to find things around the scouted area by describing, which is human, animal (by species) immediately and gives the exact position of the area that needs to be scouted. With the help of cloud technology, we can share the data in real time.

We are trying to integrate the object detection software into the drone’s camera which is a big challenge.

We are working on the GPS module and the Flight Controller for the drone. The flight controller is necessary for the stability of the drone. The Global Positioning System or GPS is a device that has a capability to measure how long a signal takes to travel from a satellite. This device gives an estimation of the drones altitude, the lat and the long of the place. This makes the device to be so vital in our project. The GPS modules are inaccurate, but they can be rectified by buying more complex external GPS receivers. For this project we are using Neo 6m v2 GPS Module, this module has a high precision output.This module comes pre-equiped with a battery due to which we can obtain the GPS lock faster. The antena is also connected to the module through the cable which allows for easy mounting of the GPS. This makes it to see the sky and give its best performance. When it comes to accuracy, we can expect an error upto 4 times the pixel size for a correctly reconstructed model.

We collected few videos from the sourceful web, and then we ran our software on the video and the results are pretty amusing. It went well. We took a video of a neighbourhood which has cars and trucks and another video from NatGeo Wild. One is for detecting the cars and the other is for detecting the types of animals. The software model we used is YOLOv3

How we built it?

The prototype will change into an “Aerial surveillance” once it takes off to the heights of the skies/clouds once we market it and make it even more scalable. This is completely remote controlled (for now at least). Using the latest advances in Machine Learning and Computer Vision, we are trying to transform the lives of the muted ones (animals). DRONEYES can describe what’s going on the ground through the video output we get on the user side. It can help to find things around the scouted area by describing, which is human, animal (by type) immediately and gives the exact position of the area that needs to be scouted. With the help of cloud technology, we can share the data in real time.

Challenges we ran into:-

  1. Integrating the object detection into the drone’s camera is a big challenge that we faced during the hackathon.
  2. The drone’s flight controller gave us a trouble during the hackathon, this made us tensed and nervous about the result, but we finally made it possible by solving it.
  3. The most important thing is to integrate the sub-modules to a whole project prototype.

Accomplishments we are proud of!

We knew it was a hard task to implement our idea on a totally new platform and environment without our physical selves being at one place due to COVID-19, but we challenged ourselves to fight it till the end and we did it. Being able to transform our idea into a project that could be displayed feels great! We will never step back in life from trying something new every time. If we could stay up for 24 hours and accomplish our goal, we believe nothing is IMPOSSIBLE.

OBJECT DETECTION

1. Real Time
2. Video Feed

YOLOv3 trained on COCO was used for Object detection. Darkflow which is a Tensorflow variant Darknet was used to process the frames. Darknet is an open source neural network framework written in C and CUDA.

Several images of Guns, Poachers, Rangers were scraped from the internet and YOLOv2 was trained from scratch to detect the following object classes in the frames. Due to lack of data and time in the hackathon, high accuracy and confidence was not achieved.

Wildlife Video Feed was fed to the layers of YOLO and animals / humans were tracked with high confidence in the wildlife. Some of the frames are :

Steps For Using Object Detection

STEP-1 Download the current repositry.

STEP-2 Open command promt and cd to object detection .

STEP-3 Then type python webstreaming.py -i 127.0.0.1 -o 5000 .

STEP-4 Then you can see , a self host server running and copy this link http://127.0.0.1:5000/ and paste in browser.

DRONE IMAGES

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published