filnet

  • *****
  • 71
New video gadget
« on: July 15, 2017, 01:23:04 pm »
I submitted a PR that adds video to the PFD and a new video gadget to the GCS.

The PR can be found here https://bitbucket.org/librepilot/librepilot/pull-requests/454

There is a readme file in ./ground/gcs/src/libs/gstreamer/ that gives some pointers to building this branch.

A demo video can seen here:


GStreamer is used to view, process, record and eventually stream video from a variety of sources (usb or ip camera, file, network...).
For those who know GStreamer, the new video gadget is more or less a glorified gst-launch.

The GCS video gadget comes with a number of sample GStreamer pipelines. Most of them work on Windows only but can easily be adapted to Linux or Mac.

A few Windows' specific GStreamer elements are used but most pipelines will work if those elements are switched with the corresponding element for the specific platform.

Type  Windows  Linux  Mac
Video capture  ksvideosrc  v4l2src  avfvideosrc
Video display  d3dvideosink  ximagesink  osxvideosink
Screen capture  dx9screencapsrc  ximagesrc  avfvideosrc

You can get information about GStreamer elements with gst-launch-1.0 <element name>

The branch is known to compile and work on Windows, Linux and Mac.
It will work best with the latest GStreamer (1.12.2). Your results may vary if you use an older version of GStreamer (but it should work...).


« Last Edit: September 13, 2017, 09:18:50 pm by filnet »

filnet

  • *****
  • 71
Re: New video gadget
« Reply #1 on: July 15, 2017, 04:37:45 pm »
[reserved]

f5soh

  • *****
  • 3923
    • LibrePilot
Re: New video gadget
« Reply #2 on: September 25, 2017, 11:49:53 pm »
Video gadget is now merged to the development 'next' branch.

LibrePilot-16.09+r522-gd9cce5e_i686.exe  https://drive.google.com/open?id=0B5d_9OcqQj8BOGZmaFF5RnVUck0

Brunosanta

  • **
  • 54
  • I understand it all but know nothing
Re: New video gadget
« Reply #3 on: October 17, 2017, 06:28:50 pm »
could anyone tell what would be the use of it, so I kind of follow?
thank you
Everybody is only optimistic on the social networks.. being real is hard nowadays

filnet

  • *****
  • 71
Re: New video gadget
« Reply #4 on: October 17, 2017, 07:14:21 pm »
could anyone tell what would be the use of it, so I kind of follow?

A simple use case is to display video from the UAV in the PFD. Sexier than the default background.

Another one is to record the video from the UAV to a file.

A more mundane use case is to record a video screen capture of your activity in GCS (for showing a bug, making a tutorial or demo-ing a new feature).

More advanced use cases include:
- receive video from UAV, overlay some information (OSD...) and transmit video to FPV goggles
- receive video from UAV, do some processing (detect faces) and send instructions back to UAV (say "hello")

GStreamer is a very powerful video/audio processing framework.

Your imagination is the limit...

Brunosanta

  • **
  • 54
  • I understand it all but know nothing
Re: New video gadget
« Reply #5 on: October 17, 2017, 07:58:26 pm »
thanks for the answers, its clear now.
Everybody is only optimistic on the social networks.. being real is hard nowadays

karla

  • ***
  • 210
Re: New video gadget
« Reply #6 on: October 18, 2017, 05:38:37 am »
A simple use case is to display video from the UAV in the PFD. Sexier than the default background.
Hi, filnet, do you have a demo of this?
Its not in your first post right?
Thanks

f5soh

  • *****
  • 3923
    • LibrePilot
Re: New video gadget
« Reply #7 on: October 18, 2017, 07:25:57 am »
Here is the video plugin and PFD working with a local USB camera.
The same can be achieved receiving a remote Wifi camera and composite video from FPV receiver using a EasyCap or similar.