Thread Tools
Mar 02, 2019, 02:49 PM
Registered User
Thread OP
Discussion

DIY Image synthesizing DSP receiver - Codename: Senyic


Hi everyone,

I want to develop a receiver technology that intelligently combines multiple video streams, not just RSSI switching but actually using all the information in multiple data-streams to generate a combined image. This is what Iftron's ClearView is advertised to do, but what exactly it does we may never know.

So, to even begin experimenting with processing methods I will need some sample data, that is 3x uncompressed PAL/NTSC data-streams, all in sync, all receiving the same VTX signal from 3 separate receivers, under a variety of reception conditions. I am not aware of anything commercial that will do this as the data rate of 3 uncompressed SD streams is already quite significant and I absolutely do not want compression on top of my raw data.

I had some previous experience with the TVP5151 CVBS decoder IC and FPGAs from this video scaler project https://www.rcgroups.com/forums/show...x-7-FPGA/page6
So I think it should be possible to combine 3 of those, an FPGA, and a FX3 USB3.0 interface chip. The FX3 is able to handle hundreds of MB/s of sustained transfer to it should not be an issue to get the data out. Reading the documentation it appears it will run in a 'slave fifo' mode which is exactly what I want to keep the FPGA logic as minimal as possible.

So, the first goal is to get some data-streams onto a PC so we can start experimenting with different processing methods. I have purchased a FX3 + Artix 7 development board combo and am currently designing a PCB to hold the 3x TVP5151's and 3x RX5808 receiver modules.

Link to FPGA + FX3 board: https://www.aliexpress.com/item/QMTE...06618157.html?

I expect the image processing will be the most challenging aspect of the project, my first idea at the moment would be to do some sort of spectral entropy analysis on a per line or per block basis, comparing the measurement of each RX and selecting perhaps the best 2 or 3 to average into a final image.

This is based on the assumption that an increase in noise due to multi-path fading or interference will increase the instantaneous spectral entropy in the signal regardless of the measured RSSI. With this information you could take the best (or reject the worst) slices from each RX to form into a final image.

Anyway, the purpose of this thread is to get some discussion going!, so if anyone has any ideas or input lets hear them! I am not a DSP guy, so if you are I'd love to know your ideas.
Sign up now
to remove ads between posts
Mar 02, 2019, 03:27 PM
Registered User
Thread OP
Reversed, just in case
Mar 12, 2019, 08:59 PM
Registered User
Thread OP
I've developed a simulation tool to test different reconstruction algorithms.
Using a static image I simulated some receiver noise/interference in 3 different streams.

A first order attempt, which just measures the noise in each line and slices together the best lines appears to work very well already.

Image Synthesizing DSP receiver for FPV (Reconstruction Simulation) (0 min 9 sec)
Apr 10, 2019, 02:35 AM
Registered User
Thread OP
Got my PCBs and have soldered them up

Still working on the VHDL code for the moment
May 16, 2019, 02:53 PM
Registered User
Any news on this I follow it with interest!
May 18, 2019, 04:52 AM
Registered User
Thread OP
Sorry, not yet. I've been busy finishing my phd to devote much time to this.


Quick Reply
Message:

Thread Tools

Similar Threads
Category Thread Thread Starter Forum Replies Last Post
Discussion 72mhz synth vs non synth RXs Thermal Hobby Radios 12 Dec 03, 2016 08:47 AM
Discussion 40 MHz DIY Synthesized Direct Conversion + DSP Receiver idea gepard DIY Electronics 2 Jan 21, 2011 04:11 AM
Multiplex Synth receiver - PC cable DIY alien2108 Radios 33 Jan 09, 2009 09:54 PM
Discussion 9Z synth and DSP TLParker Radios 2 Mar 19, 2008 12:42 PM
Discussion MPX RX-9 synth PC Interface DIY merengue DIY Electronics 1 May 14, 2006 08:53 AM