Nope, not paranoid! Definitely add some sort of extra retention mechanism.
The cheap, lazy way is to just simply use tape. I'm guilty of that from time to time!
Otherwise, use a canopy latch. I had a spare lying around and installed that on the rear of mine, and glued a ply tongue as positive retention on the front side.