By definition a meet would be attended by those who fancy attending a meet. @greenmanpp , if you fancy organizing a meet-up, then go-ahead and do it: ignore poop-heads (real, assumed, posed or imaginary).
If you want a meet, offer at least 2-3 dates for consideration in a first poll. If you get 3 people, it's a meet. (2 is a date, so you are still winning!)
After that, decide on location, from your experience or from feedback by people who are genuinely interested (which may include people who cannot come but are supportive)
Then keep abreast of reminding people, and trying to drum-up more support, including from the assumed/posing/kidding poop-head wannabies who really are wishing a met can still happen but feel it is not the swell thing to say.
The real poop-heads you can ignore: they cannot be salvaged.
They will poop on a successful meet because "in the olden time we used to be x numbers"... let them live in the olden time, when the front page was refreshed every 5 minutes and new entrants were not scared away by the said poop-heads defending their patch.