No you are not crazy! Sounds like a good plan you have put together. I agree that you should try to find a Top Hat with a diesel in good condition and a 40 or 50 litre SS tank( this is what I have in my boat) which will give you 30 hrs of motoring without having to worry about refueling. No lifting and you just need to turn a key to bring the 'iron genoa' into play and if it is a modern diesel it will be pretty quiet and easy to live with. I have found the Top Hat a wonderful sea boat for her size, easy to sail single handed and, if well set up, they will do 5-6 knots in just about any wind/sea conditions.
Good luck with your search,
Mark