one man and his dog

Almost nobody; very few people.

Used other than figuratively or idiomatically: see one, man, dog.