down on one's luck

Unlucky or undergoing a period of bad luck, especially with respect to financial matters.