A Los Angeles investor lost a bid in California federal court Thursday to recoup more than $500,000 in damages that, he said, stemmed from the IRS’ unlawful seizure of his assets to pay off a $7.2 million late-filing penalty.