An elderly Colorado man who failed to respond to the government’s claim that he owed $482,000 for failing to report his foreign bank accounts is on the hook for the bill, a federal court ruled.