Counsel for members of a wealthy extended family accused of shorting the IRS nearly $81 million by knowingly participating in an unlawful tax shelter told a Manhattan federal judge Thursday that the creator of the so-called Son-of-Boss scheme is to blame.