The potential of continued cuts to Internal Revenue Service funding is one of the biggest challenges currently facing the agency, the Treasury Inspector General for Tax Administration said in a report published Friday.