His lawyer had argued the sentence was unfair and claimed Clifford was not a threat to women but this was rejected by the Court of Appeal on Friday morning.
The court ruled the sentence handed to Clifford earlier this year was justified and correct.
Clifford was convicted in April of eight historical indecent assaults on women and on girls as young as 15.
He was famed for representing celebrities including Simon Cowell, Jade Goody, former prostitute Pamela Bordes and comedian Freddie Starr.
He was first arrested in December 2012 as part of the Operation Yewtree inquiry and was charged last April.
