Not a bad idea, but Brown had a pretty fair year and 5 million is not that much for a starting CB.
That said, barring injuries I doubt Brown is the starting CB next yr (unless he is the #3 guy) as I think our 2nd rd pick is gonna win that job pretty easy. Kid has a ton of talent.