AJ Brown misses practice with a knee issue. Did the Patriots overplay him?

Ian Rapoport reports AJ Brown's knee flared up and his status for Miami is up in the air. Was bringing him back so fast a mistake, and should the Patriots call about Josh Downs?