Detroit Lions defensive line coach Terrell Williams agreed Wednesday to join new New England Patriots coach Mike Vrabel's staff as defensive coordinator, the Patriots announced Wednesday.