Civil Rights and Housing advocates have filed a lawsuit against the town of Woodbridge in hopes of opening its doors to more affordable housing.