From Scandi to French Women, Everyone Agrees on This Controversial Trouser Trend