This is one of the benefits of using Factorization Machines with feature-rich datasets, for which there is a natural way in which extra features can be included in the model and higher order interactions can be modelled using the dimensionality parameter d. For sparse datasets, a second order FM model suffices, since there is not enough information to estimate more complex interactions.