If they have to cross difficult terrain they do so with no penalty and strike at Initiative.
If the enemy is IN difficult terrain, they still assault with no penalty, but I believe they'd still do so at I1.
In either event, as Skilled Riders they auto pass Dangerous Terrain tests.