Bad promotion is another factor.
Look at hikki. She speaks English fluently. But her English album did really really bad in US/Europe.
And I agree with Luv that Japanese music industry look on the number of no.1s more important than the number of sales. We all know that ayu's sales are declining, so her no. 1 streak is the thing to maintain her current statue.