I agree with the things people have said, but I also think that it's because it's pretty mainstream pop-ish. TO BE was released after the success of LOVE ~Destiny~ and because it's much more melancholy it did worse than the former...so I think the song's mainstream-ness has something to do with it.