Yeah I know it has dropped it twice since I've had it,get big enough to get my hopes up,then the next time I see it it has dropped!!!
Well It's something to see about if the fruit makes it to the ripe stage!!!LOL
I have the same problem with my Atemoya. It bloomed madly, and set precisely one fruit (it's still small, so I didn't want to hand pollinate and stress the tree). It desperately needs up-potting, but I'm waiting until I harvest, because I'm greedy like that.