I suggest you to perform some other tests...
I reinstalled full rom to have Miui Gallery v3.3.2 again, followed your steps and my result is that you can successfully delete some pictures but if you close the app (I mean also from the background) and you try again to delete some picture loop gets...