I know, so theoretically your problem can be something else
But you should still be able to see if AdAway icon disappears and if it's the case you would know what's the problem.
I've checked and found that it works even when set as 'Battery saver'
I'm not sure about notifications, but many apps...