Why doesn’t remove_action work in my plugin?

I am not sure about BuddyPress specifics.

In general case remove doesn’t work when it is firing before function is actually added to the hook. Between core, plugins, parent and child themes there are a lot of relative combinations of add/remove possible.

In such case to make remove fire properly you need to wrap it into function and hook that wrapper function to some point later, after add.