The filter is added before the call to fetch_feed, then immediately removed so only that particular feed is given a different feed cache transient lifetime. Any other fetch_feed calls within the lifetime of the request won’t have that filter applied, so will be given whatever the default cache transient lifetime value is.
