Getting the Stones to unsnap everyone

I think I read this on a post somewhere and was surprised more people didn't pick up on it, once the Avengers has established they could travel through the quantam realm, why not pick the point in time a few days prior to Thanos snapping his fingers to destroy the stones. Take everyone they had, and in spite of missing all those snapped away it was still a formidable group, travel to 'the garden' and retrieve them from there, rather than scattering across multiverses and different years.

This does seem like a potentially better outcome, Natasha would have survived, they know he was unarmed etc. Just wondered if there are any thoughts or obvious reasons why they didn't go that route (obviously because the writters didn't write it that way, i know i know........)