Yes, a post is “attached” to its parent post. It’s the same as when a page has a parent page, there is no difference internally.
Keep in mind though, that not all images on a post are attached to that post, and an image can appear in posts it’s not attached to.
If you’re in the user interface, you can use the uploaded to link in the detail view