Does an observer in that galaxy see our galaxy magnified as well?
It is highly unlikely that a galaxy that we see as magnified by lensing is, has, or will be positioned to see our galaxy similarly magnified. The three galaxies, including the lensing galaxy or cluster, are moving with respect to each other. Our proper motion with respect to the microwave background is about 630 km/s, so these are typically quite high velocities. Now, consider the plane containing the Milky Way (MW), the lensing galaxy, and our motion with respect to the lensing galaxy. It is moving and tilting, but let’s take it as stationary and the other galaxies are moving through it. The magnified image of the MW is always on this plane and it is moving along arcs that start at the lens and curve outward. There is another arc on this plane for magnified regions of space that we see. It also is curved, starting at the lens and curving outward, but backwards in time. We see a galaxy magnified because it crossed the plane at just the right location and time, billions of years ago, so that light from it is lined up to reach us today. But, the curve of images we see and the curves of images others see, go off in different directions because the first is based on where we are when we see it and the other is based on where we were when the light left us. It is not possible for a galaxy to pass this plane twice because the MW has never reversed its trajectory. The curves do join at the lens but the magnification there is very low.
Only if the three galaxies remained in a line for billions of years could they see each other as gravitationally lensed magnified images.
It depends on the distance between us, the lens galaxy, the magnified galaxy, and many other factors due to the way light travels. A lens galaxy passes the old light of a far-off galaxy and amplifies it in our direction due to perfect alignment.
It does not mean that an observer in the distant galaxy would see the same thing, however. For example, if the lens galaxy/cluster is closer to us than it is to the galaxy that we are magnifying, which it often is, the light of the Milky Way being amplified from the opposite view would not have reached the distant one, and will almost certainly never align since galaxies are constantly changing position. In other words, by the time the magnified light of the Milky Way reaches the other galaxy's original position, it would have already moved an enormous distance, well out of alignment.
The answer: No. Just because a galaxy is amplified for us, it does not mean we are amplified to the other galaxy due to a significant delay in light travel over such distances.
Postscript: Even if both the Milky Way and some distant galaxy were magnified from both perspectives at the same time due to some rare coincidence, being able to see one another still depends on many factors such as luminosity. For instance, if the distant galaxy hosts a quasar, we could see them - though they may not be able see us, at least not as well, unless Sagittarius A* was also a quasar when the Milky Way's light reached the other galaxy.