When I move the little diamond to the far right end of the bar (in the Modify Effect window), I get a very fast zoom out in the middle of the transition to the next piece of video.
If I remove the end diamond, I get the desired zoom in but as the transition to the next video segment starts, I get weird and undesirable flashes that totally break the flow of the video. It's very distracting.
The only way I've found, so far, is to produce a video file of just the one shot I want with the zoom in effect. And I leave the video much longer than I need it to be. Then I import that video to the file for the video I'm working on and trim the length so the rough end doesn't show.
That's a lot more messing around than I think I should have to do and I'm hoping that somebody knows a quicker, less hassle way to do what I want.