That sounds like you have clips with a different aspect ration than the project. For example, 4:3 or 21:9 clips in a 16:9 project.
There are no settings to change, and the only thing you can do is to use the PiP Designer (or drag the control button in the middle of one of the sides with the black bars on the preview screen) to enlarge the scale to fill out the entire screen.