- Select the pattern filled rectangle
- Choose
Object > Transform > Move
- Untick
Transform Objects
- Tick
Transform Patterns
- Change the
Horizontal
and Vertical
fields to move the pattern to where you want it.

(This, combined with @BillyKerr's answer, should get you what you want.)
Admittedly, I don't see why you need a pattern offhand. There may be some reason I'm unaware of. If you simply want to repeat those 4 squares down the artboard, you don't need a pattern. Just repeat them. A pattern may be unwarranted overhead. If you want to use a pattern, you don't need the 4 duplicates to create the tile, you merely need 1.
Patterns intentionally auto-offset to create a more seamless appearance overall.
It's also possible move, scale, rotate, etc. just the pattern fill of a shape, without altering the shape itself, by holding down the Grave ` key (which is also Tilde ~ with shift - if your keyboard has that key - immediately left of the 1 key) while you click-drag with the cursor.