Is there a way to hide the elements which span beyond the canvas area (artboard) in Sketch?
Try using a mask to hide the parts you don't want.
Found the answer.
All layers should be placed inside the "canvas" or "artboard" layer.
E.g. If you start the document with the iPad Landscape template, all of your objects should stay inside of that layer, otherwise they can bleed out.