I used cmd+J for two perfectly symmetric shapes to join them (points are tied to the pixel grid and that shapes are close to each other with no space between). Works fine if we'll use fill color. But something weird happens when I set the stroke:
How to merge / unite two shapes in Photoshop to avoid that? I found only one way to fix that: overlap one shape over another, but it won't work if we'll have more complicated shapes.