Changing the sequence of stitches for the edges of the petal helped solve the square issue. Now I think I've found a solution for flatness.
I added a couple of extra stitches to each petal. That makes the whole flower a bit tighter and pushes the petals together just a bit. I think it's better.