We currently only handle translation of all the points in the bounding box together. Let's support scaling etc. As such we will also need to draw the handles at the corner and mid points of the edges to drag from.