In five axis ball-end milling, the cutting edge is a continuous curve and the engagement with workpiece changes as the cutting tool rotates. Therefore the sensitivity to vibration varies along the cutting edge and as the tool rotates. In this paper, the vibration-force relationship (VFR) is obtained for infinitesimal length of cutting edge as a function of tool’s rotation angle. Numerical integration results in the VFR of the whole cutting edge and the tool. VFR of the tool is coupled to the dynamic vibration model of the tool and the workpiece to predict the possibility of vibrational instability. This algorithm is then used to predict the effects of changing the lead angle in a test setup with a flexible depth of cut direction. The analytical results, along with experiments demonstrate that the large lead angles considerably improve the stability of the process.