I have an i7 4790k with a 1070 as well and the same problems. Doesn't matter what detail level. Random framerate drops for no apparent reason.
If you're suffering from stuttering can you try enabling "prefer maximum performance" in the 3D tab in Nvidia control panel. This seems to have fixed the issue for some people