Woah, it sounds like you're increasing the system bus from 100mhz from 150mhz.. no wonder the system didn't like it. When overclocking a kaby lake system you should leave the system bus at 100mhz and then increase the speed of the processor by increasing the cpu multiplier. Most motherboards don't like it when you increase the system bus above 100mhz.
[cpu multiplier] x [system bus] = cpu speed
45 x 100 = 4500 mhz
If the cpu multiplier was left at stock (42) and the bus was changed to 150mhz then that would have been 42 x 150 = 6300mhz.
Try setting the cpu vcore (voltage) to 1.28v and then the cpu multiplier (also known as core ratio) to 45 for all cores, and then changing the bus speed back to 100.
Before overclocking though I'd highly recommend taking a read through those two guides first.
One other thing I'd like to mention is Load Line Calibration (LLC). When the cpu is under load/stress then the voltage drops a bit (it's designed this way). There's a setting in your bios to adjust the level of LLC and this will control how much the system adds to the cpu voltage under load to counter the voltage drop. On the lowest setting it will basically do nothing and you'll see the cpu voltage drop some under load, while on the highest setting it will add so much voltage that the cpu voltage will actually go up some under load. Most people use a setting in the middle to try to keep the voltage as steady as possible between load and idle.
C-states lower the cpu speed & voltage when the system is idle... when you're in the process of trying to find your stable overclock then it's best to leave things running at a constant speed and disable c states. You can find more info here:
http://www.hardwaresecrets.com/ever...ow-about-the-cpu-c-states-power-saving-modes/
If you have any questions though just ask and any of us can jump in to answer / explain.
Even though you've got an MSI motherboard and I've got Asus, if you want I can upload screenshots of my bios settings (overclocked to 4.7ghz) and then you could try to use it as a starting point & adjust what you like.
Some useful tools for the overclocking process:
CPU-Z for seeing cpu speed, ram speed, and general system info:
http://www.cpuid.com/softwares/cpu-z.html
RealTemp for seeing cpu temperatures:
https://www.techpowerup.com/realtemp/
Prime95 for stress testing:
http://www.mersenne.org/ftp_root/gimps/p95v2810.win64.zip (utilizes avx and fma3 instruction sets to really stress the cpu... I run the blend test)
RealBench for stress testing:
http://dlcdnmkt.asus.com/rog/RealBench_v2.54.zip?_ga=1.134572529.1664667219.1491950447 (uses avx instructions but not nearly as stressful)
edit: Also if you set your RAM to XMP mode then it should automatically set the speed and timings for you... there should be a setting for it.