You don't need that much INT, really. 4-5 is fine w/ Educated. If you are using a guide to grab all the skill books, you'll have more than enough. You're missing a lot by ignoring melee weapons, and you don't need unarmed perks to have a good melee build. Energy weapons and shotguns aren't that great. As for your perks, not taking Bloody Mess, Cowboy, Living Anatomy, Confirmed Bachelor, Hunter, etc. is not a wise choice.. those are all straight up damage boosts.
Here's what I've got for my build.
SPECIAL: 7 STR, 5 PER, 7-8 END, 1 CHR, 4-5 INT, 6 AGI, 9 LCK.
Tag Repair, Sneak, and Lockpicking. Perks: 01 Fast Shot and Built to Destroy, 02 Rapid Reloads, 04 Educated, 06 Bloody Mess, 08 Cowboy, 10 Finesse, 12 Confirmed Bachelor, 14 Hunter, 16 Better Criticals, 18 Purifier, 20 Ninja, 22 Super Slam, 24 Jury Rigging, 26 Nerves of Steel, 28 Living Anatomy, 30 Math Wrath.
Fast Shot: Faster shots = more damage per second. Accuracy isn't as important.
Built to Destroy: The durability decrease isn't much compared to the extra crit stacking.
Rapid Reloads: A useful perk when you have several deathclaws, cazadors, nightclaws, etc. charging you and you need every second to count before they slaughter you or your companions, due to the very high damage they put out on Very Hard, even if you have 40 DT. If you're fighting groups of enemies, you'll have to reload eventually and the faster reloading will increase DPS. Finally, some weapons have pretty long reloads, although you won't be using them much once you have the really good ones.
Educated: You'll get an extra 50 or so skill points with this ability. It's not a mandatory perk, but it helps you get your Science and Med to 70 so you can pick up Living Anatomy and Math Wrath, and helps you get your Speech skill up.
Bloody Mess: 5% more damage on everything
Cowboy: Revolvers like the Ranger Sequoia and Mysterious Magnum pack a significant punch, and lever-action firearms includes powerful rifles like That Machine and the Cowboy Repeater.
Finesse: 5% more crit
Confirmed Bachelor: 10% more damage on male targets - perfect for a boost on legion troops and any other male targets
Hunter: Animals and mutated animals include Cazadors and Lakelurks. A 75% crit boost on these targets is great.
Better Criticals: 50% more crit damage
Purifier: Purifier targets Abomination, Ghoul, and Super Mutant type enemies, all of which tend to have a lot of HP.
Ninja: With this perk you'll be getting crits on almost every melee swing, making Oh, Baby! a very deadly weapon.
Super Slam: Activates all the time on blunt weapons. Perfect for knocking high HP enemies like Super Mutants and Deathclaws to the ground.
Jury Rigging: Lets you use powerful unique weapons and armor without having to worry about them eventually wearing out.
Nerves of Steel: More AP regen is always a good thing.
Living Anatomy: 5% more damage on all human targets and non feral ghouls
Math Wrath: 10% less AP use
Other perks to consider:
Commando and/or Sniper: More accuracy in VATS is good.
Grim Reaper's Spirit: Currently bugged so it doesn't work. But it's a good perk.