Character config > Control > Character > Battle Effects settings
Everyone should be made aware of how much these can improve your framerate. I just put 'Others' to 'Limited' and I get a huge framerate improvement during FATEs. Whatever you feel like of course.
Does this also make sure NPCs get loaded first instead of players?