Got the same problem. Got the 5th one on my map too, but just can't get the second one.
Yeah there are, but the system is absolutely ridiculous. In the city there are those unnamed NPCs with yellow dialogue boxes and when you pass them you'll get the heart to heart on your map if that dialogue box is about your party character. Often times they're about tyrants or treasures or such.
The dialogue boxes also aren't all there immediately but they become available after doing certain things (such as completing a certain quest).
They can be pretty hard to find too since they're not visible to very far. And I'm pretty sure at least some of them are in place only at night or day.