To date, the best books I've found for getting your feet wet in Mac OS X are the Big Nerd Ranch books. They're not written in Swift, but frankly most of the difficulty lies in learning the Objective-C AppKit frameworks. And they're not nearly as clean or beginner friendly as their UIKit counterparts in iOS, several parts still date back to the OpenStep days.
Cocoa Programming for Mac OS X
Advanced Mac OS X Programming
There's not nearly as much demand for OS X development as there is for iOS development, so I expect lessons in Swift will take some time to find their footing in OS X. Plus, some of the most powerful, interesting and portable(!) OS X frameworks and functions tend to be C based, so having some footing in C and UNIX makes sense in the long run. Especially if you ever want to give Linux or app programming for other UNIX kernels a try someday.
For clean, modern Objective-C, I highly recommend the Scott Meyers endorsed
Effective Objective-C 2.0. It should help bridge some gaps between Objective-C and Swift, and it'll let you know what parts of Objective-C you don't need anymore.
The
Objective-C 2.0 Phrasebook is another one that I've enjoyed having by my side. Lots of quick, recipe solutions there that work for AppKit (OS X) and UIKit (iOS), and the examples are short enough that they aren't hard to translate to Swift. It's also written by the author behind the GNUstep Objective-C runtime, so he knows his stuff.