The Daylite preferences Contact Sharing provide these two options:
All contacts or Only contacts in the "Shared People" and "Shared Companies" lists
Chose Only contacts in the "Shared People" and "Shared Companies" lists to determine for yourself which contacts you'd like to sync.
In Daylite you will see two lists in the Contacts section: Shared Companies and Shared People. These lists contain the sets of contact data whose owner you are. When you create new contacts these will be linked with these two lists automatically.
To add more contacts to the lists, drag them on the list name in the sidebar.
If you have contact on the list who you don't want to sync, you can disable syncing by unchecking the checkbox in the shared section.
This article covers setting up contact syncing: How do I connect Daylite to the Apple Contacts app on the Mac (CardDAV)?
How do I connect Daylite with the Apple Calendar app for iPhone or iPad (CalDAV)?
How can I test whether your Daylite server's CalDAV/CardDAV interface works generally?
What are CalDAV and CardDAV?
How do I remove a CardDAV account on my Mac?