I believe the important distinction is between 'having access to phonebook for calls and chats' and 'datamining phonebook for the needs of Facebook'.

Signal (the foundation) does not get to use my phonebook even if Signal (the app) does.

Made the switch yesterday. Hope this will be a turning point for Facebook