Slack will have temporary access to messages (in transit on their backend), but if the keys are revoked by the organization then yes Slack cannot see them.