Message deletion comes in two kinds. "Delete for me" removes a message from your own view only; the other person still has it. "Delete for everyone" (or "unsend") removes it from the conversation for everybody, usually within a time limit, and often leaves a note saying a message was removed.
Neither is a guarantee the message was never seen. The other person may have read it, screenshotted it, or had it forwarded to a notification on their locked screen before you deleted it. Backups on the other person's device may keep a copy.
If you often want messages gone, disappearing messages, which delete themselves after a set time for everybody in the conversation, are a more reliable tool than remembering to delete.
Where Naven stands
Naven lets you unsend a message and leaves a note that a message was unsent, rather than removing the gap silently. Conversations can also turn on disappearing messages.