Sorry, but if you are using writing to communicate about issues at work or issues related to the work environment, it is not illegal for the supervisor to keep the note. It is not a breach of your confidentiality if he is not making the correspondance available to everyone.
The same would hold true for emails or texts in the work environment. For one thing, it serves as documentation that accommodation is being made.
