You should check the laws within your state as they relate to your question. Generally, if someone tries to forceably remove your sidearm, that is considered a deadly threat warranting the appropriate response on your part.
In MI this would fall under our SYG law. If someone manages to disarm me, I am in fear for my life. There is an imminent threat of great bodily harm, rape or death. Lethal force is authorized.