We have a potential solution now in QA and will provide additional updates as we approach release.
Posted about 1 month ago. Feb 14, 2018 - 10:40 PST
Currently, if an Azure external account does not have real-time alerting configured, alerts will not end when related resources are deleted. The root cause has been identified and engineering is actively working to fix this. For an immediate workaround you can configure real-time alerting (http://docs.evident.io/#azure-logs).