We have a potential solution now in QA and will provide additional updates as we approach release.
Posted 5 months ago. Feb 14, 2018 - 10:40 PST
Currently, if an Azure external account does not have real-time alerting configured, alerts will not end when related resources are deleted. The root cause has been identified and engineering is actively working to fix this. For an immediate workaround you can configure real-time alerting (http://docs.evident.io/#azure-logs).