And it clearly would be necessary because even these higly sophisticated models would only look for what they are trained for and will have a lot of arbitrary/non relevant findings.

Also someone has to take responsibility. The moment software firms are willing to take full responsibility without disclaimers I will start to believe they might be able to replace some people.