`podman manifest inspect` is not suitable for this task. It inspects
image manifests the same way as it does with manifest lists, as a result
it tries to push everything as manifest lists which breaks.

This patch tries to fix that problem by using `podman manifest exists`
instead.