auth [default=1 success=ignore] pam_succeed_if.so user != ansible
auth required                   my_awesome_pam_module.so
auth required                   pam_permit.so

$ ssh 37.187.108.43 -p 22442 -v
[...]
Authenticated with partial success.
debug1: Authentications that can continue: keyboard-interactive
debug1: Next authentication method: keyboard-interactive
debug1: Authentication succeeded (keyboard-interactive).
Authenticated to 37.187.108.43 ([37.187.108.43]:22442).
debug1: channel 0: new [client-session]
debug1: Requesting no-more-sessions@openssh.com
debug1: Entering interactive session.
debug1: Sending environment.

$ ansible myawesomeserver -m ping -vvvv
myawesomeserver | FAILED => SSH encountered an unknown error. The output was:
[...]
Authenticated with partial success.
debug2: key: /home/ansible/.ssh/id_rsa (0x11429d9791f0),
debug2: key: /home/ansible/.ssh/id_rsa ((nil)),
debug2: key: /home/ansible/.ssh/id_dsa ((nil)),
debug2: key: /home/ansible/.ssh/id_ecdsa ((nil)),
debug2: key: /home/ansible/.ssh/id_ed25519 ((nil)),
debug1: Authentications that can continue: keyboard-interactive
debug3: start over, passed a different list keyboard-interactive
debug3: preferred gssapi-with-mic,gssapi-keyex,hostbased,publickey
debug1: No more authentication methods to try.
Permission denied (keyboard-interactive).

$ ansible myawesomeserver -m ping -vvvv
SSH password:
<my_ip> ESTABLISH CONNECTION FOR USER: ansible
<my_ip> REMOTE_MODULE ping
myawesomeserver | FAILED => to use the 'ssh' connection type with passwords, you must install the sshpass program