Audio driver mapped wrongly to Nvidia causing no audio input ubuntu 20.04

Current kernel is 5.15.10 (custom build, cannot downgrade as my laptop has very new hardware, lower kernels do not support some drivers for them). Sound chip is Realtek ACL287. Somehow the system does not show any audio input and output, after doing the following:

sudo apt-get remove --purge pulseaudio
sudo apt-get install pulseaudio
mv ~/.config/pulse ~/.config/new_pulse_conf

The speaker came back but not the integrated microphone (also, cannot pair any audio devices through bluetooth anymore)

Solutions that I've tried from No sound - Ubuntu 20.04 LTS:

1. Add options snd-hda-intel dmic_detect=0 at the end of /etc/modprobe.d/alsa-base.conf.
2. Edit /etc/modprobe.d/blacklist.conf as root and add the blacklist snd_soc_skl at the end of the file.

Also tried all the solutions that are from here: Sound card not detecting

Finally I figured out that the problem is due to the nvidia driver as it somehow makes the system to pick it up as the audio device instead of intel one.

Output of lspci:

lspci | grep Audio
01:00.1 Audio device: NVIDIA Corporation Device 2291 (rev a1)

Output for aplay -l:

**** List of PLAYBACK Hardware Devices ****
card 0: PCH [HDA Intel PCH], device 0: ALC287 Analog [ALC287 Analog]
  Subdevices: 1/1
  Subdevice #0: subdevice #0
card 0: PCH [HDA Intel PCH], device 3: HDMI 0 [HDMI 0]
  Subdevices: 1/1
  Subdevice #0: subdevice #0
card 0: PCH [HDA Intel PCH], device 7: HDMI 1 [HDMI 1]
  Subdevices: 1/1
  Subdevice #0: subdevice #0
card 0: PCH [HDA Intel PCH], device 8: HDMI 2 [HDMI 2]
  Subdevices: 1/1
  Subdevice #0: subdevice #0
card 0: PCH [HDA Intel PCH], device 9: HDMI 3 [HDMI 3]
  Subdevices: 1/1
  Subdevice #0: subdevice #0
card 0: PCH [HDA Intel PCH], device 10: HDMI 4 [HDMI 4]
  Subdevices: 1/1
  Subdevice #0: subdevice #0
card 0: PCH [HDA Intel PCH], device 11: HDMI 5 [HDMI 5]
  Subdevices: 1/1
  Subdevice #0: subdevice #0
card 0: PCH [HDA Intel PCH], device 12: HDMI 6 [HDMI 6]
  Subdevices: 1/1
  Subdevice #0: subdevice #0
card 0: PCH [HDA Intel PCH], device 13: HDMI 7 [HDMI 7]
  Subdevices: 1/1
  Subdevice #0: subdevice #0
card 0: PCH [HDA Intel PCH], device 14: HDMI 8 [HDMI 8]
  Subdevices: 1/1
  Subdevice #0: subdevice #0
card 0: PCH [HDA Intel PCH], device 15: HDMI 9 [HDMI 9]
  Subdevices: 1/1
  Subdevice #0: subdevice #0
card 0: PCH [HDA Intel PCH], device 16: HDMI 10 [HDMI 10]
  Subdevices: 1/1
  Subdevice #0: subdevice #0
card 0: PCH [HDA Intel PCH], device 17: HDMI 11 [HDMI 11]
  Subdevices: 1/1
  Subdevice #0: subdevice #0
card 1: NVidia [HDA NVidia], device 3: HDMI 0 [HDMI 0]
  Subdevices: 1/1
  Subdevice #0: subdevice #0
card 1: NVidia [HDA NVidia], device 7: HDMI 1 [HDMI 1]
  Subdevices: 1/1
  Subdevice #0: subdevice #0
card 1: NVidia [HDA NVidia], device 8: HDMI 2 [HDMI 2]
  Subdevices: 1/1
  Subdevice #0: subdevice #0
card 1: NVidia [HDA NVidia], device 9: HDMI 3 [HDMI 3]
  Subdevices: 1/1
  Subdevice #0: subdevice #0
card 1: NVidia [HDA NVidia], device 10: HDMI 4 [HDMI 4]
  Subdevices: 1/1
  Subdevice #0: subdevice #0
card 1: NVidia [HDA NVidia], device 11: HDMI 5 [HDMI 5]
  Subdevices: 1/1

Tried to override the driver using sudo driverctl set-override 0000:00:1f.3 snd_hda_intel and also tried sudo modprobe snd_hda_intel.

The current output:

sudo driverctl list-devices | grep snd_hda_intel
0000:00:1f.3 snd_hda_intel [*]
0000:01:00.1 snd_hda_intel

pactl does not show any input source as:

pactl list short sources
0   alsa_output.pci-0000_00_1f.3.analog-stereo.monitor  module-alsa-card.c  s16le 2ch 48000Hz   SUSPENDED

My Alsa information is located here: http://alsa-project.org/db/?f=9399f1580f85e78cb2115e6242ba93c9bfdb204a

Tried also force alsa reload: sudo alsa force-reload and also tried pavucontrol.

No idea what I could do without mess up nvidia gpu driver and audio driver at the same time..

After searching and trying. The problem is that somehow alsa having problem due to too many possible drivers from both Intel and Nvidia. The solution that worked for me is the following:

rm -r .config/pulse
sudo apt-get remove --purge pulseaudio
sudo apt-get install pulseaudio
pulseaudio -k
pulseaudio -vvv 

While doing the last step, it removed the unnecessary drivers, but it was taking ages in retrieving the valid driver. It could take hours, and got stacked in generating the correct mapping. I had to kill it, but after rebooting actually the audio (input/output) started to work again. Maybe another reboot will undo the effect.

Also, for other how had similar problem, worth trying to do: mv ~/.config/pulse ~/.config/new_pulse_conf after the re-installation. It worked once after rebooting (only once tho).