I am not able to uninstall Ubuntu from WSL

I had created an Ubuntu distro on wsl. I then removed it using wsl --unregister Ubuntu. That completed successfully. Now when I run wsl -l -v, I get

Distributions can be installed by visiting the Microsoft Store:https://aka.ms/wslstore

as expected.

The issue is I'm still able to access the distro from VS code. When I ran winget list, I got the following in my output.

Name                                          Id                                                   Version--------------------------------------------------------------------------------------------------------------------Ubuntu                                        CanonicalGroupLimited.Ubuntu_79rhkp1fndgsc           2204.1.8.0

To remove it, I ran winget uninstall Ubuntu to get this :

Failed when searching source; results will not be included: wingetFound Ubuntu [CanonicalGroupLimited.Ubuntu_79rhkp1fndgsc]Starting package uninstall...Successfully uninstalled

The issue is when I run winget list, I can still see Ubuntu installed. I'm not able to uninstall it, and I'm still able to access it from VS Code. Yet, I'm not able to see it with wsl -l -v, or in the "Add or Remove Programs" Windows setting. How can I get rid of this distro completely?