ISRG and Let's Encrypt
Today, the DST Root CA X3 certificate expired, leaving many devices on the internet having issues connecting to services and certificates that use this Root CA, including those using Let’s Encrypt certificates.
Some of these problematic devices include Samsung Galaxy phones, iPhones, VDI zero and thin clients, and even Sophos UTM firewalls.
In my environment, I noticed a number of issues when browsing to websites that use the free Let’s Encrypt certificates, as the Web Protection Web Filtering service on my Sophos UTM firewall would report the certificate has expired and not allow me access to the websites using it.
Let’s Encrypt originally used the “DST Root CA X3” certificate to issue Let’s Encrypt certificates. However, as time has passed and the service has been used more, they now use “ISRG Root X1” and “ISRG Root X2” as Root CA’s and “Let’s Encrypt R3” as an intermediate certificate.
Older devices may be using the older Root CA which expired today (September 30th, 2021). Please see https://letsencrypt.org/docs/dst-root-ca-x3-expiration-september-2021/ for more information.
To fix this issue, you need to add the 2 new Root CAs to your computer or device.
Root CA Certificates (PEM format):
Intermediate Certificate (PEM format):
You can download them by clicking the links above or go to https://letsencrypt.org/certificates/ for more information and to download if you don’t trust the above links.
After downloading and adding these Root CAs and the Intermediate CA to your computer or device, you should have the full certificate chain to validate the Let’s Encrypt certificates. You only need to add the two root certificates. The Let’s Encrypt certificates that are used on websites that you visit and that you might have deployed on your servers should now work without any issues.
If you’re still having issues, you can try deleting the “DST Root CA X3” certificate from your existing Root CAs. Also, you may need to close and reopen any software and/or browsers for it to work with the new certificate.
If you have a firewall that scans HTTPs traffic, you’ll need to add the two root certificates above to the HTTPS Certification authority list.
As an example, to fix this on the Sophos UTM firewall, follow the instructions below:
The steps should be similar for other firewalls that provide HTTPS Scanning and Filtering.
While most of us frequently deploy new ESXi hosts, a question and task not oftenly discussed is how to properly decommission a VMware ESXi host. Some might be surprised to… Read More
This guide will outline the instructions to Disable the VMware Horizon Session Bar. These instructions can be used to disable the Horizon Session Bar (also known as the Horizon Client… Read More
Normally, any VMs that are NVIDIA vGPU enabled have to be manually migrated with manual vMotion if a host is placed in to maintenance mode, to evacuate the host. While… Read More
You may experience GPU issues with the VMware Horizon Indirect Display Driver in your environment when using 3rd party applications which incorrectly utilize the incorrect display adapter. This results with… Read More
Today we're going to cover a powerful little NAS being used with VMware; the Synology DS923+ VMware vSphere Use case and Configuration. This little (but powerful) NAS is perfect for… Read More
Today we'll go over how to install the vSphere vCenter Root Certificate on your client system. Certificates are designed to verify the identity of the systems, software, and/or resources we… Read More
View Comments
Thanks Stephen. Your article last year fixed my Comodo cert expiring issue and now you have fixed my Let's Encrypt issue. In my case I needed to restart the UTM for the certs to come into effect. Thanks so much
Thanks for the precise and to-the-point information. This was bugging my email client since yesterday and besides all the discussions of concerned admins, no one except you seemed to bother providing a link to the three relevant certificates. A one minute fix.
Hi Stephen,
I ran into this problem and thankfully I found your post. CAn you go into detail about how to fix this problem? I downloaded the files but I have no idea what to do with them.
thank you every much. no where it is mentioned as perfectly as you did
genio! gacias por la solucion!
You're welcome! Glad it helped!
You saved my day...
This works perfectly... not sure until when but it works
Thank you Stephen! I've had two support requests caused by this issue in the last 24 hours. Your explanation and fix description is detailed and thorough. Thanks again.
Thank you so much: you saved may day !
In 5 minutes everything was again working fine with my HTTPS filtering/scanning on my Sophos UTM 9 appliance.
Very nice to see there are still people sharing valuable information...
This worked great! The "connection not secure" error message for visiting certain sites went away. I use a Mac, and after downloading the 3 certificates I had to follow the quick instructions at the link below and that did the trick:
https://support.apple.com/guide/keychain-access/change-the-trust-settings-of-a-certificate-kyca11871/mac
Thanks again, Stephen
Thank you Stephen! Phenomenal fix. I am a beginner end user and have Windows 7 (groan). However I determined in applying Stephen's fix the DER files worked. The PEM files would not. So for those of you that are attempting to apply the fix don't despair. After restarting my computer with the DER files so far I have had no issues. I also live in the USA.
Hope this information will help and encourage others to give it a try.
So grateful I found you and the fix!
I run mantry.com, Stephen gave me 1 minute of guidance over chat along with the thorough instructions on this blog and I was able to fix the DST Root CA X3 Certificate Expiration Problem. He made my week!
Hello Stephen
I just downloaded the files, but I don't know what's next
Do I need to reemplace the tree files on specific folder on my computer?
Greetings from Mexico
Hi Omar,
The Root CAs and Intermediate CA need to be added to your devices Certificate store. As an example, if this was windows, you'd add the Root CAs to the System's "Trusted Root Certification Authorities" store, and the Intermediate to the "Intermediate Authorities" store.
Cheers,
Stephen
According to Sophos, as of 10/1/21 at 19:00GMT an update was released and a restart is required because certain services such as web proxy cache the previously loaded certificates.
From https://support.sophos.com/support/s/article/KB-000042993?language=en_US
"The CA Data bundle for UTM has been released. All Sophos UTMs should have received & are updated.
This bundle removes the expired Let's Encrypt X3 CA from both the UTM cert store (used by web proxy, email) and WAF. This should automatically resolve the issue for both WAF & Email.
For awarren [sic] http (web proxy) it may require a restart before the issue is resolved. That’s because the proxy caches the CAs and requires a restart to reload.
Sophos Firewall web proxy - Hotfix roll out started to address issue Friday, Oct 1, 2021 19:00 GMT"
Hey Brent! Thanks for the update!
Thank you Stephen! These steps helped me resolve my issues I've been trying to resolve these past two days