If you use the Find My app on another Apple device (other than iCloud.com/Find), it may be able to locate your phone even if it is offline. See the following from Use Find My to locate your lost Apple device or AirTag - Apple Support
(and note in particular the last paragraph of the excerpt below)
If Find My shows "No location found" or "Offline"
- If Find My can't display the current location (because the phone is powered off or otherwise not sending its location), Find My displays the last location sent by the device or the last known location on the Find My network.
- If more than seven days have passed since your device last sent its location to Apple through the Find My network, Find My can't display a location and instead shows "No location found."
- If your device is online but is unable to send its location (for example, if there's an issue with Location Services), Find My can't display a location and instead shows "Not sharing location • Online."
The Find My network is an encrypted, anonymous network of hundreds of millions of Apple devices that can help find your stuff, even when it's offline. Nearby devices securely send the location of your missing device to iCloud, so that you can find it in Find My. It's all anonymous and encrypted to protect everyone's privacy.