Did you Upgrade to the new Home architecture?
Any device that is connected to an upgraded home and not running the latest software will lose access to the home until the device is updated. This includes people that you invite to control your home.
Once you’ve upgraded to this, any devices not running the latest software can’t use the home app (on that device) or receive invites.
As per your title “without a Hub”. You need to have an Apple TV or HomePod to act as the hub to set up Homekit in the Home App.