How to use the same two monitors with two different Mac minis (without constantly unplugging)?

Hi everyone,

I’m setting up a second Mac mini and I’d like to use the same two external monitors with both machines, without physically unplugging cables each time.

Current setup

Mac mini #1: [model/chip + macOS version]

Mac mini #2: [model/chip + macOS version — e.g., “Mac mini (M4)”]

Displays: 2x [brand/model], resolution/refresh rate (e.g., 4K @ 60 Hz), HDR on/off

Connections on Mac mini #1: [e.g., HDMI for Display 1 + USB-C/Thunderbolt for Display 2]

Connections on Mac mini #2: [same or planned]

Peripherals: [keyboard/mouse model], audio output [monitor speakers / interface / headphones]

Goal

Use both Macs with the same two monitors (and ideally the same keyboard/mouse) and switch between Macs quickly—without re-cabling—while keeping stable resolution/refresh (and HDR if possible).

Something like a KVM switch system.

If you have a known-good wiring diagram (e.g., “Macs → KVM → monitors” with exact ports/cables) or specific product recommendations that have worked reliably with Mac minis, I’d really appreciate it. Also happy to hear about any pitfalls before I buy the wrong KVM/dock.

Thanks a lot!