Can no longer drag pinned tabs to reorder

I have 5 pinned tabs, and I would like to reorder them by dragging. You used to be able to freely drag them right to left, but if I drag them more than 1 position, I get a window appearing, and the tab becomes unpinned.