Drag from container and click children without setTopOnly?

I have a container with some coins which are clickable and the container is draggable, but I want to be able to drag the coins as well as able to click on the coins, I know it’s possible to do this with

setTopOnly(false);

but I don’t want to use this because I have other buttons and UI elements that depend on this being true, so I’ve been trying to remove interactivity on the coins while dragging them, but when I do this, the coins are draggable every 2 clicks. Any ideas to solve this?

I performed a workaround by enabling and disabling the setTopOnly option when needed, that way I can drag the coins while using the other buttons in the screen without any problem.