I'd use 2 part epoxy. Both surfaces need to be flat and cleaned with acetone for the best hold. 5 minute epoxy is plenty strong.
Alternatively, use a gel form of CA (superglue - several brands are on the shelves) - it takes a little longer to set (~30 sec) and the gel type will fill any space btwn the wood and metal.