I'd leave a gap, then trim it out.
'Course I'd box the ductwork to begin with, but your project may differ from those I've encountered. IME construction/remodeling is always a series of compromises but there are no expansion/contraction issues in your situation of which I am aware. ------ gpsman