A CP on the lens will help but there will still be reflections that the CP will not filter out. Using a sheet of linear polarizing material on the light source will give you better control.
This is an example of a 17 x24 polarizing filter for use with a softbox. Smaller could be made for strobe or other light source use.