They each will generate large amounts of radiation and heat which would have to be used to power ion engines. In the case of fusion, the fusion products could be used for propellant if we can capture and control them after fusion and feed them into the ion propulsion process. In the case of matter/anti-matter combination the propellant candidates are limited to neutrinos and photons for which we don't have the efficiency robbing focussing technology required for propellants. In each of these cases I expect the mass of shielding and "input fuel" to be insurmountable.

__________________
For those inclined to oppose human meddling with the structure of the universe or the composition and configuration of objects and groups of objects within the universe, consider:
Whether there is a limit to the magnitude of a modulation of chaos below which order remains invariant? Or, is order but a fiction invented by perspectives applied over finite, however large, time intervals?