Huddersfield boss Jan Siewert felt Tommy Smith's first-half red card 'broke them' as they fell to a 2-0 defeat at Newcastle.