Paul Clement says despite a positive start, Burnley's first goal affected Swansea's confidence following their 2-0 defeat.