Leyland cypress on the east coast are frequently plagued by bagworms and a variety of fungal problem including several cankers and root rots. Depending on what exactly the problem may be, it is sometimes treatable and other times, removal and replacement is the only solution.
As common as these problems seem to be, I'm surprised the county extension agent wasn't more familiar with them and could give you better advice. This link may help clarify your problem: