On Butler’s Farm, Joe instructed two builders to knock down Holly Barton’s memorial. Holly is Moira’s late daughter, who died as a result of a drug addiction. A tree was planted after her death, which was regularly visited by Moira and Matty Barton. When the Dingles discovered Holly’s memorial had been destroyed, they all naturally assumed Joe had something to do with it, but no-one got actual confirmation due to lack of proof and, well, the fact Joe would rather lie to everyone than tell the truth and face the Dingles wrath.
This action driven by Joe has generated a strong reaction in the Emmerdale community, questioning his permanence in the series.
Dawn Taylor's reaction to the cutting down of Holly's tree was the one that caused Joe the most fear. He told Dawn that he had nothing to do with it, and while she said she believed him, she also said that if he did, they wouldn't continue their relationship.