"When he peeped out in the lightning-flashes, he saw that across the valley the stone-giants were out, and hurling rocks at one another for a game, and catching them, and tossing them down into the darkness where they smashed among the trees far below, or splintered into little bits with a bang."
Did the company have to run for their lives from the giants? No. But they were there, and the company was aware and afraid of them, despite them not appearing in the rest of the story, or LotR.