A social worker who tried to see a toddler in the weeks before he was allegedly murdered by his grandparents was told the child was having a nap, a court has heard.