Located along the road that leads to the old sulphur quarry, it is the church farthest from the town but no less popular for the people of Latera.
Built in a rectangular shape with a single nave, it contains five altars, decorated with frescoes and paintings of some value, testifying the importance it held for its worshippers and for the rulers of the village at different times.
To the left of the first altar there is a fresco depicting St. Sebastian, an exact copy of the subject painted on canvas in 1596 in the church of St. Salvatore in Farnese. It shows the date 1501, an illegible signature and the coat of arms of the Farnese family at the bottom: however, the dating is considered unlikely and it is preferably attributed to the Emilian artist Anton Maria Panico, a pupil of Carracci.
On the other altars there are the images of St. Anthony of Padua, St. Francis Xavier and St. Anthony Abbot, while the 15th-century image of the Madonna and Child holding a little bird, which gives the church its title, is a copy: the original was transferred to the parish church of St. Clement in 1739 and placed above the altar of the Holy Crucifix.
The year of the church's construction is unknown, although it most likely predates 1400: from the minutes of the General Council of 1579 and from an inquiry made in the same year in order to prove that the chapels of St. Sebastian and the Madonna della Cava were the jus (right) of the Community, a terminus ante quem is inferred, as the five witnesses agree that the two chapels were very old, built before their parents were born.